Note: This is test shard 4 of 8.
[==========] Running 7 tests from 6 test suites.
[----------] Global test environment set-up.
[----------] 1 test from LocationAwareRebalancingBasicTest
[ RUN ] LocationAwareRebalancingBasicTest.Basic
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260810 01:55:29.457556 21763 ts_itest-base.cc:115] Starting cluster with:
I20260810 01:55:29.457813 21763 ts_itest-base.cc:116] --------------
I20260810 01:55:29.457899 21763 ts_itest-base.cc:117] 6 tablet servers
I20260810 01:55:29.458017 21763 ts_itest-base.cc:118] 3 replicas per TS
I20260810 01:55:29.458096 21763 ts_itest-base.cc:119] --------------
2026-08-10T01:55:29Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:55:29Z Disabled control of system clock
I20260810 01:55:29.489279 21763 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNubV1X/build/asan/bin/kudu
/tmp/dist-test-taskNubV1X/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.64.254:44083
--webserver_interface=127.21.64.254
--webserver_port=0
--builtin_ntp_servers=127.21.64.212:41935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.64.254:44083
--location_mapping_cmd=/tmp/dist-test-taskNubV1X/build/asan/bin/testdata/assign-location.py --state_store=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/location-assignment.state --map /A:2 --map /B:2 --map /C:2
--tserver_unresponsive_timeout_ms=3000
--enable_range_replica_placement=false
--raft_prepare_replacement_before_eviction=true
--enable_range_replica_placement=false with env {}
W20260810 01:55:29.859699 21780 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:55:29.860136 21780 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:55:29.860281 21780 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 01:55:29.869387 21780 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:55:29.869515 21780 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:55:29.869633 21780 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:55:29.869730 21780 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:55:29.879966 21780 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.64.212:41935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/wal
--enable_range_replica_placement=false
--location_mapping_cmd=/tmp/dist-test-taskNubV1X/build/asan/bin/testdata/assign-location.py --state_store=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/location-assignment.state --map /A:2 --map /B:2 --map /C:2
--ipki_ca_key_size=768
--master_addresses=127.21.64.254:44083
--tserver_unresponsive_timeout_ms=3000
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.64.254:44083
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.21.64.254
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 01:44:04 UTC on e7f111948823
build id 13266
ASAN enabled
I20260810 01:55:29.882340 21780 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:55:29.885007 21780 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 01:55:29.904491 21794 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:55:29.904603 21788 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:55:29.904393 21791 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:55:29.905728 21780 server_base.cc:1061] running on GCE node
I20260810 01:55:29.906929 21780 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:55:29.909507 21780 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:55:29.910894 21780 hybrid_clock.cc:648] HybridClock initialized: now 1786326929910856 us; error 65 us; skew 500 ppm
I20260810 01:55:29.911418 21780 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 01:55:29.914798 21780 webserver.cc:533] Webserver started at http://127.21.64.254:43149/ using document root <none> and password file <none>
I20260810 01:55:29.915953 21780 fs_manager.cc:362] Metadata directory not provided
I20260810 01:55:29.916136 21780 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:55:29.916735 21780 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:55:29.920549 21780 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "bf0370fa21854d2c844561ee38dfbd53"
format_stamp: "Formatted at 2026-08-10 01:55:29 on dist-test-slave-bw88"
I20260810 01:55:29.922010 21780 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "bf0370fa21854d2c844561ee38dfbd53"
format_stamp: "Formatted at 2026-08-10 01:55:29 on dist-test-slave-bw88"
I20260810 01:55:29.930645 21780 fs_manager.cc:696] Time spent creating directory manager: real 0.008s user 0.006s sys 0.001s
I20260810 01:55:29.936301 21802 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:55:29.938539 21780 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.001s sys 0.001s
I20260810 01:55:29.938803 21780 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/wal
uuid: "bf0370fa21854d2c844561ee38dfbd53"
format_stamp: "Formatted at 2026-08-10 01:55:29 on dist-test-slave-bw88"
I20260810 01:55:29.939055 21780 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:55:29.959699 21780 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 01:55:29.960899 21780 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:55:29.961285 21780 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:55:29.991930 21780 rpc_server.cc:307] RPC server started. Bound to: 127.21.64.254:44083
I20260810 01:55:29.991915 21871 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.64.254:44083 every 8 connection(s)
I20260810 01:55:29.994848 21780 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260810 01:55:29.999825 21763 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNubV1X/build/asan/bin/kudu as pid 21780
I20260810 01:55:30.000248 21763 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/wal/instance
I20260810 01:55:30.002224 21872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:30.020300 21872 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf0370fa21854d2c844561ee38dfbd53: Bootstrap starting.
I20260810 01:55:30.027724 21872 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bf0370fa21854d2c844561ee38dfbd53: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:30.029587 21872 log.cc:826] T 00000000000000000000000000000000 P bf0370fa21854d2c844561ee38dfbd53: Log is configured to *not* fsync() on all Append() calls
I20260810 01:55:30.033833 21872 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf0370fa21854d2c844561ee38dfbd53: No bootstrap required, opened a new log
I20260810 01:55:30.040915 21872 raft_consensus.cc:359] T 00000000000000000000000000000000 P bf0370fa21854d2c844561ee38dfbd53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf0370fa21854d2c844561ee38dfbd53" member_type: VOTER last_known_addr { host: "127.21.64.254" port: 44083 } }
I20260810 01:55:30.041591 21872 raft_consensus.cc:385] T 00000000000000000000000000000000 P bf0370fa21854d2c844561ee38dfbd53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:30.041793 21872 raft_consensus.cc:740] T 00000000000000000000000000000000 P bf0370fa21854d2c844561ee38dfbd53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf0370fa21854d2c844561ee38dfbd53, State: Initialized, Role: FOLLOWER
I20260810 01:55:30.043401 21872 consensus_queue.cc:260] T 00000000000000000000000000000000 P bf0370fa21854d2c844561ee38dfbd53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf0370fa21854d2c844561ee38dfbd53" member_type: VOTER last_known_addr { host: "127.21.64.254" port: 44083 } }
I20260810 01:55:30.043831 21872 raft_consensus.cc:399] T 00000000000000000000000000000000 P bf0370fa21854d2c844561ee38dfbd53 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:55:30.044098 21872 raft_consensus.cc:493] T 00000000000000000000000000000000 P bf0370fa21854d2c844561ee38dfbd53 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:55:30.044413 21872 raft_consensus.cc:3060] T 00000000000000000000000000000000 P bf0370fa21854d2c844561ee38dfbd53 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:30.047044 21872 raft_consensus.cc:515] T 00000000000000000000000000000000 P bf0370fa21854d2c844561ee38dfbd53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf0370fa21854d2c844561ee38dfbd53" member_type: VOTER last_known_addr { host: "127.21.64.254" port: 44083 } }
I20260810 01:55:30.048149 21872 leader_election.cc:304] T 00000000000000000000000000000000 P bf0370fa21854d2c844561ee38dfbd53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bf0370fa21854d2c844561ee38dfbd53; no voters:
I20260810 01:55:30.049064 21872 leader_election.cc:290] T 00000000000000000000000000000000 P bf0370fa21854d2c844561ee38dfbd53 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:55:30.049367 21879 raft_consensus.cc:2804] T 00000000000000000000000000000000 P bf0370fa21854d2c844561ee38dfbd53 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:55:30.050424 21879 raft_consensus.cc:697] T 00000000000000000000000000000000 P bf0370fa21854d2c844561ee38dfbd53 [term 1 LEADER]: Becoming Leader. State: Replica: bf0370fa21854d2c844561ee38dfbd53, State: Running, Role: LEADER
I20260810 01:55:30.051144 21879 consensus_queue.cc:237] T 00000000000000000000000000000000 P bf0370fa21854d2c844561ee38dfbd53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf0370fa21854d2c844561ee38dfbd53" member_type: VOTER last_known_addr { host: "127.21.64.254" port: 44083 } }
I20260810 01:55:30.051987 21872 sys_catalog.cc:565] T 00000000000000000000000000000000 P bf0370fa21854d2c844561ee38dfbd53 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:55:30.058421 21880 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf0370fa21854d2c844561ee38dfbd53 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bf0370fa21854d2c844561ee38dfbd53" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf0370fa21854d2c844561ee38dfbd53" member_type: VOTER last_known_addr { host: "127.21.64.254" port: 44083 } } }
I20260810 01:55:30.059231 21880 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf0370fa21854d2c844561ee38dfbd53 [sys.catalog]: This master's current role is: LEADER
I20260810 01:55:30.058059 21881 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf0370fa21854d2c844561ee38dfbd53 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bf0370fa21854d2c844561ee38dfbd53. Latest consensus state: current_term: 1 leader_uuid: "bf0370fa21854d2c844561ee38dfbd53" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf0370fa21854d2c844561ee38dfbd53" member_type: VOTER last_known_addr { host: "127.21.64.254" port: 44083 } } }
I20260810 01:55:30.060189 21881 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf0370fa21854d2c844561ee38dfbd53 [sys.catalog]: This master's current role is: LEADER
I20260810 01:55:30.064638 21888 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260810 01:55:30.073537 21888 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260810 01:55:30.087335 21888 catalog_manager.cc:1383] Generated new cluster ID: 283dc7b4014e4c56a95dc94c4daea179
I20260810 01:55:30.087509 21888 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260810 01:55:30.102680 21888 catalog_manager.cc:1406] Generated new certificate authority record
I20260810 01:55:30.104477 21888 catalog_manager.cc:1540] Loading token signing keys...
I20260810 01:55:30.120637 21888 catalog_manager.cc:6092] T 00000000000000000000000000000000 P bf0370fa21854d2c844561ee38dfbd53: Generated new TSK 0
I20260810 01:55:30.121891 21888 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260810 01:55:30.136838 21763 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNubV1X/build/asan/bin/kudu
/tmp/dist-test-taskNubV1X/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.64.193:0
--local_ip_for_outbound_sockets=127.21.64.193
--webserver_interface=127.21.64.193
--webserver_port=0
--tserver_master_addrs=127.21.64.254:44083
--builtin_ntp_servers=127.21.64.212:41935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
W20260810 01:55:30.492400 21907 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:55:30.492719 21907 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:55:30.492798 21907 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 01:55:30.502110 21907 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:55:30.502288 21907 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.64.193
I20260810 01:55:30.513209 21907 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.64.212:41935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.64.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.21.64.193
--webserver_port=0
--tserver_master_addrs=127.21.64.254:44083
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.64.193
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 01:44:04 UTC on e7f111948823
build id 13266
ASAN enabled
I20260810 01:55:30.514981 21907 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:55:30.516924 21907 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 01:55:30.531581 21916 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:55:30.531606 21917 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:55:30.533370 21920 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:55:30.533862 21907 server_base.cc:1061] running on GCE node
I20260810 01:55:30.534476 21907 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:55:30.535457 21907 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:55:30.536705 21907 hybrid_clock.cc:648] HybridClock initialized: now 1786326930536658 us; error 38 us; skew 500 ppm
I20260810 01:55:30.537041 21907 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 01:55:30.539438 21907 webserver.cc:533] Webserver started at http://127.21.64.193:37219/ using document root <none> and password file <none>
I20260810 01:55:30.540256 21907 fs_manager.cc:362] Metadata directory not provided
I20260810 01:55:30.540395 21907 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:55:30.540792 21907 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:55:30.543773 21907 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "c5ca831c32e4452dba1cfc6cd296e532"
format_stamp: "Formatted at 2026-08-10 01:55:30 on dist-test-slave-bw88"
I20260810 01:55:30.544620 21907 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "c5ca831c32e4452dba1cfc6cd296e532"
format_stamp: "Formatted at 2026-08-10 01:55:30 on dist-test-slave-bw88"
I20260810 01:55:30.550482 21907 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260810 01:55:30.554219 21927 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:55:30.555656 21907 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260810 01:55:30.555841 21907 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "c5ca831c32e4452dba1cfc6cd296e532"
format_stamp: "Formatted at 2026-08-10 01:55:30 on dist-test-slave-bw88"
I20260810 01:55:30.556094 21907 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:55:30.582130 21907 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 01:55:30.583120 21907 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:55:30.583428 21907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:55:30.584690 21907 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260810 01:55:30.587028 21907 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:55:30.587194 21907 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:55:30.587329 21907 ts_tablet_manager.cc:616] Registered 0 tablets
I20260810 01:55:30.587457 21907 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:55:30.626282 21907 rpc_server.cc:307] RPC server started. Bound to: 127.21.64.193:39917
I20260810 01:55:30.626374 22081 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.64.193:39917 every 8 connection(s)
I20260810 01:55:30.627893 21907 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20260810 01:55:30.637895 21763 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNubV1X/build/asan/bin/kudu as pid 21907
I20260810 01:55:30.638134 21763 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20260810 01:55:30.642553 21763 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNubV1X/build/asan/bin/kudu
/tmp/dist-test-taskNubV1X/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.64.194:0
--local_ip_for_outbound_sockets=127.21.64.194
--webserver_interface=127.21.64.194
--webserver_port=0
--tserver_master_addrs=127.21.64.254:44083
--builtin_ntp_servers=127.21.64.212:41935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20260810 01:55:30.643332 22083 heartbeater.cc:344] Connected to a master server at 127.21.64.254:44083
I20260810 01:55:30.643929 22083 heartbeater.cc:461] Registering TS with master...
I20260810 01:55:30.645470 22083 heartbeater.cc:507] Master 127.21.64.254:44083 requested a full tablet report, sending...
I20260810 01:55:30.701854 21826 ts_manager.cc:194] Registered new tserver with Master: c5ca831c32e4452dba1cfc6cd296e532 (127.21.64.193:39917)
I20260810 01:55:30.705454 21826 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.21.64.193:51737
W20260810 01:55:31.012061 22090 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:55:31.012343 22090 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:55:31.012418 22090 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 01:55:31.020800 22090 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:55:31.020946 22090 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.64.194
I20260810 01:55:31.030901 22090 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.64.212:41935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.64.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.21.64.194
--webserver_port=0
--tserver_master_addrs=127.21.64.254:44083
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.64.194
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 01:44:04 UTC on e7f111948823
build id 13266
ASAN enabled
I20260810 01:55:31.032430 22090 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:55:31.034268 22090 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 01:55:31.044128 22097 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:55:31.044229 22098 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:55:31.044180 22101 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:55:31.045239 22090 server_base.cc:1061] running on GCE node
I20260810 01:55:31.045851 22090 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:55:31.046828 22090 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:55:31.048064 22090 hybrid_clock.cc:648] HybridClock initialized: now 1786326931048039 us; error 51 us; skew 500 ppm
I20260810 01:55:31.048388 22090 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 01:55:31.050647 22090 webserver.cc:533] Webserver started at http://127.21.64.194:41807/ using document root <none> and password file <none>
I20260810 01:55:31.051395 22090 fs_manager.cc:362] Metadata directory not provided
I20260810 01:55:31.051537 22090 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:55:31.051971 22090 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:55:31.054780 22090 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "78c107f9dfbc4d3483895dda0f791bb2"
format_stamp: "Formatted at 2026-08-10 01:55:31 on dist-test-slave-bw88"
I20260810 01:55:31.055586 22090 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "78c107f9dfbc4d3483895dda0f791bb2"
format_stamp: "Formatted at 2026-08-10 01:55:31 on dist-test-slave-bw88"
I20260810 01:55:31.060884 22090 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260810 01:55:31.064602 22110 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:55:31.066157 22090 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:55:31.066347 22090 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "78c107f9dfbc4d3483895dda0f791bb2"
format_stamp: "Formatted at 2026-08-10 01:55:31 on dist-test-slave-bw88"
I20260810 01:55:31.066582 22090 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:55:31.097425 22090 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 01:55:31.098433 22090 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:55:31.098745 22090 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:55:31.099695 22090 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260810 01:55:31.101392 22090 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:55:31.101533 22090 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260810 01:55:31.101639 22090 ts_tablet_manager.cc:616] Registered 0 tablets
I20260810 01:55:31.101702 22090 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:55:31.138213 22090 rpc_server.cc:307] RPC server started. Bound to: 127.21.64.194:33547
I20260810 01:55:31.138306 22262 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.64.194:33547 every 8 connection(s)
I20260810 01:55:31.139750 22090 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20260810 01:55:31.148097 21763 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNubV1X/build/asan/bin/kudu as pid 22090
I20260810 01:55:31.148301 21763 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20260810 01:55:31.151675 21763 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNubV1X/build/asan/bin/kudu
/tmp/dist-test-taskNubV1X/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.64.195:0
--local_ip_for_outbound_sockets=127.21.64.195
--webserver_interface=127.21.64.195
--webserver_port=0
--tserver_master_addrs=127.21.64.254:44083
--builtin_ntp_servers=127.21.64.212:41935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20260810 01:55:31.153894 22263 heartbeater.cc:344] Connected to a master server at 127.21.64.254:44083
I20260810 01:55:31.154261 22263 heartbeater.cc:461] Registering TS with master...
I20260810 01:55:31.155160 22263 heartbeater.cc:507] Master 127.21.64.254:44083 requested a full tablet report, sending...
I20260810 01:55:31.204214 21826 ts_manager.cc:194] Registered new tserver with Master: 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194:33547)
I20260810 01:55:31.205760 21826 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.21.64.194:42361
W20260810 01:55:31.516052 22270 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:55:31.516341 22270 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:55:31.516412 22270 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 01:55:31.525509 22270 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:55:31.525688 22270 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.64.195
I20260810 01:55:31.536727 22270 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.64.212:41935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.64.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.21.64.195
--webserver_port=0
--tserver_master_addrs=127.21.64.254:44083
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.64.195
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 01:44:04 UTC on e7f111948823
build id 13266
ASAN enabled
I20260810 01:55:31.538416 22270 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:55:31.540298 22270 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 01:55:31.551173 22279 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:55:31.552059 22282 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:55:31.552337 22278 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:55:31.552917 22270 server_base.cc:1061] running on GCE node
I20260810 01:55:31.553630 22270 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:55:31.554632 22270 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:55:31.555881 22270 hybrid_clock.cc:648] HybridClock initialized: now 1786326931555832 us; error 58 us; skew 500 ppm
I20260810 01:55:31.556242 22270 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 01:55:31.558593 22270 webserver.cc:533] Webserver started at http://127.21.64.195:35333/ using document root <none> and password file <none>
I20260810 01:55:31.559355 22270 fs_manager.cc:362] Metadata directory not provided
I20260810 01:55:31.559502 22270 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:55:31.559893 22270 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:55:31.562516 22270 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "65755ebc82864dc3a3193b1ba3870613"
format_stamp: "Formatted at 2026-08-10 01:55:31 on dist-test-slave-bw88"
I20260810 01:55:31.563445 22270 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "65755ebc82864dc3a3193b1ba3870613"
format_stamp: "Formatted at 2026-08-10 01:55:31 on dist-test-slave-bw88"
I20260810 01:55:31.568930 22270 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260810 01:55:31.572719 22291 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:55:31.574194 22270 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260810 01:55:31.574381 22270 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "65755ebc82864dc3a3193b1ba3870613"
format_stamp: "Formatted at 2026-08-10 01:55:31 on dist-test-slave-bw88"
I20260810 01:55:31.574633 22270 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:55:31.592195 22270 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 01:55:31.593066 22270 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:55:31.593415 22270 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:55:31.594440 22270 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260810 01:55:31.596225 22270 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:55:31.596355 22270 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:55:31.596484 22270 ts_tablet_manager.cc:616] Registered 0 tablets
I20260810 01:55:31.596591 22270 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:55:31.632277 22270 rpc_server.cc:307] RPC server started. Bound to: 127.21.64.195:46103
I20260810 01:55:31.632385 22468 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.64.195:46103 every 8 connection(s)
I20260810 01:55:31.633846 22270 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20260810 01:55:31.643751 21763 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNubV1X/build/asan/bin/kudu as pid 22270
I20260810 01:55:31.643949 21763 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20260810 01:55:31.647354 22471 heartbeater.cc:344] Connected to a master server at 127.21.64.254:44083
I20260810 01:55:31.647595 21763 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNubV1X/build/asan/bin/kudu
/tmp/dist-test-taskNubV1X/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.64.196:0
--local_ip_for_outbound_sockets=127.21.64.196
--webserver_interface=127.21.64.196
--webserver_port=0
--tserver_master_addrs=127.21.64.254:44083
--builtin_ntp_servers=127.21.64.212:41935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20260810 01:55:31.647748 22471 heartbeater.cc:461] Registering TS with master...
I20260810 01:55:31.648589 22471 heartbeater.cc:507] Master 127.21.64.254:44083 requested a full tablet report, sending...
I20260810 01:55:31.705246 21826 ts_manager.cc:194] Registered new tserver with Master: 65755ebc82864dc3a3193b1ba3870613 (127.21.64.195:46103)
I20260810 01:55:31.706640 21826 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.21.64.195:50449
I20260810 01:55:31.709722 22083 heartbeater.cc:499] Master 127.21.64.254:44083 was elected leader, sending a full tablet report...
W20260810 01:55:32.053508 22476 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:55:32.053882 22476 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:55:32.053972 22476 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 01:55:32.062347 22476 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:55:32.062534 22476 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.64.196
I20260810 01:55:32.073829 22476 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.64.212:41935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.64.196:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--webserver_interface=127.21.64.196
--webserver_port=0
--tserver_master_addrs=127.21.64.254:44083
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.64.196
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 01:44:04 UTC on e7f111948823
build id 13266
ASAN enabled
I20260810 01:55:32.075754 22476 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:55:32.077782 22476 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 01:55:32.089953 22487 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:55:32.091547 22476 server_base.cc:1061] running on GCE node
W20260810 01:55:32.091696 22488 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:55:32.091944 22490 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:55:32.092617 22476 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:55:32.093565 22476 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:55:32.094794 22476 hybrid_clock.cc:648] HybridClock initialized: now 1786326932094738 us; error 50 us; skew 500 ppm
I20260810 01:55:32.095144 22476 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 01:55:32.097440 22476 webserver.cc:533] Webserver started at http://127.21.64.196:35741/ using document root <none> and password file <none>
I20260810 01:55:32.098179 22476 fs_manager.cc:362] Metadata directory not provided
I20260810 01:55:32.098326 22476 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:55:32.098694 22476 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:55:32.101122 22476 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/data/instance:
uuid: "fabe62238d32404097129ae02ed3b0b3"
format_stamp: "Formatted at 2026-08-10 01:55:32 on dist-test-slave-bw88"
I20260810 01:55:32.101986 22476 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal/instance:
uuid: "fabe62238d32404097129ae02ed3b0b3"
format_stamp: "Formatted at 2026-08-10 01:55:32 on dist-test-slave-bw88"
I20260810 01:55:32.111326 22476 fs_manager.cc:696] Time spent creating directory manager: real 0.009s user 0.005s sys 0.003s
I20260810 01:55:32.115643 22498 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:55:32.117479 22476 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260810 01:55:32.117660 22476 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/data,/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal
uuid: "fabe62238d32404097129ae02ed3b0b3"
format_stamp: "Formatted at 2026-08-10 01:55:32 on dist-test-slave-bw88"
I20260810 01:55:32.117899 22476 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal
metadata directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal
1 data directories: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:55:32.146467 22476 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 01:55:32.147771 22476 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:55:32.148156 22476 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:55:32.149857 22476 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260810 01:55:32.152273 22476 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:55:32.152406 22476 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:55:32.152522 22476 ts_tablet_manager.cc:616] Registered 0 tablets
I20260810 01:55:32.152609 22476 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:55:32.209033 22263 heartbeater.cc:499] Master 127.21.64.254:44083 was elected leader, sending a full tablet report...
I20260810 01:55:32.234479 22476 rpc_server.cc:307] RPC server started. Bound to: 127.21.64.196:32931
I20260810 01:55:32.234776 22656 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.64.196:32931 every 8 connection(s)
I20260810 01:55:32.236651 22476 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/data/info.pb
I20260810 01:55:32.245981 21763 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNubV1X/build/asan/bin/kudu as pid 22476
I20260810 01:55:32.246264 21763 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal/instance
I20260810 01:55:32.252717 21763 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNubV1X/build/asan/bin/kudu
/tmp/dist-test-taskNubV1X/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/wal
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/logs
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.64.197:0
--local_ip_for_outbound_sockets=127.21.64.197
--webserver_interface=127.21.64.197
--webserver_port=0
--tserver_master_addrs=127.21.64.254:44083
--builtin_ntp_servers=127.21.64.212:41935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20260810 01:55:32.264621 22657 heartbeater.cc:344] Connected to a master server at 127.21.64.254:44083
I20260810 01:55:32.265019 22657 heartbeater.cc:461] Registering TS with master...
I20260810 01:55:32.266161 22657 heartbeater.cc:507] Master 127.21.64.254:44083 requested a full tablet report, sending...
I20260810 01:55:32.325187 21826 ts_manager.cc:194] Registered new tserver with Master: fabe62238d32404097129ae02ed3b0b3 (127.21.64.196:32931)
I20260810 01:55:32.327232 21826 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.21.64.196:50361
I20260810 01:55:32.710414 22471 heartbeater.cc:499] Master 127.21.64.254:44083 was elected leader, sending a full tablet report...
W20260810 01:55:32.899160 22662 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:55:32.899817 22662 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:55:32.900085 22662 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 01:55:32.921123 22662 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:55:32.921567 22662 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.64.197
I20260810 01:55:32.947184 22662 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.64.212:41935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.64.197:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--webserver_interface=127.21.64.197
--webserver_port=0
--tserver_master_addrs=127.21.64.254:44083
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.64.197
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 01:44:04 UTC on e7f111948823
build id 13266
ASAN enabled
I20260810 01:55:32.950626 22662 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:55:32.954388 22662 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 01:55:32.972106 22670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:55:32.972203 22669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:55:32.973519 22674 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:55:32.974261 22662 server_base.cc:1061] running on GCE node
I20260810 01:55:32.975028 22662 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:55:32.976071 22662 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:55:32.977404 22662 hybrid_clock.cc:648] HybridClock initialized: now 1786326932977285 us; error 42 us; skew 500 ppm
I20260810 01:55:32.977823 22662 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 01:55:32.980778 22662 webserver.cc:533] Webserver started at http://127.21.64.197:42209/ using document root <none> and password file <none>
I20260810 01:55:32.982067 22662 fs_manager.cc:362] Metadata directory not provided
I20260810 01:55:32.982227 22662 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:55:32.982679 22662 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:55:32.985754 22662 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data/instance:
uuid: "687f288b7e9d4650a758d5451483e49b"
format_stamp: "Formatted at 2026-08-10 01:55:32 on dist-test-slave-bw88"
I20260810 01:55:32.986692 22662 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/wal/instance:
uuid: "687f288b7e9d4650a758d5451483e49b"
format_stamp: "Formatted at 2026-08-10 01:55:32 on dist-test-slave-bw88"
I20260810 01:55:32.994803 22662 fs_manager.cc:696] Time spent creating directory manager: real 0.008s user 0.002s sys 0.006s
I20260810 01:55:33.000181 22684 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:55:33.001902 22662 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260810 01:55:33.002106 22662 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data,/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/wal
uuid: "687f288b7e9d4650a758d5451483e49b"
format_stamp: "Formatted at 2026-08-10 01:55:32 on dist-test-slave-bw88"
I20260810 01:55:33.002368 22662 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/wal
metadata directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/wal
1 data directories: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:55:33.033896 22662 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 01:55:33.035398 22662 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:55:33.035969 22662 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:55:33.037637 22662 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260810 01:55:33.039968 22662 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:55:33.040194 22662 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:55:33.040401 22662 ts_tablet_manager.cc:616] Registered 0 tablets
I20260810 01:55:33.040632 22662 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:55:33.136168 22662 rpc_server.cc:307] RPC server started. Bound to: 127.21.64.197:37655
I20260810 01:55:33.136576 22829 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.64.197:37655 every 8 connection(s)
I20260810 01:55:33.138327 22662 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data/info.pb
I20260810 01:55:33.146847 21763 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNubV1X/build/asan/bin/kudu as pid 22662
I20260810 01:55:33.147121 21763 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/wal/instance
I20260810 01:55:33.150906 21763 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNubV1X/build/asan/bin/kudu
/tmp/dist-test-taskNubV1X/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/wal
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/logs
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.64.198:0
--local_ip_for_outbound_sockets=127.21.64.198
--webserver_interface=127.21.64.198
--webserver_port=0
--tserver_master_addrs=127.21.64.254:44083
--builtin_ntp_servers=127.21.64.212:41935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20260810 01:55:33.159972 22830 heartbeater.cc:344] Connected to a master server at 127.21.64.254:44083
I20260810 01:55:33.160404 22830 heartbeater.cc:461] Registering TS with master...
I20260810 01:55:33.161767 22830 heartbeater.cc:507] Master 127.21.64.254:44083 requested a full tablet report, sending...
I20260810 01:55:33.236892 21826 ts_manager.cc:194] Registered new tserver with Master: 687f288b7e9d4650a758d5451483e49b (127.21.64.197:37655)
I20260810 01:55:33.238354 21826 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.21.64.197:36671
I20260810 01:55:33.330857 22657 heartbeater.cc:499] Master 127.21.64.254:44083 was elected leader, sending a full tablet report...
W20260810 01:55:33.798516 22834 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:55:33.798919 22834 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:55:33.799111 22834 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 01:55:33.811053 22834 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:55:33.811352 22834 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.64.198
I20260810 01:55:33.824244 22834 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.64.212:41935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/data
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.64.198:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/data/info.pb
--webserver_interface=127.21.64.198
--webserver_port=0
--tserver_master_addrs=127.21.64.254:44083
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.64.198
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 01:44:04 UTC on e7f111948823
build id 13266
ASAN enabled
I20260810 01:55:33.826342 22834 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:55:33.828595 22834 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 01:55:33.840003 22844 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:55:33.840253 22845 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:55:33.842195 22849 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:55:33.842330 22834 server_base.cc:1061] running on GCE node
I20260810 01:55:33.843036 22834 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:55:33.844182 22834 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:55:33.845515 22834 hybrid_clock.cc:648] HybridClock initialized: now 1786326933845381 us; error 91 us; skew 500 ppm
I20260810 01:55:33.845899 22834 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 01:55:33.848748 22834 webserver.cc:533] Webserver started at http://127.21.64.198:35713/ using document root <none> and password file <none>
I20260810 01:55:33.849797 22834 fs_manager.cc:362] Metadata directory not provided
I20260810 01:55:33.849962 22834 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:55:33.850507 22834 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:55:33.853492 22834 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/data/instance:
uuid: "5c71783cbed64297b17353312fcd4bb0"
format_stamp: "Formatted at 2026-08-10 01:55:33 on dist-test-slave-bw88"
I20260810 01:55:33.854462 22834 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/wal/instance:
uuid: "5c71783cbed64297b17353312fcd4bb0"
format_stamp: "Formatted at 2026-08-10 01:55:33 on dist-test-slave-bw88"
I20260810 01:55:33.860697 22834 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260810 01:55:33.864877 22856 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:55:33.866561 22834 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:55:33.866770 22834 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/data,/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/wal
uuid: "5c71783cbed64297b17353312fcd4bb0"
format_stamp: "Formatted at 2026-08-10 01:55:33 on dist-test-slave-bw88"
I20260810 01:55:33.867044 22834 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/wal
metadata directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/wal
1 data directories: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:55:33.885685 22834 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 01:55:33.886657 22834 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:55:33.886997 22834 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:55:33.888291 22834 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260810 01:55:33.890031 22834 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:55:33.890218 22834 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:55:33.890398 22834 ts_tablet_manager.cc:616] Registered 0 tablets
I20260810 01:55:33.890563 22834 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:55:33.964917 22834 rpc_server.cc:307] RPC server started. Bound to: 127.21.64.198:33973
I20260810 01:55:33.965215 23006 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.64.198:33973 every 8 connection(s)
I20260810 01:55:33.966755 22834 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/data/info.pb
I20260810 01:55:33.972251 21763 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNubV1X/build/asan/bin/kudu as pid 22834
I20260810 01:55:33.972591 21763 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/wal/instance
I20260810 01:55:33.985265 23007 heartbeater.cc:344] Connected to a master server at 127.21.64.254:44083
I20260810 01:55:33.985632 23007 heartbeater.cc:461] Registering TS with master...
I20260810 01:55:33.986618 23007 heartbeater.cc:507] Master 127.21.64.254:44083 requested a full tablet report, sending...
I20260810 01:55:34.049110 21825 ts_manager.cc:194] Registered new tserver with Master: 5c71783cbed64297b17353312fcd4bb0 (127.21.64.198:33973)
I20260810 01:55:34.050289 21825 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.21.64.198:59593
I20260810 01:55:34.055744 21763 external_mini_cluster.cc:955] 6 TS(s) registered with all masters
I20260810 01:55:34.080734 21763 external_mini_cluster.cc:955] 6 TS(s) registered with all masters
I20260810 01:55:34.241968 22830 heartbeater.cc:499] Master 127.21.64.254:44083 was elected leader, sending a full tablet report...
I20260810 01:55:35.053664 23007 heartbeater.cc:499] Master 127.21.64.254:44083 was elected leader, sending a full tablet report...
I20260810 01:55:37.837237 21826 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60594:
name: "rebalance_test_table_0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260810 01:55:37.913681 21994 tablet_service.cc:1511] Processing CreateTablet for tablet 1f62ef81920c40b1899c6bbf347e3b2e (DEFAULT_TABLE table=rebalance_test_table_0 [id=634e9b3924ec4bf28d35e3c0f5fdc58c]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:37.918772 21994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f62ef81920c40b1899c6bbf347e3b2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:37.925127 22363 tablet_service.cc:1511] Processing CreateTablet for tablet 1f62ef81920c40b1899c6bbf347e3b2e (DEFAULT_TABLE table=rebalance_test_table_0 [id=634e9b3924ec4bf28d35e3c0f5fdc58c]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:37.926964 22363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f62ef81920c40b1899c6bbf347e3b2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:37.924202 22364 tablet_service.cc:1511] Processing CreateTablet for tablet eff94403f0e847568a8be1b329da4969 (DEFAULT_TABLE table=rebalance_test_table_0 [id=634e9b3924ec4bf28d35e3c0f5fdc58c]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:37.931700 22364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eff94403f0e847568a8be1b329da4969. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:37.913563 21995 tablet_service.cc:1511] Processing CreateTablet for tablet f52f608800a643c7acf05e348742c26c (DEFAULT_TABLE table=rebalance_test_table_0 [id=634e9b3924ec4bf28d35e3c0f5fdc58c]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:37.936384 21995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f52f608800a643c7acf05e348742c26c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:37.940362 22740 tablet_service.cc:1511] Processing CreateTablet for tablet f52f608800a643c7acf05e348742c26c (DEFAULT_TABLE table=rebalance_test_table_0 [id=634e9b3924ec4bf28d35e3c0f5fdc58c]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:37.942444 22740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f52f608800a643c7acf05e348742c26c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:37.945653 22739 tablet_service.cc:1511] Processing CreateTablet for tablet 1f62ef81920c40b1899c6bbf347e3b2e (DEFAULT_TABLE table=rebalance_test_table_0 [id=634e9b3924ec4bf28d35e3c0f5fdc58c]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:37.946647 22739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f62ef81920c40b1899c6bbf347e3b2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:37.947216 22559 tablet_service.cc:1511] Processing CreateTablet for tablet f52f608800a643c7acf05e348742c26c (DEFAULT_TABLE table=rebalance_test_table_0 [id=634e9b3924ec4bf28d35e3c0f5fdc58c]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:37.948745 22559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f52f608800a643c7acf05e348742c26c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:37.963094 22181 tablet_service.cc:1511] Processing CreateTablet for tablet eff94403f0e847568a8be1b329da4969 (DEFAULT_TABLE table=rebalance_test_table_0 [id=634e9b3924ec4bf28d35e3c0f5fdc58c]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:37.965178 22181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eff94403f0e847568a8be1b329da4969. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:37.981874 23042 tablet_bootstrap.cc:492] T 1f62ef81920c40b1899c6bbf347e3b2e P 687f288b7e9d4650a758d5451483e49b: Bootstrap starting.
I20260810 01:55:37.982352 23041 tablet_bootstrap.cc:492] T f52f608800a643c7acf05e348742c26c P fabe62238d32404097129ae02ed3b0b3: Bootstrap starting.
I20260810 01:55:37.987246 22922 tablet_service.cc:1511] Processing CreateTablet for tablet eff94403f0e847568a8be1b329da4969 (DEFAULT_TABLE table=rebalance_test_table_0 [id=634e9b3924ec4bf28d35e3c0f5fdc58c]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:37.989274 22922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eff94403f0e847568a8be1b329da4969. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:37.994222 23042 tablet_bootstrap.cc:654] T 1f62ef81920c40b1899c6bbf347e3b2e P 687f288b7e9d4650a758d5451483e49b: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:37.994678 23041 tablet_bootstrap.cc:654] T f52f608800a643c7acf05e348742c26c P fabe62238d32404097129ae02ed3b0b3: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:37.999902 23042 log.cc:826] T 1f62ef81920c40b1899c6bbf347e3b2e P 687f288b7e9d4650a758d5451483e49b: Log is configured to *not* fsync() on all Append() calls
I20260810 01:55:38.002192 23045 tablet_bootstrap.cc:492] T eff94403f0e847568a8be1b329da4969 P 78c107f9dfbc4d3483895dda0f791bb2: Bootstrap starting.
I20260810 01:55:38.006120 23040 tablet_bootstrap.cc:492] T 1f62ef81920c40b1899c6bbf347e3b2e P c5ca831c32e4452dba1cfc6cd296e532: Bootstrap starting.
I20260810 01:55:38.012645 23042 tablet_bootstrap.cc:492] T 1f62ef81920c40b1899c6bbf347e3b2e P 687f288b7e9d4650a758d5451483e49b: No bootstrap required, opened a new log
I20260810 01:55:38.013105 23042 ts_tablet_manager.cc:1403] T 1f62ef81920c40b1899c6bbf347e3b2e P 687f288b7e9d4650a758d5451483e49b: Time spent bootstrapping tablet: real 0.032s user 0.004s sys 0.008s
I20260810 01:55:38.013868 23040 tablet_bootstrap.cc:654] T 1f62ef81920c40b1899c6bbf347e3b2e P c5ca831c32e4452dba1cfc6cd296e532: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:38.015395 23043 tablet_bootstrap.cc:492] T eff94403f0e847568a8be1b329da4969 P 65755ebc82864dc3a3193b1ba3870613: Bootstrap starting.
I20260810 01:55:38.019052 23041 log.cc:826] T f52f608800a643c7acf05e348742c26c P fabe62238d32404097129ae02ed3b0b3: Log is configured to *not* fsync() on all Append() calls
I20260810 01:55:38.020725 23043 tablet_bootstrap.cc:654] T eff94403f0e847568a8be1b329da4969 P 65755ebc82864dc3a3193b1ba3870613: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:38.022734 23045 tablet_bootstrap.cc:654] T eff94403f0e847568a8be1b329da4969 P 78c107f9dfbc4d3483895dda0f791bb2: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:38.022713 23043 log.cc:826] T eff94403f0e847568a8be1b329da4969 P 65755ebc82864dc3a3193b1ba3870613: Log is configured to *not* fsync() on all Append() calls
I20260810 01:55:38.024607 23045 log.cc:826] T eff94403f0e847568a8be1b329da4969 P 78c107f9dfbc4d3483895dda0f791bb2: Log is configured to *not* fsync() on all Append() calls
I20260810 01:55:38.026036 23040 log.cc:826] T 1f62ef81920c40b1899c6bbf347e3b2e P c5ca831c32e4452dba1cfc6cd296e532: Log is configured to *not* fsync() on all Append() calls
I20260810 01:55:38.028200 23042 raft_consensus.cc:359] T 1f62ef81920c40b1899c6bbf347e3b2e P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:38.029388 23041 tablet_bootstrap.cc:492] T f52f608800a643c7acf05e348742c26c P fabe62238d32404097129ae02ed3b0b3: No bootstrap required, opened a new log
I20260810 01:55:38.029976 23041 ts_tablet_manager.cc:1403] T f52f608800a643c7acf05e348742c26c P fabe62238d32404097129ae02ed3b0b3: Time spent bootstrapping tablet: real 0.052s user 0.003s sys 0.011s
I20260810 01:55:38.028774 23050 tablet_bootstrap.cc:492] T eff94403f0e847568a8be1b329da4969 P 5c71783cbed64297b17353312fcd4bb0: Bootstrap starting.
I20260810 01:55:38.031013 23042 raft_consensus.cc:385] T 1f62ef81920c40b1899c6bbf347e3b2e P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:38.031291 23042 raft_consensus.cc:740] T 1f62ef81920c40b1899c6bbf347e3b2e P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687f288b7e9d4650a758d5451483e49b, State: Initialized, Role: FOLLOWER
I20260810 01:55:38.033097 23042 consensus_queue.cc:260] T 1f62ef81920c40b1899c6bbf347e3b2e P 687f288b7e9d4650a758d5451483e49b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:38.035642 23045 tablet_bootstrap.cc:492] T eff94403f0e847568a8be1b329da4969 P 78c107f9dfbc4d3483895dda0f791bb2: No bootstrap required, opened a new log
I20260810 01:55:38.036069 23045 ts_tablet_manager.cc:1403] T eff94403f0e847568a8be1b329da4969 P 78c107f9dfbc4d3483895dda0f791bb2: Time spent bootstrapping tablet: real 0.034s user 0.009s sys 0.003s
I20260810 01:55:38.037870 23043 tablet_bootstrap.cc:492] T eff94403f0e847568a8be1b329da4969 P 65755ebc82864dc3a3193b1ba3870613: No bootstrap required, opened a new log
I20260810 01:55:38.038357 23043 ts_tablet_manager.cc:1403] T eff94403f0e847568a8be1b329da4969 P 65755ebc82864dc3a3193b1ba3870613: Time spent bootstrapping tablet: real 0.023s user 0.007s sys 0.010s
I20260810 01:55:38.038682 23050 tablet_bootstrap.cc:654] T eff94403f0e847568a8be1b329da4969 P 5c71783cbed64297b17353312fcd4bb0: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:38.041067 23050 log.cc:826] T eff94403f0e847568a8be1b329da4969 P 5c71783cbed64297b17353312fcd4bb0: Log is configured to *not* fsync() on all Append() calls
I20260810 01:55:38.043742 23040 tablet_bootstrap.cc:492] T 1f62ef81920c40b1899c6bbf347e3b2e P c5ca831c32e4452dba1cfc6cd296e532: No bootstrap required, opened a new log
I20260810 01:55:38.048286 23040 ts_tablet_manager.cc:1403] T 1f62ef81920c40b1899c6bbf347e3b2e P c5ca831c32e4452dba1cfc6cd296e532: Time spent bootstrapping tablet: real 0.043s user 0.008s sys 0.010s
I20260810 01:55:38.050762 23042 ts_tablet_manager.cc:1434] T 1f62ef81920c40b1899c6bbf347e3b2e P 687f288b7e9d4650a758d5451483e49b: Time spent starting tablet: real 0.037s user 0.010s sys 0.004s
I20260810 01:55:38.051896 23041 raft_consensus.cc:359] T f52f608800a643c7acf05e348742c26c P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:38.052644 23041 raft_consensus.cc:385] T f52f608800a643c7acf05e348742c26c P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:38.052874 23041 raft_consensus.cc:740] T f52f608800a643c7acf05e348742c26c P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabe62238d32404097129ae02ed3b0b3, State: Initialized, Role: FOLLOWER
I20260810 01:55:38.053887 23041 consensus_queue.cc:260] T f52f608800a643c7acf05e348742c26c P fabe62238d32404097129ae02ed3b0b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:38.060351 23042 tablet_bootstrap.cc:492] T f52f608800a643c7acf05e348742c26c P 687f288b7e9d4650a758d5451483e49b: Bootstrap starting.
I20260810 01:55:38.063957 23045 raft_consensus.cc:359] T eff94403f0e847568a8be1b329da4969 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } }
I20260810 01:55:38.067552 23043 raft_consensus.cc:359] T eff94403f0e847568a8be1b329da4969 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } }
I20260810 01:55:38.069635 23043 raft_consensus.cc:385] T eff94403f0e847568a8be1b329da4969 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:38.069821 23043 raft_consensus.cc:740] T eff94403f0e847568a8be1b329da4969 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65755ebc82864dc3a3193b1ba3870613, State: Initialized, Role: FOLLOWER
I20260810 01:55:38.069545 23045 raft_consensus.cc:385] T eff94403f0e847568a8be1b329da4969 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:38.070822 23045 raft_consensus.cc:740] T eff94403f0e847568a8be1b329da4969 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78c107f9dfbc4d3483895dda0f791bb2, State: Initialized, Role: FOLLOWER
I20260810 01:55:38.070763 23043 consensus_queue.cc:260] T eff94403f0e847568a8be1b329da4969 P 65755ebc82864dc3a3193b1ba3870613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } }
I20260810 01:55:38.069307 23042 tablet_bootstrap.cc:654] T f52f608800a643c7acf05e348742c26c P 687f288b7e9d4650a758d5451483e49b: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:38.072824 23050 tablet_bootstrap.cc:492] T eff94403f0e847568a8be1b329da4969 P 5c71783cbed64297b17353312fcd4bb0: No bootstrap required, opened a new log
I20260810 01:55:38.073437 23050 ts_tablet_manager.cc:1403] T eff94403f0e847568a8be1b329da4969 P 5c71783cbed64297b17353312fcd4bb0: Time spent bootstrapping tablet: real 0.045s user 0.017s sys 0.022s
I20260810 01:55:38.073129 23040 raft_consensus.cc:359] T 1f62ef81920c40b1899c6bbf347e3b2e P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:38.073730 23040 raft_consensus.cc:385] T 1f62ef81920c40b1899c6bbf347e3b2e P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:38.073871 23040 raft_consensus.cc:740] T 1f62ef81920c40b1899c6bbf347e3b2e P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ca831c32e4452dba1cfc6cd296e532, State: Initialized, Role: FOLLOWER
I20260810 01:55:38.074254 23045 consensus_queue.cc:260] T eff94403f0e847568a8be1b329da4969 P 78c107f9dfbc4d3483895dda0f791bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } }
I20260810 01:55:38.075232 23040 consensus_queue.cc:260] T 1f62ef81920c40b1899c6bbf347e3b2e P c5ca831c32e4452dba1cfc6cd296e532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:38.077823 23045 ts_tablet_manager.cc:1434] T eff94403f0e847568a8be1b329da4969 P 78c107f9dfbc4d3483895dda0f791bb2: Time spent starting tablet: real 0.042s user 0.014s sys 0.001s
I20260810 01:55:38.082023 23041 ts_tablet_manager.cc:1434] T f52f608800a643c7acf05e348742c26c P fabe62238d32404097129ae02ed3b0b3: Time spent starting tablet: real 0.052s user 0.014s sys 0.017s
I20260810 01:55:38.085567 23050 raft_consensus.cc:359] T eff94403f0e847568a8be1b329da4969 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } }
I20260810 01:55:38.087397 23042 tablet_bootstrap.cc:492] T f52f608800a643c7acf05e348742c26c P 687f288b7e9d4650a758d5451483e49b: No bootstrap required, opened a new log
I20260810 01:55:38.087623 23042 ts_tablet_manager.cc:1403] T f52f608800a643c7acf05e348742c26c P 687f288b7e9d4650a758d5451483e49b: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.003s
I20260810 01:55:38.087921 23040 ts_tablet_manager.cc:1434] T 1f62ef81920c40b1899c6bbf347e3b2e P c5ca831c32e4452dba1cfc6cd296e532: Time spent starting tablet: real 0.039s user 0.011s sys 0.008s
I20260810 01:55:38.088423 23040 tablet_bootstrap.cc:492] T f52f608800a643c7acf05e348742c26c P c5ca831c32e4452dba1cfc6cd296e532: Bootstrap starting.
I20260810 01:55:38.088871 23050 raft_consensus.cc:385] T eff94403f0e847568a8be1b329da4969 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:38.089031 23050 raft_consensus.cc:740] T eff94403f0e847568a8be1b329da4969 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c71783cbed64297b17353312fcd4bb0, State: Initialized, Role: FOLLOWER
I20260810 01:55:38.088703 23042 raft_consensus.cc:359] T f52f608800a643c7acf05e348742c26c P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:38.090665 23042 raft_consensus.cc:385] T f52f608800a643c7acf05e348742c26c P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:38.090914 23042 raft_consensus.cc:740] T f52f608800a643c7acf05e348742c26c P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687f288b7e9d4650a758d5451483e49b, State: Initialized, Role: FOLLOWER
I20260810 01:55:38.091347 23042 consensus_queue.cc:260] T f52f608800a643c7acf05e348742c26c P 687f288b7e9d4650a758d5451483e49b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:38.091615 23040 tablet_bootstrap.cc:654] T f52f608800a643c7acf05e348742c26c P c5ca831c32e4452dba1cfc6cd296e532: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:38.091681 23050 consensus_queue.cc:260] T eff94403f0e847568a8be1b329da4969 P 5c71783cbed64297b17353312fcd4bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } }
I20260810 01:55:38.101639 23050 ts_tablet_manager.cc:1434] T eff94403f0e847568a8be1b329da4969 P 5c71783cbed64297b17353312fcd4bb0: Time spent starting tablet: real 0.028s user 0.017s sys 0.004s
I20260810 01:55:38.101999 23040 tablet_bootstrap.cc:492] T f52f608800a643c7acf05e348742c26c P c5ca831c32e4452dba1cfc6cd296e532: No bootstrap required, opened a new log
I20260810 01:55:38.102324 23040 ts_tablet_manager.cc:1403] T f52f608800a643c7acf05e348742c26c P c5ca831c32e4452dba1cfc6cd296e532: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.011s
I20260810 01:55:38.103505 23042 ts_tablet_manager.cc:1434] T f52f608800a643c7acf05e348742c26c P 687f288b7e9d4650a758d5451483e49b: Time spent starting tablet: real 0.016s user 0.000s sys 0.003s
I20260810 01:55:38.103914 23040 raft_consensus.cc:359] T f52f608800a643c7acf05e348742c26c P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:38.104274 23040 raft_consensus.cc:385] T f52f608800a643c7acf05e348742c26c P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:38.104539 23040 raft_consensus.cc:740] T f52f608800a643c7acf05e348742c26c P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ca831c32e4452dba1cfc6cd296e532, State: Initialized, Role: FOLLOWER
I20260810 01:55:38.105266 23040 consensus_queue.cc:260] T f52f608800a643c7acf05e348742c26c P c5ca831c32e4452dba1cfc6cd296e532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:38.106205 23043 ts_tablet_manager.cc:1434] T eff94403f0e847568a8be1b329da4969 P 65755ebc82864dc3a3193b1ba3870613: Time spent starting tablet: real 0.068s user 0.011s sys 0.026s
I20260810 01:55:38.106757 23040 ts_tablet_manager.cc:1434] T f52f608800a643c7acf05e348742c26c P c5ca831c32e4452dba1cfc6cd296e532: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260810 01:55:38.109606 23043 tablet_bootstrap.cc:492] T 1f62ef81920c40b1899c6bbf347e3b2e P 65755ebc82864dc3a3193b1ba3870613: Bootstrap starting.
I20260810 01:55:38.113011 23043 tablet_bootstrap.cc:654] T 1f62ef81920c40b1899c6bbf347e3b2e P 65755ebc82864dc3a3193b1ba3870613: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:38.116972 23043 tablet_bootstrap.cc:492] T 1f62ef81920c40b1899c6bbf347e3b2e P 65755ebc82864dc3a3193b1ba3870613: No bootstrap required, opened a new log
I20260810 01:55:38.117201 23043 ts_tablet_manager.cc:1403] T 1f62ef81920c40b1899c6bbf347e3b2e P 65755ebc82864dc3a3193b1ba3870613: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.005s
I20260810 01:55:38.118471 23043 raft_consensus.cc:359] T 1f62ef81920c40b1899c6bbf347e3b2e P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:38.118738 23043 raft_consensus.cc:385] T 1f62ef81920c40b1899c6bbf347e3b2e P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:38.118943 23043 raft_consensus.cc:740] T 1f62ef81920c40b1899c6bbf347e3b2e P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65755ebc82864dc3a3193b1ba3870613, State: Initialized, Role: FOLLOWER
I20260810 01:55:38.119270 23043 consensus_queue.cc:260] T 1f62ef81920c40b1899c6bbf347e3b2e P 65755ebc82864dc3a3193b1ba3870613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:38.119917 23043 ts_tablet_manager.cc:1434] T 1f62ef81920c40b1899c6bbf347e3b2e P 65755ebc82864dc3a3193b1ba3870613: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
W20260810 01:55:38.136201 22084 tablet.cc:2406] T 1f62ef81920c40b1899c6bbf347e3b2e P c5ca831c32e4452dba1cfc6cd296e532: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 01:55:38.140025 22473 tablet.cc:2406] T 1f62ef81920c40b1899c6bbf347e3b2e P 65755ebc82864dc3a3193b1ba3870613: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 01:55:38.146014 22266 tablet.cc:2406] T eff94403f0e847568a8be1b329da4969 P 78c107f9dfbc4d3483895dda0f791bb2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 01:55:38.146746 22831 tablet.cc:2406] T 1f62ef81920c40b1899c6bbf347e3b2e P 687f288b7e9d4650a758d5451483e49b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:55:38.164891 23061 raft_consensus.cc:493] T f52f608800a643c7acf05e348742c26c P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:55:38.165436 23061 raft_consensus.cc:515] T f52f608800a643c7acf05e348742c26c P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:38.168440 23061 leader_election.cc:290] T f52f608800a643c7acf05e348742c26c P c5ca831c32e4452dba1cfc6cd296e532 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fabe62238d32404097129ae02ed3b0b3 (127.21.64.196:32931), 687f288b7e9d4650a758d5451483e49b (127.21.64.197:37655)
I20260810 01:55:38.173530 23059 raft_consensus.cc:493] T eff94403f0e847568a8be1b329da4969 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:55:38.173998 23059 raft_consensus.cc:515] T eff94403f0e847568a8be1b329da4969 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } }
I20260810 01:55:38.176717 23059 leader_election.cc:290] T eff94403f0e847568a8be1b329da4969 P 78c107f9dfbc4d3483895dda0f791bb2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65755ebc82864dc3a3193b1ba3870613 (127.21.64.195:46103), 5c71783cbed64297b17353312fcd4bb0 (127.21.64.198:33973)
I20260810 01:55:38.183856 22588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52f608800a643c7acf05e348742c26c" candidate_uuid: "c5ca831c32e4452dba1cfc6cd296e532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabe62238d32404097129ae02ed3b0b3" is_pre_election: true
I20260810 01:55:38.184577 22588 raft_consensus.cc:2468] T f52f608800a643c7acf05e348742c26c P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ca831c32e4452dba1cfc6cd296e532 in term 0.
I20260810 01:55:38.185415 21930 leader_election.cc:304] T f52f608800a643c7acf05e348742c26c P c5ca831c32e4452dba1cfc6cd296e532 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ca831c32e4452dba1cfc6cd296e532, fabe62238d32404097129ae02ed3b0b3; no voters:
I20260810 01:55:38.185849 23061 raft_consensus.cc:2804] T f52f608800a643c7acf05e348742c26c P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:55:38.186074 23061 raft_consensus.cc:493] T f52f608800a643c7acf05e348742c26c P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:55:38.186292 23061 raft_consensus.cc:3060] T f52f608800a643c7acf05e348742c26c P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:38.183831 22770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52f608800a643c7acf05e348742c26c" candidate_uuid: "c5ca831c32e4452dba1cfc6cd296e532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687f288b7e9d4650a758d5451483e49b" is_pre_election: true
I20260810 01:55:38.187160 22770 raft_consensus.cc:2468] T f52f608800a643c7acf05e348742c26c P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ca831c32e4452dba1cfc6cd296e532 in term 0.
I20260810 01:55:38.190498 23061 raft_consensus.cc:515] T f52f608800a643c7acf05e348742c26c P c5ca831c32e4452dba1cfc6cd296e532 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:38.191926 22588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52f608800a643c7acf05e348742c26c" candidate_uuid: "c5ca831c32e4452dba1cfc6cd296e532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabe62238d32404097129ae02ed3b0b3"
I20260810 01:55:38.192270 22588 raft_consensus.cc:3060] T f52f608800a643c7acf05e348742c26c P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:38.195562 23061 leader_election.cc:290] T f52f608800a643c7acf05e348742c26c P c5ca831c32e4452dba1cfc6cd296e532 [CANDIDATE]: Term 1 election: Requested vote from peers fabe62238d32404097129ae02ed3b0b3 (127.21.64.196:32931), 687f288b7e9d4650a758d5451483e49b (127.21.64.197:37655)
I20260810 01:55:38.196419 22770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52f608800a643c7acf05e348742c26c" candidate_uuid: "c5ca831c32e4452dba1cfc6cd296e532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687f288b7e9d4650a758d5451483e49b"
I20260810 01:55:38.196753 22770 raft_consensus.cc:3060] T f52f608800a643c7acf05e348742c26c P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:38.197312 22952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff94403f0e847568a8be1b329da4969" candidate_uuid: "78c107f9dfbc4d3483895dda0f791bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c71783cbed64297b17353312fcd4bb0" is_pre_election: true
I20260810 01:55:38.197715 22392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff94403f0e847568a8be1b329da4969" candidate_uuid: "78c107f9dfbc4d3483895dda0f791bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65755ebc82864dc3a3193b1ba3870613" is_pre_election: true
I20260810 01:55:38.198237 22952 raft_consensus.cc:2468] T eff94403f0e847568a8be1b329da4969 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78c107f9dfbc4d3483895dda0f791bb2 in term 0.
I20260810 01:55:38.198364 22588 raft_consensus.cc:2468] T f52f608800a643c7acf05e348742c26c P fabe62238d32404097129ae02ed3b0b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ca831c32e4452dba1cfc6cd296e532 in term 1.
I20260810 01:55:38.198644 22392 raft_consensus.cc:2468] T eff94403f0e847568a8be1b329da4969 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78c107f9dfbc4d3483895dda0f791bb2 in term 0.
I20260810 01:55:38.199008 21930 leader_election.cc:304] T f52f608800a643c7acf05e348742c26c P c5ca831c32e4452dba1cfc6cd296e532 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ca831c32e4452dba1cfc6cd296e532, fabe62238d32404097129ae02ed3b0b3; no voters:
I20260810 01:55:38.199409 23061 raft_consensus.cc:2804] T f52f608800a643c7acf05e348742c26c P c5ca831c32e4452dba1cfc6cd296e532 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:55:38.199514 22116 leader_election.cc:304] T eff94403f0e847568a8be1b329da4969 P 78c107f9dfbc4d3483895dda0f791bb2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c71783cbed64297b17353312fcd4bb0, 78c107f9dfbc4d3483895dda0f791bb2; no voters:
I20260810 01:55:38.200183 23059 raft_consensus.cc:2804] T eff94403f0e847568a8be1b329da4969 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:55:38.200515 23059 raft_consensus.cc:493] T eff94403f0e847568a8be1b329da4969 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:55:38.200821 23061 raft_consensus.cc:697] T f52f608800a643c7acf05e348742c26c P c5ca831c32e4452dba1cfc6cd296e532 [term 1 LEADER]: Becoming Leader. State: Replica: c5ca831c32e4452dba1cfc6cd296e532, State: Running, Role: LEADER
I20260810 01:55:38.201057 23059 raft_consensus.cc:3060] T eff94403f0e847568a8be1b329da4969 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:38.201601 23054 raft_consensus.cc:493] T 1f62ef81920c40b1899c6bbf347e3b2e P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:55:38.202203 22770 raft_consensus.cc:2468] T f52f608800a643c7acf05e348742c26c P 687f288b7e9d4650a758d5451483e49b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ca831c32e4452dba1cfc6cd296e532 in term 1.
I20260810 01:55:38.202013 23061 consensus_queue.cc:237] T f52f608800a643c7acf05e348742c26c P c5ca831c32e4452dba1cfc6cd296e532 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:38.201897 23054 raft_consensus.cc:515] T 1f62ef81920c40b1899c6bbf347e3b2e P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:38.205762 23054 leader_election.cc:290] T 1f62ef81920c40b1899c6bbf347e3b2e P 687f288b7e9d4650a758d5451483e49b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ca831c32e4452dba1cfc6cd296e532 (127.21.64.193:39917), 65755ebc82864dc3a3193b1ba3870613 (127.21.64.195:46103)
I20260810 01:55:38.206795 23059 raft_consensus.cc:515] T eff94403f0e847568a8be1b329da4969 P 78c107f9dfbc4d3483895dda0f791bb2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } }
I20260810 01:55:38.208528 22392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff94403f0e847568a8be1b329da4969" candidate_uuid: "78c107f9dfbc4d3483895dda0f791bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65755ebc82864dc3a3193b1ba3870613"
I20260810 01:55:38.208945 22392 raft_consensus.cc:3060] T eff94403f0e847568a8be1b329da4969 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:38.213119 21825 catalog_manager.cc:5719] T f52f608800a643c7acf05e348742c26c P c5ca831c32e4452dba1cfc6cd296e532 reported cstate change: term changed from 0 to 1, leader changed from <none> to c5ca831c32e4452dba1cfc6cd296e532 (127.21.64.193). New cstate: current_term: 1 leader_uuid: "c5ca831c32e4452dba1cfc6cd296e532" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } health_report { overall_health: HEALTHY } } }
I20260810 01:55:38.214243 23059 leader_election.cc:290] T eff94403f0e847568a8be1b329da4969 P 78c107f9dfbc4d3483895dda0f791bb2 [CANDIDATE]: Term 1 election: Requested vote from peers 65755ebc82864dc3a3193b1ba3870613 (127.21.64.195:46103), 5c71783cbed64297b17353312fcd4bb0 (127.21.64.198:33973)
I20260810 01:55:38.217831 22392 raft_consensus.cc:2468] T eff94403f0e847568a8be1b329da4969 P 65755ebc82864dc3a3193b1ba3870613 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78c107f9dfbc4d3483895dda0f791bb2 in term 1.
I20260810 01:55:38.217744 22952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eff94403f0e847568a8be1b329da4969" candidate_uuid: "78c107f9dfbc4d3483895dda0f791bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c71783cbed64297b17353312fcd4bb0"
I20260810 01:55:38.218165 22952 raft_consensus.cc:3060] T eff94403f0e847568a8be1b329da4969 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:38.218904 22112 leader_election.cc:304] T eff94403f0e847568a8be1b329da4969 P 78c107f9dfbc4d3483895dda0f791bb2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65755ebc82864dc3a3193b1ba3870613, 78c107f9dfbc4d3483895dda0f791bb2; no voters:
I20260810 01:55:38.219372 23059 raft_consensus.cc:2804] T eff94403f0e847568a8be1b329da4969 P 78c107f9dfbc4d3483895dda0f791bb2 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:55:38.223547 22026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62ef81920c40b1899c6bbf347e3b2e" candidate_uuid: "687f288b7e9d4650a758d5451483e49b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ca831c32e4452dba1cfc6cd296e532" is_pre_election: true
I20260810 01:55:38.224493 22026 raft_consensus.cc:2468] T 1f62ef81920c40b1899c6bbf347e3b2e P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687f288b7e9d4650a758d5451483e49b in term 0.
I20260810 01:55:38.225564 22691 leader_election.cc:304] T 1f62ef81920c40b1899c6bbf347e3b2e P 687f288b7e9d4650a758d5451483e49b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687f288b7e9d4650a758d5451483e49b, c5ca831c32e4452dba1cfc6cd296e532; no voters:
W20260810 01:55:38.226953 23009 tablet.cc:2406] T eff94403f0e847568a8be1b329da4969 P 5c71783cbed64297b17353312fcd4bb0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:55:38.227589 23054 raft_consensus.cc:2804] T 1f62ef81920c40b1899c6bbf347e3b2e P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:55:38.227837 23054 raft_consensus.cc:493] T 1f62ef81920c40b1899c6bbf347e3b2e P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:55:38.227975 23054 raft_consensus.cc:3060] T 1f62ef81920c40b1899c6bbf347e3b2e P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:38.229382 22392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62ef81920c40b1899c6bbf347e3b2e" candidate_uuid: "687f288b7e9d4650a758d5451483e49b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65755ebc82864dc3a3193b1ba3870613" is_pre_election: true
I20260810 01:55:38.229818 22392 raft_consensus.cc:2468] T 1f62ef81920c40b1899c6bbf347e3b2e P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687f288b7e9d4650a758d5451483e49b in term 0.
I20260810 01:55:38.230067 23059 raft_consensus.cc:697] T eff94403f0e847568a8be1b329da4969 P 78c107f9dfbc4d3483895dda0f791bb2 [term 1 LEADER]: Becoming Leader. State: Replica: 78c107f9dfbc4d3483895dda0f791bb2, State: Running, Role: LEADER
I20260810 01:55:38.230947 23059 consensus_queue.cc:237] T eff94403f0e847568a8be1b329da4969 P 78c107f9dfbc4d3483895dda0f791bb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } }
I20260810 01:55:38.232005 22952 raft_consensus.cc:2468] T eff94403f0e847568a8be1b329da4969 P 5c71783cbed64297b17353312fcd4bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78c107f9dfbc4d3483895dda0f791bb2 in term 1.
I20260810 01:55:38.232335 23054 raft_consensus.cc:515] T 1f62ef81920c40b1899c6bbf347e3b2e P 687f288b7e9d4650a758d5451483e49b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:38.233213 23054 leader_election.cc:290] T 1f62ef81920c40b1899c6bbf347e3b2e P 687f288b7e9d4650a758d5451483e49b [CANDIDATE]: Term 1 election: Requested vote from peers c5ca831c32e4452dba1cfc6cd296e532 (127.21.64.193:39917), 65755ebc82864dc3a3193b1ba3870613 (127.21.64.195:46103)
I20260810 01:55:38.233799 22026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62ef81920c40b1899c6bbf347e3b2e" candidate_uuid: "687f288b7e9d4650a758d5451483e49b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ca831c32e4452dba1cfc6cd296e532"
I20260810 01:55:38.233783 22392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62ef81920c40b1899c6bbf347e3b2e" candidate_uuid: "687f288b7e9d4650a758d5451483e49b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65755ebc82864dc3a3193b1ba3870613"
I20260810 01:55:38.234045 22392 raft_consensus.cc:3060] T 1f62ef81920c40b1899c6bbf347e3b2e P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:38.234077 22026 raft_consensus.cc:3060] T 1f62ef81920c40b1899c6bbf347e3b2e P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:38.237162 22026 raft_consensus.cc:2468] T 1f62ef81920c40b1899c6bbf347e3b2e P c5ca831c32e4452dba1cfc6cd296e532 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687f288b7e9d4650a758d5451483e49b in term 1.
I20260810 01:55:38.237834 22691 leader_election.cc:304] T 1f62ef81920c40b1899c6bbf347e3b2e P 687f288b7e9d4650a758d5451483e49b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687f288b7e9d4650a758d5451483e49b, c5ca831c32e4452dba1cfc6cd296e532; no voters:
I20260810 01:55:38.237919 22392 raft_consensus.cc:2468] T 1f62ef81920c40b1899c6bbf347e3b2e P 65755ebc82864dc3a3193b1ba3870613 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687f288b7e9d4650a758d5451483e49b in term 1.
I20260810 01:55:38.238552 23054 raft_consensus.cc:2804] T 1f62ef81920c40b1899c6bbf347e3b2e P 687f288b7e9d4650a758d5451483e49b [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:55:38.239329 23054 raft_consensus.cc:697] T 1f62ef81920c40b1899c6bbf347e3b2e P 687f288b7e9d4650a758d5451483e49b [term 1 LEADER]: Becoming Leader. State: Replica: 687f288b7e9d4650a758d5451483e49b, State: Running, Role: LEADER
I20260810 01:55:38.240027 23054 consensus_queue.cc:237] T 1f62ef81920c40b1899c6bbf347e3b2e P 687f288b7e9d4650a758d5451483e49b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:38.246937 21825 catalog_manager.cc:5719] T eff94403f0e847568a8be1b329da4969 P 78c107f9dfbc4d3483895dda0f791bb2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194). New cstate: current_term: 1 leader_uuid: "78c107f9dfbc4d3483895dda0f791bb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } health_report { overall_health: HEALTHY } } }
W20260810 01:55:38.249536 22658 tablet.cc:2406] T f52f608800a643c7acf05e348742c26c P fabe62238d32404097129ae02ed3b0b3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:55:38.251375 21825 catalog_manager.cc:5719] T 1f62ef81920c40b1899c6bbf347e3b2e P 687f288b7e9d4650a758d5451483e49b reported cstate change: term changed from 0 to 1, leader changed from <none> to 687f288b7e9d4650a758d5451483e49b (127.21.64.197). New cstate: current_term: 1 leader_uuid: "687f288b7e9d4650a758d5451483e49b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } health_report { overall_health: UNKNOWN } } }
I20260810 01:55:38.640693 23081 consensus_queue.cc:1048] T 1f62ef81920c40b1899c6bbf347e3b2e P 687f288b7e9d4650a758d5451483e49b [LEADER]: Connected to new peer: Peer: permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:38.658919 23054 consensus_queue.cc:1048] T 1f62ef81920c40b1899c6bbf347e3b2e P 687f288b7e9d4650a758d5451483e49b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:38.665563 23059 consensus_queue.cc:1048] T eff94403f0e847568a8be1b329da4969 P 78c107f9dfbc4d3483895dda0f791bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:38.677191 23079 consensus_queue.cc:1048] T eff94403f0e847568a8be1b329da4969 P 78c107f9dfbc4d3483895dda0f791bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:38.752740 23061 consensus_queue.cc:1048] T f52f608800a643c7acf05e348742c26c P c5ca831c32e4452dba1cfc6cd296e532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:38.764971 23061 consensus_queue.cc:1048] T f52f608800a643c7acf05e348742c26c P c5ca831c32e4452dba1cfc6cd296e532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260810 01:55:38.959617 23083 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:55:38.960182 23083 flags.cc:432] Enabled unsafe flag: --never_fsync=true
Using table 'rebalance_test_table_0'
INSERT report
rows total: 2000
time total: 453.407 ms
time per row: 0.226703 ms
I20260810 01:55:39.680194 21826 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60594:
name: "rebalance_test_table_1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260810 01:55:39.690502 22181 tablet_service.cc:1511] Processing CreateTablet for tablet 427e0356411c46059107c49238ddedfa (DEFAULT_TABLE table=rebalance_test_table_1 [id=b86a650f6d8b477c834fa223d27df9f7]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:39.691053 22181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 427e0356411c46059107c49238ddedfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:39.691155 22559 tablet_service.cc:1511] Processing CreateTablet for tablet 427e0356411c46059107c49238ddedfa (DEFAULT_TABLE table=rebalance_test_table_1 [id=b86a650f6d8b477c834fa223d27df9f7]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:39.691642 22559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 427e0356411c46059107c49238ddedfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:39.692914 22922 tablet_service.cc:1511] Processing CreateTablet for tablet 427e0356411c46059107c49238ddedfa (DEFAULT_TABLE table=rebalance_test_table_1 [id=b86a650f6d8b477c834fa223d27df9f7]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:39.693950 22558 tablet_service.cc:1511] Processing CreateTablet for tablet 68dd7bad9556499581be22797800a04d (DEFAULT_TABLE table=rebalance_test_table_1 [id=b86a650f6d8b477c834fa223d27df9f7]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:39.694399 22558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68dd7bad9556499581be22797800a04d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:39.695286 22921 tablet_service.cc:1511] Processing CreateTablet for tablet 68dd7bad9556499581be22797800a04d (DEFAULT_TABLE table=rebalance_test_table_1 [id=b86a650f6d8b477c834fa223d27df9f7]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:39.696224 22922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 427e0356411c46059107c49238ddedfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:39.698215 22739 tablet_service.cc:1511] Processing CreateTablet for tablet a875835a0e7c4109a9035551e5d3104f (DEFAULT_TABLE table=rebalance_test_table_1 [id=b86a650f6d8b477c834fa223d27df9f7]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:39.698670 22739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a875835a0e7c4109a9035551e5d3104f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:39.700975 21994 tablet_service.cc:1511] Processing CreateTablet for tablet a875835a0e7c4109a9035551e5d3104f (DEFAULT_TABLE table=rebalance_test_table_1 [id=b86a650f6d8b477c834fa223d27df9f7]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:39.701494 21994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a875835a0e7c4109a9035551e5d3104f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:39.701792 22921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68dd7bad9556499581be22797800a04d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:39.706001 22178 tablet_service.cc:1511] Processing CreateTablet for tablet 68dd7bad9556499581be22797800a04d (DEFAULT_TABLE table=rebalance_test_table_1 [id=b86a650f6d8b477c834fa223d27df9f7]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:39.706643 22178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68dd7bad9556499581be22797800a04d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:39.712368 23200 tablet_bootstrap.cc:492] T 427e0356411c46059107c49238ddedfa P 78c107f9dfbc4d3483895dda0f791bb2: Bootstrap starting.
I20260810 01:55:39.714986 23196 tablet_bootstrap.cc:492] T 427e0356411c46059107c49238ddedfa P fabe62238d32404097129ae02ed3b0b3: Bootstrap starting.
I20260810 01:55:39.715188 23197 tablet_bootstrap.cc:492] T a875835a0e7c4109a9035551e5d3104f P 687f288b7e9d4650a758d5451483e49b: Bootstrap starting.
I20260810 01:55:39.716178 22364 tablet_service.cc:1511] Processing CreateTablet for tablet a875835a0e7c4109a9035551e5d3104f (DEFAULT_TABLE table=rebalance_test_table_1 [id=b86a650f6d8b477c834fa223d27df9f7]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:39.716629 22364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a875835a0e7c4109a9035551e5d3104f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:39.717514 23196 tablet_bootstrap.cc:654] T 427e0356411c46059107c49238ddedfa P fabe62238d32404097129ae02ed3b0b3: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:39.719839 23200 tablet_bootstrap.cc:654] T 427e0356411c46059107c49238ddedfa P 78c107f9dfbc4d3483895dda0f791bb2: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:39.724167 23197 tablet_bootstrap.cc:654] T a875835a0e7c4109a9035551e5d3104f P 687f288b7e9d4650a758d5451483e49b: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:39.727566 23198 tablet_bootstrap.cc:492] T a875835a0e7c4109a9035551e5d3104f P c5ca831c32e4452dba1cfc6cd296e532: Bootstrap starting.
I20260810 01:55:39.728452 23204 tablet_bootstrap.cc:492] T a875835a0e7c4109a9035551e5d3104f P 65755ebc82864dc3a3193b1ba3870613: Bootstrap starting.
I20260810 01:55:39.731166 23200 tablet_bootstrap.cc:492] T 427e0356411c46059107c49238ddedfa P 78c107f9dfbc4d3483895dda0f791bb2: No bootstrap required, opened a new log
I20260810 01:55:39.731582 23204 tablet_bootstrap.cc:654] T a875835a0e7c4109a9035551e5d3104f P 65755ebc82864dc3a3193b1ba3870613: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:39.733767 23203 tablet_bootstrap.cc:492] T 427e0356411c46059107c49238ddedfa P 5c71783cbed64297b17353312fcd4bb0: Bootstrap starting.
I20260810 01:55:39.733908 23198 tablet_bootstrap.cc:654] T a875835a0e7c4109a9035551e5d3104f P c5ca831c32e4452dba1cfc6cd296e532: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:39.734208 23200 ts_tablet_manager.cc:1403] T 427e0356411c46059107c49238ddedfa P 78c107f9dfbc4d3483895dda0f791bb2: Time spent bootstrapping tablet: real 0.022s user 0.005s sys 0.000s
I20260810 01:55:39.736014 23200 raft_consensus.cc:359] T 427e0356411c46059107c49238ddedfa P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:39.737874 23197 tablet_bootstrap.cc:492] T a875835a0e7c4109a9035551e5d3104f P 687f288b7e9d4650a758d5451483e49b: No bootstrap required, opened a new log
I20260810 01:55:39.738133 23197 ts_tablet_manager.cc:1403] T a875835a0e7c4109a9035551e5d3104f P 687f288b7e9d4650a758d5451483e49b: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.004s
I20260810 01:55:39.738571 23200 raft_consensus.cc:385] T 427e0356411c46059107c49238ddedfa P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:39.738692 23200 raft_consensus.cc:740] T 427e0356411c46059107c49238ddedfa P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78c107f9dfbc4d3483895dda0f791bb2, State: Initialized, Role: FOLLOWER
I20260810 01:55:39.738732 23203 tablet_bootstrap.cc:654] T 427e0356411c46059107c49238ddedfa P 5c71783cbed64297b17353312fcd4bb0: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:39.738946 23200 consensus_queue.cc:260] T 427e0356411c46059107c49238ddedfa P 78c107f9dfbc4d3483895dda0f791bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:39.739563 23200 ts_tablet_manager.cc:1434] T 427e0356411c46059107c49238ddedfa P 78c107f9dfbc4d3483895dda0f791bb2: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260810 01:55:39.740856 23200 tablet_bootstrap.cc:492] T 68dd7bad9556499581be22797800a04d P 78c107f9dfbc4d3483895dda0f791bb2: Bootstrap starting.
I20260810 01:55:39.741958 23204 tablet_bootstrap.cc:492] T a875835a0e7c4109a9035551e5d3104f P 65755ebc82864dc3a3193b1ba3870613: No bootstrap required, opened a new log
I20260810 01:55:39.742211 23204 ts_tablet_manager.cc:1403] T a875835a0e7c4109a9035551e5d3104f P 65755ebc82864dc3a3193b1ba3870613: Time spent bootstrapping tablet: real 0.014s user 0.007s sys 0.005s
I20260810 01:55:39.742806 23200 tablet_bootstrap.cc:654] T 68dd7bad9556499581be22797800a04d P 78c107f9dfbc4d3483895dda0f791bb2: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:39.743407 23204 raft_consensus.cc:359] T a875835a0e7c4109a9035551e5d3104f P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:39.743724 23204 raft_consensus.cc:385] T a875835a0e7c4109a9035551e5d3104f P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:39.743888 23204 raft_consensus.cc:740] T a875835a0e7c4109a9035551e5d3104f P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65755ebc82864dc3a3193b1ba3870613, State: Initialized, Role: FOLLOWER
I20260810 01:55:39.744357 23204 consensus_queue.cc:260] T a875835a0e7c4109a9035551e5d3104f P 65755ebc82864dc3a3193b1ba3870613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:39.745935 23197 raft_consensus.cc:359] T a875835a0e7c4109a9035551e5d3104f P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:39.746452 23198 tablet_bootstrap.cc:492] T a875835a0e7c4109a9035551e5d3104f P c5ca831c32e4452dba1cfc6cd296e532: No bootstrap required, opened a new log
I20260810 01:55:39.746619 23198 ts_tablet_manager.cc:1403] T a875835a0e7c4109a9035551e5d3104f P c5ca831c32e4452dba1cfc6cd296e532: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.000s
I20260810 01:55:39.746964 23203 tablet_bootstrap.cc:492] T 427e0356411c46059107c49238ddedfa P 5c71783cbed64297b17353312fcd4bb0: No bootstrap required, opened a new log
I20260810 01:55:39.747169 23203 ts_tablet_manager.cc:1403] T 427e0356411c46059107c49238ddedfa P 5c71783cbed64297b17353312fcd4bb0: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.004s
I20260810 01:55:39.747493 23198 raft_consensus.cc:359] T a875835a0e7c4109a9035551e5d3104f P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:39.747691 23198 raft_consensus.cc:385] T a875835a0e7c4109a9035551e5d3104f P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:39.747797 23198 raft_consensus.cc:740] T a875835a0e7c4109a9035551e5d3104f P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ca831c32e4452dba1cfc6cd296e532, State: Initialized, Role: FOLLOWER
I20260810 01:55:39.747916 23196 tablet_bootstrap.cc:492] T 427e0356411c46059107c49238ddedfa P fabe62238d32404097129ae02ed3b0b3: No bootstrap required, opened a new log
I20260810 01:55:39.748121 23196 ts_tablet_manager.cc:1403] T 427e0356411c46059107c49238ddedfa P fabe62238d32404097129ae02ed3b0b3: Time spent bootstrapping tablet: real 0.033s user 0.008s sys 0.017s
I20260810 01:55:39.748057 23198 consensus_queue.cc:260] T a875835a0e7c4109a9035551e5d3104f P c5ca831c32e4452dba1cfc6cd296e532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:39.748605 23198 ts_tablet_manager.cc:1434] T a875835a0e7c4109a9035551e5d3104f P c5ca831c32e4452dba1cfc6cd296e532: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 01:55:39.749541 23203 raft_consensus.cc:359] T 427e0356411c46059107c49238ddedfa P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:39.749789 23203 raft_consensus.cc:385] T 427e0356411c46059107c49238ddedfa P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:39.749965 23203 raft_consensus.cc:740] T 427e0356411c46059107c49238ddedfa P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c71783cbed64297b17353312fcd4bb0, State: Initialized, Role: FOLLOWER
I20260810 01:55:39.750474 23203 consensus_queue.cc:260] T 427e0356411c46059107c49238ddedfa P 5c71783cbed64297b17353312fcd4bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:39.751786 23197 raft_consensus.cc:385] T a875835a0e7c4109a9035551e5d3104f P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:39.751845 23196 raft_consensus.cc:359] T 427e0356411c46059107c49238ddedfa P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:39.752004 23197 raft_consensus.cc:740] T a875835a0e7c4109a9035551e5d3104f P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687f288b7e9d4650a758d5451483e49b, State: Initialized, Role: FOLLOWER
I20260810 01:55:39.752089 23196 raft_consensus.cc:385] T 427e0356411c46059107c49238ddedfa P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:39.752213 23196 raft_consensus.cc:740] T 427e0356411c46059107c49238ddedfa P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabe62238d32404097129ae02ed3b0b3, State: Initialized, Role: FOLLOWER
I20260810 01:55:39.752359 23197 consensus_queue.cc:260] T a875835a0e7c4109a9035551e5d3104f P 687f288b7e9d4650a758d5451483e49b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:39.753182 23197 ts_tablet_manager.cc:1434] T a875835a0e7c4109a9035551e5d3104f P 687f288b7e9d4650a758d5451483e49b: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20260810 01:55:39.753494 23196 consensus_queue.cc:260] T 427e0356411c46059107c49238ddedfa P fabe62238d32404097129ae02ed3b0b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:39.755410 23203 ts_tablet_manager.cc:1434] T 427e0356411c46059107c49238ddedfa P 5c71783cbed64297b17353312fcd4bb0: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260810 01:55:39.756579 23203 tablet_bootstrap.cc:492] T 68dd7bad9556499581be22797800a04d P 5c71783cbed64297b17353312fcd4bb0: Bootstrap starting.
I20260810 01:55:39.759085 23203 tablet_bootstrap.cc:654] T 68dd7bad9556499581be22797800a04d P 5c71783cbed64297b17353312fcd4bb0: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:39.761116 23200 tablet_bootstrap.cc:492] T 68dd7bad9556499581be22797800a04d P 78c107f9dfbc4d3483895dda0f791bb2: No bootstrap required, opened a new log
I20260810 01:55:39.761379 23200 ts_tablet_manager.cc:1403] T 68dd7bad9556499581be22797800a04d P 78c107f9dfbc4d3483895dda0f791bb2: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.010s
I20260810 01:55:39.762490 23200 raft_consensus.cc:359] T 68dd7bad9556499581be22797800a04d P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:39.762755 23200 raft_consensus.cc:385] T 68dd7bad9556499581be22797800a04d P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:39.762846 23200 raft_consensus.cc:740] T 68dd7bad9556499581be22797800a04d P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78c107f9dfbc4d3483895dda0f791bb2, State: Initialized, Role: FOLLOWER
I20260810 01:55:39.763562 23200 consensus_queue.cc:260] T 68dd7bad9556499581be22797800a04d P 78c107f9dfbc4d3483895dda0f791bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:39.764438 23200 ts_tablet_manager.cc:1434] T 68dd7bad9556499581be22797800a04d P 78c107f9dfbc4d3483895dda0f791bb2: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260810 01:55:39.765996 23204 ts_tablet_manager.cc:1434] T a875835a0e7c4109a9035551e5d3104f P 65755ebc82864dc3a3193b1ba3870613: Time spent starting tablet: real 0.024s user 0.006s sys 0.013s
I20260810 01:55:39.766803 23220 raft_consensus.cc:493] T 427e0356411c46059107c49238ddedfa P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:55:39.767092 23220 raft_consensus.cc:515] T 427e0356411c46059107c49238ddedfa P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:39.768321 23203 tablet_bootstrap.cc:492] T 68dd7bad9556499581be22797800a04d P 5c71783cbed64297b17353312fcd4bb0: No bootstrap required, opened a new log
I20260810 01:55:39.767351 23196 ts_tablet_manager.cc:1434] T 427e0356411c46059107c49238ddedfa P fabe62238d32404097129ae02ed3b0b3: Time spent starting tablet: real 0.019s user 0.014s sys 0.001s
I20260810 01:55:39.768591 23203 ts_tablet_manager.cc:1403] T 68dd7bad9556499581be22797800a04d P 5c71783cbed64297b17353312fcd4bb0: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.000s
I20260810 01:55:39.768801 23196 tablet_bootstrap.cc:492] T 68dd7bad9556499581be22797800a04d P fabe62238d32404097129ae02ed3b0b3: Bootstrap starting.
I20260810 01:55:39.770177 23203 raft_consensus.cc:359] T 68dd7bad9556499581be22797800a04d P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:39.770457 23203 raft_consensus.cc:385] T 68dd7bad9556499581be22797800a04d P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:39.770582 23203 raft_consensus.cc:740] T 68dd7bad9556499581be22797800a04d P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c71783cbed64297b17353312fcd4bb0, State: Initialized, Role: FOLLOWER
I20260810 01:55:39.770996 23203 consensus_queue.cc:260] T 68dd7bad9556499581be22797800a04d P 5c71783cbed64297b17353312fcd4bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:39.771813 23196 tablet_bootstrap.cc:654] T 68dd7bad9556499581be22797800a04d P fabe62238d32404097129ae02ed3b0b3: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:39.771857 23203 ts_tablet_manager.cc:1434] T 68dd7bad9556499581be22797800a04d P 5c71783cbed64297b17353312fcd4bb0: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 01:55:39.772593 23220 leader_election.cc:290] T 427e0356411c46059107c49238ddedfa P fabe62238d32404097129ae02ed3b0b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194:33547), 5c71783cbed64297b17353312fcd4bb0 (127.21.64.198:33973)
I20260810 01:55:39.778045 23196 tablet_bootstrap.cc:492] T 68dd7bad9556499581be22797800a04d P fabe62238d32404097129ae02ed3b0b3: No bootstrap required, opened a new log
I20260810 01:55:39.778388 23196 ts_tablet_manager.cc:1403] T 68dd7bad9556499581be22797800a04d P fabe62238d32404097129ae02ed3b0b3: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.005s
I20260810 01:55:39.779500 23196 raft_consensus.cc:359] T 68dd7bad9556499581be22797800a04d P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:39.779968 23196 raft_consensus.cc:385] T 68dd7bad9556499581be22797800a04d P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:39.780113 23196 raft_consensus.cc:740] T 68dd7bad9556499581be22797800a04d P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabe62238d32404097129ae02ed3b0b3, State: Initialized, Role: FOLLOWER
I20260810 01:55:39.780524 23196 consensus_queue.cc:260] T 68dd7bad9556499581be22797800a04d P fabe62238d32404097129ae02ed3b0b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:39.781400 23196 ts_tablet_manager.cc:1434] T 68dd7bad9556499581be22797800a04d P fabe62238d32404097129ae02ed3b0b3: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260810 01:55:39.787148 22209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427e0356411c46059107c49238ddedfa" candidate_uuid: "fabe62238d32404097129ae02ed3b0b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78c107f9dfbc4d3483895dda0f791bb2" is_pre_election: true
I20260810 01:55:39.787643 22209 raft_consensus.cc:2468] T 427e0356411c46059107c49238ddedfa P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabe62238d32404097129ae02ed3b0b3 in term 0.
I20260810 01:55:39.788329 22502 leader_election.cc:304] T 427e0356411c46059107c49238ddedfa P fabe62238d32404097129ae02ed3b0b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78c107f9dfbc4d3483895dda0f791bb2, fabe62238d32404097129ae02ed3b0b3; no voters:
I20260810 01:55:39.788758 23220 raft_consensus.cc:2804] T 427e0356411c46059107c49238ddedfa P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:55:39.788897 23220 raft_consensus.cc:493] T 427e0356411c46059107c49238ddedfa P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:55:39.788972 23220 raft_consensus.cc:3060] T 427e0356411c46059107c49238ddedfa P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:39.789009 22952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427e0356411c46059107c49238ddedfa" candidate_uuid: "fabe62238d32404097129ae02ed3b0b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c71783cbed64297b17353312fcd4bb0" is_pre_election: true
I20260810 01:55:39.789194 22952 raft_consensus.cc:2468] T 427e0356411c46059107c49238ddedfa P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabe62238d32404097129ae02ed3b0b3 in term 0.
I20260810 01:55:39.791241 23220 raft_consensus.cc:515] T 427e0356411c46059107c49238ddedfa P fabe62238d32404097129ae02ed3b0b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:39.791957 23220 leader_election.cc:290] T 427e0356411c46059107c49238ddedfa P fabe62238d32404097129ae02ed3b0b3 [CANDIDATE]: Term 1 election: Requested vote from peers 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194:33547), 5c71783cbed64297b17353312fcd4bb0 (127.21.64.198:33973)
I20260810 01:55:39.792435 22209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427e0356411c46059107c49238ddedfa" candidate_uuid: "fabe62238d32404097129ae02ed3b0b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78c107f9dfbc4d3483895dda0f791bb2"
I20260810 01:55:39.792622 22209 raft_consensus.cc:3060] T 427e0356411c46059107c49238ddedfa P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:39.792842 22952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427e0356411c46059107c49238ddedfa" candidate_uuid: "fabe62238d32404097129ae02ed3b0b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c71783cbed64297b17353312fcd4bb0"
I20260810 01:55:39.793100 22952 raft_consensus.cc:3060] T 427e0356411c46059107c49238ddedfa P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:39.794873 22209 raft_consensus.cc:2468] T 427e0356411c46059107c49238ddedfa P 78c107f9dfbc4d3483895dda0f791bb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabe62238d32404097129ae02ed3b0b3 in term 1.
I20260810 01:55:39.795256 22502 leader_election.cc:304] T 427e0356411c46059107c49238ddedfa P fabe62238d32404097129ae02ed3b0b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78c107f9dfbc4d3483895dda0f791bb2, fabe62238d32404097129ae02ed3b0b3; no voters:
I20260810 01:55:39.795433 22952 raft_consensus.cc:2468] T 427e0356411c46059107c49238ddedfa P 5c71783cbed64297b17353312fcd4bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabe62238d32404097129ae02ed3b0b3 in term 1.
I20260810 01:55:39.795612 23220 raft_consensus.cc:2804] T 427e0356411c46059107c49238ddedfa P fabe62238d32404097129ae02ed3b0b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:55:39.795919 23220 raft_consensus.cc:697] T 427e0356411c46059107c49238ddedfa P fabe62238d32404097129ae02ed3b0b3 [term 1 LEADER]: Becoming Leader. State: Replica: fabe62238d32404097129ae02ed3b0b3, State: Running, Role: LEADER
I20260810 01:55:39.796417 23220 consensus_queue.cc:237] T 427e0356411c46059107c49238ddedfa P fabe62238d32404097129ae02ed3b0b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:39.799671 21816 catalog_manager.cc:5719] T 427e0356411c46059107c49238ddedfa P fabe62238d32404097129ae02ed3b0b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to fabe62238d32404097129ae02ed3b0b3 (127.21.64.196). New cstate: current_term: 1 leader_uuid: "fabe62238d32404097129ae02ed3b0b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } health_report { overall_health: HEALTHY } } }
I20260810 01:55:39.816774 23213 raft_consensus.cc:493] T 68dd7bad9556499581be22797800a04d P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:55:39.816991 23213 raft_consensus.cc:515] T 68dd7bad9556499581be22797800a04d P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:39.818635 23213 leader_election.cc:290] T 68dd7bad9556499581be22797800a04d P 5c71783cbed64297b17353312fcd4bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fabe62238d32404097129ae02ed3b0b3 (127.21.64.196:32931), 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194:33547)
I20260810 01:55:39.827957 22209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dd7bad9556499581be22797800a04d" candidate_uuid: "5c71783cbed64297b17353312fcd4bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78c107f9dfbc4d3483895dda0f791bb2" is_pre_election: true
I20260810 01:55:39.827947 22588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dd7bad9556499581be22797800a04d" candidate_uuid: "5c71783cbed64297b17353312fcd4bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabe62238d32404097129ae02ed3b0b3" is_pre_election: true
I20260810 01:55:39.828212 22588 raft_consensus.cc:2468] T 68dd7bad9556499581be22797800a04d P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c71783cbed64297b17353312fcd4bb0 in term 0.
I20260810 01:55:39.828212 22209 raft_consensus.cc:2468] T 68dd7bad9556499581be22797800a04d P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c71783cbed64297b17353312fcd4bb0 in term 0.
I20260810 01:55:39.828960 22857 leader_election.cc:304] T 68dd7bad9556499581be22797800a04d P 5c71783cbed64297b17353312fcd4bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 5c71783cbed64297b17353312fcd4bb0, 78c107f9dfbc4d3483895dda0f791bb2, fabe62238d32404097129ae02ed3b0b3; no voters:
I20260810 01:55:39.829429 23213 raft_consensus.cc:2804] T 68dd7bad9556499581be22797800a04d P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:55:39.829605 23213 raft_consensus.cc:493] T 68dd7bad9556499581be22797800a04d P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:55:39.829721 23213 raft_consensus.cc:3060] T 68dd7bad9556499581be22797800a04d P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:39.831847 23213 raft_consensus.cc:515] T 68dd7bad9556499581be22797800a04d P 5c71783cbed64297b17353312fcd4bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:39.832527 23213 leader_election.cc:290] T 68dd7bad9556499581be22797800a04d P 5c71783cbed64297b17353312fcd4bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fabe62238d32404097129ae02ed3b0b3 (127.21.64.196:32931), 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194:33547)
I20260810 01:55:39.832914 22588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dd7bad9556499581be22797800a04d" candidate_uuid: "5c71783cbed64297b17353312fcd4bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabe62238d32404097129ae02ed3b0b3"
I20260810 01:55:39.833000 22209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dd7bad9556499581be22797800a04d" candidate_uuid: "5c71783cbed64297b17353312fcd4bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78c107f9dfbc4d3483895dda0f791bb2"
I20260810 01:55:39.833159 22588 raft_consensus.cc:3060] T 68dd7bad9556499581be22797800a04d P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:39.833210 22209 raft_consensus.cc:3060] T 68dd7bad9556499581be22797800a04d P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:39.835172 22588 raft_consensus.cc:2468] T 68dd7bad9556499581be22797800a04d P fabe62238d32404097129ae02ed3b0b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c71783cbed64297b17353312fcd4bb0 in term 1.
I20260810 01:55:39.835427 22209 raft_consensus.cc:2468] T 68dd7bad9556499581be22797800a04d P 78c107f9dfbc4d3483895dda0f791bb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c71783cbed64297b17353312fcd4bb0 in term 1.
I20260810 01:55:39.835882 22861 leader_election.cc:304] T 68dd7bad9556499581be22797800a04d P 5c71783cbed64297b17353312fcd4bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c71783cbed64297b17353312fcd4bb0, 78c107f9dfbc4d3483895dda0f791bb2; no voters:
I20260810 01:55:39.836207 23213 raft_consensus.cc:2804] T 68dd7bad9556499581be22797800a04d P 5c71783cbed64297b17353312fcd4bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:55:39.836696 23213 raft_consensus.cc:697] T 68dd7bad9556499581be22797800a04d P 5c71783cbed64297b17353312fcd4bb0 [term 1 LEADER]: Becoming Leader. State: Replica: 5c71783cbed64297b17353312fcd4bb0, State: Running, Role: LEADER
I20260810 01:55:39.837208 23213 consensus_queue.cc:237] T 68dd7bad9556499581be22797800a04d P 5c71783cbed64297b17353312fcd4bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:39.840541 21816 catalog_manager.cc:5719] T 68dd7bad9556499581be22797800a04d P 5c71783cbed64297b17353312fcd4bb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c71783cbed64297b17353312fcd4bb0 (127.21.64.198). New cstate: current_term: 1 leader_uuid: "5c71783cbed64297b17353312fcd4bb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } health_report { overall_health: HEALTHY } } }
I20260810 01:55:39.907187 23212 raft_consensus.cc:493] T a875835a0e7c4109a9035551e5d3104f P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:55:39.907368 23212 raft_consensus.cc:515] T a875835a0e7c4109a9035551e5d3104f P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:39.909040 23212 leader_election.cc:290] T a875835a0e7c4109a9035551e5d3104f P 65755ebc82864dc3a3193b1ba3870613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ca831c32e4452dba1cfc6cd296e532 (127.21.64.193:39917), 687f288b7e9d4650a758d5451483e49b (127.21.64.197:37655)
I20260810 01:55:39.928272 22026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a875835a0e7c4109a9035551e5d3104f" candidate_uuid: "65755ebc82864dc3a3193b1ba3870613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ca831c32e4452dba1cfc6cd296e532" is_pre_election: true
I20260810 01:55:39.928371 22770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a875835a0e7c4109a9035551e5d3104f" candidate_uuid: "65755ebc82864dc3a3193b1ba3870613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687f288b7e9d4650a758d5451483e49b" is_pre_election: true
I20260810 01:55:39.928627 22770 raft_consensus.cc:2468] T a875835a0e7c4109a9035551e5d3104f P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65755ebc82864dc3a3193b1ba3870613 in term 0.
I20260810 01:55:39.929263 22294 leader_election.cc:304] T a875835a0e7c4109a9035551e5d3104f P 65755ebc82864dc3a3193b1ba3870613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65755ebc82864dc3a3193b1ba3870613, 687f288b7e9d4650a758d5451483e49b; no voters:
I20260810 01:55:39.929692 23212 raft_consensus.cc:2804] T a875835a0e7c4109a9035551e5d3104f P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:55:39.929688 22026 raft_consensus.cc:2468] T a875835a0e7c4109a9035551e5d3104f P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65755ebc82864dc3a3193b1ba3870613 in term 0.
I20260810 01:55:39.929833 23212 raft_consensus.cc:493] T a875835a0e7c4109a9035551e5d3104f P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:55:39.929934 23212 raft_consensus.cc:3060] T a875835a0e7c4109a9035551e5d3104f P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:39.932096 23212 raft_consensus.cc:515] T a875835a0e7c4109a9035551e5d3104f P 65755ebc82864dc3a3193b1ba3870613 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:39.932720 23212 leader_election.cc:290] T a875835a0e7c4109a9035551e5d3104f P 65755ebc82864dc3a3193b1ba3870613 [CANDIDATE]: Term 1 election: Requested vote from peers c5ca831c32e4452dba1cfc6cd296e532 (127.21.64.193:39917), 687f288b7e9d4650a758d5451483e49b (127.21.64.197:37655)
I20260810 01:55:39.933211 22026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a875835a0e7c4109a9035551e5d3104f" candidate_uuid: "65755ebc82864dc3a3193b1ba3870613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ca831c32e4452dba1cfc6cd296e532"
I20260810 01:55:39.933234 22770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a875835a0e7c4109a9035551e5d3104f" candidate_uuid: "65755ebc82864dc3a3193b1ba3870613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687f288b7e9d4650a758d5451483e49b"
I20260810 01:55:39.933473 22026 raft_consensus.cc:3060] T a875835a0e7c4109a9035551e5d3104f P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:39.933494 22770 raft_consensus.cc:3060] T a875835a0e7c4109a9035551e5d3104f P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:39.935454 22770 raft_consensus.cc:2468] T a875835a0e7c4109a9035551e5d3104f P 687f288b7e9d4650a758d5451483e49b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65755ebc82864dc3a3193b1ba3870613 in term 1.
I20260810 01:55:39.935489 22026 raft_consensus.cc:2468] T a875835a0e7c4109a9035551e5d3104f P c5ca831c32e4452dba1cfc6cd296e532 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65755ebc82864dc3a3193b1ba3870613 in term 1.
I20260810 01:55:39.935905 22294 leader_election.cc:304] T a875835a0e7c4109a9035551e5d3104f P 65755ebc82864dc3a3193b1ba3870613 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65755ebc82864dc3a3193b1ba3870613, 687f288b7e9d4650a758d5451483e49b; no voters:
I20260810 01:55:39.936209 23212 raft_consensus.cc:2804] T a875835a0e7c4109a9035551e5d3104f P 65755ebc82864dc3a3193b1ba3870613 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:55:39.936625 23212 raft_consensus.cc:697] T a875835a0e7c4109a9035551e5d3104f P 65755ebc82864dc3a3193b1ba3870613 [term 1 LEADER]: Becoming Leader. State: Replica: 65755ebc82864dc3a3193b1ba3870613, State: Running, Role: LEADER
I20260810 01:55:39.937213 23212 consensus_queue.cc:237] T a875835a0e7c4109a9035551e5d3104f P 65755ebc82864dc3a3193b1ba3870613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:39.941064 21816 catalog_manager.cc:5719] T a875835a0e7c4109a9035551e5d3104f P 65755ebc82864dc3a3193b1ba3870613 reported cstate change: term changed from 0 to 1, leader changed from <none> to 65755ebc82864dc3a3193b1ba3870613 (127.21.64.195). New cstate: current_term: 1 leader_uuid: "65755ebc82864dc3a3193b1ba3870613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } health_report { overall_health: HEALTHY } } }
I20260810 01:55:40.187896 23220 consensus_queue.cc:1048] T 427e0356411c46059107c49238ddedfa P fabe62238d32404097129ae02ed3b0b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:40.199615 23216 consensus_queue.cc:1048] T 427e0356411c46059107c49238ddedfa P fabe62238d32404097129ae02ed3b0b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:40.252048 23213 consensus_queue.cc:1048] T 68dd7bad9556499581be22797800a04d P 5c71783cbed64297b17353312fcd4bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:40.259037 23213 consensus_queue.cc:1048] T 68dd7bad9556499581be22797800a04d P 5c71783cbed64297b17353312fcd4bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 01:55:40.382305 23244 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:55:40.382786 23244 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260810 01:55:40.415930 23212 consensus_queue.cc:1048] T a875835a0e7c4109a9035551e5d3104f P 65755ebc82864dc3a3193b1ba3870613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:40.425211 23212 consensus_queue.cc:1048] T a875835a0e7c4109a9035551e5d3104f P 65755ebc82864dc3a3193b1ba3870613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
Using table 'rebalance_test_table_1'
INSERT report
rows total: 2000
time total: 299.496 ms
time per row: 0.149748 ms
I20260810 01:55:40.880825 21826 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60594:
name: "rebalance_test_table_2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260810 01:55:40.891119 21994 tablet_service.cc:1511] Processing CreateTablet for tablet 29268e7314114f5c87a36479ed0dd60e (DEFAULT_TABLE table=rebalance_test_table_2 [id=6955ca7b6dc04212b54fb2887d346107]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:40.891394 22739 tablet_service.cc:1511] Processing CreateTablet for tablet 29268e7314114f5c87a36479ed0dd60e (DEFAULT_TABLE table=rebalance_test_table_2 [id=6955ca7b6dc04212b54fb2887d346107]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:40.891682 21994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29268e7314114f5c87a36479ed0dd60e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:40.891885 22739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29268e7314114f5c87a36479ed0dd60e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:40.892446 22178 tablet_service.cc:1511] Processing CreateTablet for tablet 0d8ea0eb9e1440fbb6a729f093d9fc18 (DEFAULT_TABLE table=rebalance_test_table_2 [id=6955ca7b6dc04212b54fb2887d346107]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:40.892724 22922 tablet_service.cc:1511] Processing CreateTablet for tablet 0d8ea0eb9e1440fbb6a729f093d9fc18 (DEFAULT_TABLE table=rebalance_test_table_2 [id=6955ca7b6dc04212b54fb2887d346107]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:40.893034 22178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d8ea0eb9e1440fbb6a729f093d9fc18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:40.893204 22922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d8ea0eb9e1440fbb6a729f093d9fc18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:40.895973 22364 tablet_service.cc:1511] Processing CreateTablet for tablet 29268e7314114f5c87a36479ed0dd60e (DEFAULT_TABLE table=rebalance_test_table_2 [id=6955ca7b6dc04212b54fb2887d346107]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:40.896399 22364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29268e7314114f5c87a36479ed0dd60e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:40.907958 23334 tablet_bootstrap.cc:492] T 29268e7314114f5c87a36479ed0dd60e P c5ca831c32e4452dba1cfc6cd296e532: Bootstrap starting.
I20260810 01:55:40.908808 23338 tablet_bootstrap.cc:492] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P 5c71783cbed64297b17353312fcd4bb0: Bootstrap starting.
I20260810 01:55:40.909552 22559 tablet_service.cc:1511] Processing CreateTablet for tablet 0d8ea0eb9e1440fbb6a729f093d9fc18 (DEFAULT_TABLE table=rebalance_test_table_2 [id=6955ca7b6dc04212b54fb2887d346107]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:40.910022 22559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d8ea0eb9e1440fbb6a729f093d9fc18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:40.910728 23335 tablet_bootstrap.cc:492] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P 78c107f9dfbc4d3483895dda0f791bb2: Bootstrap starting.
I20260810 01:55:40.912484 23334 tablet_bootstrap.cc:654] T 29268e7314114f5c87a36479ed0dd60e P c5ca831c32e4452dba1cfc6cd296e532: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:40.913592 23336 tablet_bootstrap.cc:492] T 29268e7314114f5c87a36479ed0dd60e P 687f288b7e9d4650a758d5451483e49b: Bootstrap starting.
I20260810 01:55:40.914950 23335 tablet_bootstrap.cc:654] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P 78c107f9dfbc4d3483895dda0f791bb2: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:40.915499 23336 tablet_bootstrap.cc:654] T 29268e7314114f5c87a36479ed0dd60e P 687f288b7e9d4650a758d5451483e49b: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:40.916597 21994 tablet_service.cc:1511] Processing CreateTablet for tablet 50e87df99e0947a294ea41b1fd5f71c1 (DEFAULT_TABLE table=rebalance_test_table_2 [id=6955ca7b6dc04212b54fb2887d346107]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:40.917013 21994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50e87df99e0947a294ea41b1fd5f71c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:40.917156 22739 tablet_service.cc:1511] Processing CreateTablet for tablet 50e87df99e0947a294ea41b1fd5f71c1 (DEFAULT_TABLE table=rebalance_test_table_2 [id=6955ca7b6dc04212b54fb2887d346107]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:40.917577 22739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50e87df99e0947a294ea41b1fd5f71c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:40.924001 23338 tablet_bootstrap.cc:654] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P 5c71783cbed64297b17353312fcd4bb0: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:40.925549 22363 tablet_service.cc:1511] Processing CreateTablet for tablet 50e87df99e0947a294ea41b1fd5f71c1 (DEFAULT_TABLE table=rebalance_test_table_2 [id=6955ca7b6dc04212b54fb2887d346107]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:40.926126 22363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50e87df99e0947a294ea41b1fd5f71c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:40.938710 23345 tablet_bootstrap.cc:492] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P fabe62238d32404097129ae02ed3b0b3: Bootstrap starting.
I20260810 01:55:40.938719 23334 tablet_bootstrap.cc:492] T 29268e7314114f5c87a36479ed0dd60e P c5ca831c32e4452dba1cfc6cd296e532: No bootstrap required, opened a new log
I20260810 01:55:40.939105 23334 ts_tablet_manager.cc:1403] T 29268e7314114f5c87a36479ed0dd60e P c5ca831c32e4452dba1cfc6cd296e532: Time spent bootstrapping tablet: real 0.031s user 0.003s sys 0.011s
I20260810 01:55:40.940882 23334 raft_consensus.cc:359] T 29268e7314114f5c87a36479ed0dd60e P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:40.941232 23345 tablet_bootstrap.cc:654] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P fabe62238d32404097129ae02ed3b0b3: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:40.941506 23346 tablet_bootstrap.cc:492] T 29268e7314114f5c87a36479ed0dd60e P 65755ebc82864dc3a3193b1ba3870613: Bootstrap starting.
I20260810 01:55:40.941802 23334 raft_consensus.cc:385] T 29268e7314114f5c87a36479ed0dd60e P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:40.942065 23334 raft_consensus.cc:740] T 29268e7314114f5c87a36479ed0dd60e P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ca831c32e4452dba1cfc6cd296e532, State: Initialized, Role: FOLLOWER
I20260810 01:55:40.942566 23334 consensus_queue.cc:260] T 29268e7314114f5c87a36479ed0dd60e P c5ca831c32e4452dba1cfc6cd296e532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:40.943833 23346 tablet_bootstrap.cc:654] T 29268e7314114f5c87a36479ed0dd60e P 65755ebc82864dc3a3193b1ba3870613: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:40.947404 23338 tablet_bootstrap.cc:492] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P 5c71783cbed64297b17353312fcd4bb0: No bootstrap required, opened a new log
I20260810 01:55:40.947659 23338 ts_tablet_manager.cc:1403] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P 5c71783cbed64297b17353312fcd4bb0: Time spent bootstrapping tablet: real 0.039s user 0.003s sys 0.011s
I20260810 01:55:40.948983 23335 tablet_bootstrap.cc:492] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P 78c107f9dfbc4d3483895dda0f791bb2: No bootstrap required, opened a new log
I20260810 01:55:40.948866 23338 raft_consensus.cc:359] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:40.949156 23335 ts_tablet_manager.cc:1403] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P 78c107f9dfbc4d3483895dda0f791bb2: Time spent bootstrapping tablet: real 0.039s user 0.016s sys 0.012s
I20260810 01:55:40.949154 23338 raft_consensus.cc:385] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:40.949384 23338 raft_consensus.cc:740] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c71783cbed64297b17353312fcd4bb0, State: Initialized, Role: FOLLOWER
I20260810 01:55:40.949674 23336 tablet_bootstrap.cc:492] T 29268e7314114f5c87a36479ed0dd60e P 687f288b7e9d4650a758d5451483e49b: No bootstrap required, opened a new log
I20260810 01:55:40.949885 23336 ts_tablet_manager.cc:1403] T 29268e7314114f5c87a36479ed0dd60e P 687f288b7e9d4650a758d5451483e49b: Time spent bootstrapping tablet: real 0.037s user 0.003s sys 0.012s
I20260810 01:55:40.949715 23338 consensus_queue.cc:260] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P 5c71783cbed64297b17353312fcd4bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:40.950075 23335 raft_consensus.cc:359] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:40.950280 23335 raft_consensus.cc:385] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:40.950359 23334 ts_tablet_manager.cc:1434] T 29268e7314114f5c87a36479ed0dd60e P c5ca831c32e4452dba1cfc6cd296e532: Time spent starting tablet: real 0.009s user 0.001s sys 0.002s
I20260810 01:55:40.950373 23335 raft_consensus.cc:740] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78c107f9dfbc4d3483895dda0f791bb2, State: Initialized, Role: FOLLOWER
I20260810 01:55:40.950601 23335 consensus_queue.cc:260] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P 78c107f9dfbc4d3483895dda0f791bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:40.950785 23336 raft_consensus.cc:359] T 29268e7314114f5c87a36479ed0dd60e P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:40.950999 23336 raft_consensus.cc:385] T 29268e7314114f5c87a36479ed0dd60e P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:40.951119 23336 raft_consensus.cc:740] T 29268e7314114f5c87a36479ed0dd60e P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687f288b7e9d4650a758d5451483e49b, State: Initialized, Role: FOLLOWER
I20260810 01:55:40.951455 23336 consensus_queue.cc:260] T 29268e7314114f5c87a36479ed0dd60e P 687f288b7e9d4650a758d5451483e49b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:40.951454 23335 ts_tablet_manager.cc:1434] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P 78c107f9dfbc4d3483895dda0f791bb2: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 01:55:40.952237 23336 ts_tablet_manager.cc:1434] T 29268e7314114f5c87a36479ed0dd60e P 687f288b7e9d4650a758d5451483e49b: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 01:55:40.952639 23336 tablet_bootstrap.cc:492] T 50e87df99e0947a294ea41b1fd5f71c1 P 687f288b7e9d4650a758d5451483e49b: Bootstrap starting.
I20260810 01:55:40.954386 23334 tablet_bootstrap.cc:492] T 50e87df99e0947a294ea41b1fd5f71c1 P c5ca831c32e4452dba1cfc6cd296e532: Bootstrap starting.
I20260810 01:55:40.955181 23336 tablet_bootstrap.cc:654] T 50e87df99e0947a294ea41b1fd5f71c1 P 687f288b7e9d4650a758d5451483e49b: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:40.956326 23346 tablet_bootstrap.cc:492] T 29268e7314114f5c87a36479ed0dd60e P 65755ebc82864dc3a3193b1ba3870613: No bootstrap required, opened a new log
I20260810 01:55:40.956542 23346 ts_tablet_manager.cc:1403] T 29268e7314114f5c87a36479ed0dd60e P 65755ebc82864dc3a3193b1ba3870613: Time spent bootstrapping tablet: real 0.019s user 0.000s sys 0.005s
I20260810 01:55:40.956791 23334 tablet_bootstrap.cc:654] T 50e87df99e0947a294ea41b1fd5f71c1 P c5ca831c32e4452dba1cfc6cd296e532: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:40.957683 23346 raft_consensus.cc:359] T 29268e7314114f5c87a36479ed0dd60e P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:40.957891 23346 raft_consensus.cc:385] T 29268e7314114f5c87a36479ed0dd60e P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:40.957990 23346 raft_consensus.cc:740] T 29268e7314114f5c87a36479ed0dd60e P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65755ebc82864dc3a3193b1ba3870613, State: Initialized, Role: FOLLOWER
I20260810 01:55:40.958232 23346 consensus_queue.cc:260] T 29268e7314114f5c87a36479ed0dd60e P 65755ebc82864dc3a3193b1ba3870613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:40.959057 23346 ts_tablet_manager.cc:1434] T 29268e7314114f5c87a36479ed0dd60e P 65755ebc82864dc3a3193b1ba3870613: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 01:55:40.959378 23346 tablet_bootstrap.cc:492] T 50e87df99e0947a294ea41b1fd5f71c1 P 65755ebc82864dc3a3193b1ba3870613: Bootstrap starting.
I20260810 01:55:40.961318 23346 tablet_bootstrap.cc:654] T 50e87df99e0947a294ea41b1fd5f71c1 P 65755ebc82864dc3a3193b1ba3870613: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:40.966500 23336 tablet_bootstrap.cc:492] T 50e87df99e0947a294ea41b1fd5f71c1 P 687f288b7e9d4650a758d5451483e49b: No bootstrap required, opened a new log
I20260810 01:55:40.966722 23336 ts_tablet_manager.cc:1403] T 50e87df99e0947a294ea41b1fd5f71c1 P 687f288b7e9d4650a758d5451483e49b: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.009s
I20260810 01:55:40.967630 23336 raft_consensus.cc:359] T 50e87df99e0947a294ea41b1fd5f71c1 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:40.967932 23336 raft_consensus.cc:385] T 50e87df99e0947a294ea41b1fd5f71c1 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:40.968016 23336 raft_consensus.cc:740] T 50e87df99e0947a294ea41b1fd5f71c1 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687f288b7e9d4650a758d5451483e49b, State: Initialized, Role: FOLLOWER
I20260810 01:55:40.968307 23336 consensus_queue.cc:260] T 50e87df99e0947a294ea41b1fd5f71c1 P 687f288b7e9d4650a758d5451483e49b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:40.968571 23334 tablet_bootstrap.cc:492] T 50e87df99e0947a294ea41b1fd5f71c1 P c5ca831c32e4452dba1cfc6cd296e532: No bootstrap required, opened a new log
I20260810 01:55:40.968745 23334 ts_tablet_manager.cc:1403] T 50e87df99e0947a294ea41b1fd5f71c1 P c5ca831c32e4452dba1cfc6cd296e532: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.006s
I20260810 01:55:40.968950 23336 ts_tablet_manager.cc:1434] T 50e87df99e0947a294ea41b1fd5f71c1 P 687f288b7e9d4650a758d5451483e49b: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 01:55:40.969597 23334 raft_consensus.cc:359] T 50e87df99e0947a294ea41b1fd5f71c1 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:40.969837 23334 raft_consensus.cc:385] T 50e87df99e0947a294ea41b1fd5f71c1 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:40.969923 23334 raft_consensus.cc:740] T 50e87df99e0947a294ea41b1fd5f71c1 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ca831c32e4452dba1cfc6cd296e532, State: Initialized, Role: FOLLOWER
I20260810 01:55:40.951613 23338 ts_tablet_manager.cc:1434] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P 5c71783cbed64297b17353312fcd4bb0: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260810 01:55:40.970187 23334 consensus_queue.cc:260] T 50e87df99e0947a294ea41b1fd5f71c1 P c5ca831c32e4452dba1cfc6cd296e532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:40.970638 23346 tablet_bootstrap.cc:492] T 50e87df99e0947a294ea41b1fd5f71c1 P 65755ebc82864dc3a3193b1ba3870613: No bootstrap required, opened a new log
I20260810 01:55:40.970818 23346 ts_tablet_manager.cc:1403] T 50e87df99e0947a294ea41b1fd5f71c1 P 65755ebc82864dc3a3193b1ba3870613: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.008s
I20260810 01:55:40.971764 23334 ts_tablet_manager.cc:1434] T 50e87df99e0947a294ea41b1fd5f71c1 P c5ca831c32e4452dba1cfc6cd296e532: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 01:55:40.971915 23346 raft_consensus.cc:359] T 50e87df99e0947a294ea41b1fd5f71c1 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:40.972172 23346 raft_consensus.cc:385] T 50e87df99e0947a294ea41b1fd5f71c1 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:40.972254 23346 raft_consensus.cc:740] T 50e87df99e0947a294ea41b1fd5f71c1 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65755ebc82864dc3a3193b1ba3870613, State: Initialized, Role: FOLLOWER
I20260810 01:55:40.972551 23346 consensus_queue.cc:260] T 50e87df99e0947a294ea41b1fd5f71c1 P 65755ebc82864dc3a3193b1ba3870613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:40.973739 23346 ts_tablet_manager.cc:1434] T 50e87df99e0947a294ea41b1fd5f71c1 P 65755ebc82864dc3a3193b1ba3870613: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 01:55:40.973883 23345 tablet_bootstrap.cc:492] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P fabe62238d32404097129ae02ed3b0b3: No bootstrap required, opened a new log
I20260810 01:55:40.974056 23345 ts_tablet_manager.cc:1403] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P fabe62238d32404097129ae02ed3b0b3: Time spent bootstrapping tablet: real 0.035s user 0.005s sys 0.000s
I20260810 01:55:40.974951 23345 raft_consensus.cc:359] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:40.975178 23345 raft_consensus.cc:385] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:40.976214 23345 raft_consensus.cc:740] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabe62238d32404097129ae02ed3b0b3, State: Initialized, Role: FOLLOWER
I20260810 01:55:40.976523 23345 consensus_queue.cc:260] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P fabe62238d32404097129ae02ed3b0b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:40.977167 23345 ts_tablet_manager.cc:1434] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P fabe62238d32404097129ae02ed3b0b3: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 01:55:41.047541 23213 raft_consensus.cc:493] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:55:41.047817 23213 raft_consensus.cc:515] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:41.048588 23213 leader_election.cc:290] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P 5c71783cbed64297b17353312fcd4bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194:33547), fabe62238d32404097129ae02ed3b0b3 (127.21.64.196:32931)
I20260810 01:55:41.049325 22209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8ea0eb9e1440fbb6a729f093d9fc18" candidate_uuid: "5c71783cbed64297b17353312fcd4bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78c107f9dfbc4d3483895dda0f791bb2" is_pre_election: true
I20260810 01:55:41.049324 22587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8ea0eb9e1440fbb6a729f093d9fc18" candidate_uuid: "5c71783cbed64297b17353312fcd4bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabe62238d32404097129ae02ed3b0b3" is_pre_election: true
I20260810 01:55:41.049592 22209 raft_consensus.cc:2468] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c71783cbed64297b17353312fcd4bb0 in term 0.
I20260810 01:55:41.049592 22587 raft_consensus.cc:2468] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c71783cbed64297b17353312fcd4bb0 in term 0.
I20260810 01:55:41.050130 22861 leader_election.cc:304] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P 5c71783cbed64297b17353312fcd4bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c71783cbed64297b17353312fcd4bb0, 78c107f9dfbc4d3483895dda0f791bb2; no voters:
I20260810 01:55:41.050477 23213 raft_consensus.cc:2804] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:55:41.050591 23213 raft_consensus.cc:493] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:55:41.050710 23213 raft_consensus.cc:3060] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:41.053154 23213 raft_consensus.cc:515] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P 5c71783cbed64297b17353312fcd4bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:41.053779 23213 leader_election.cc:290] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P 5c71783cbed64297b17353312fcd4bb0 [CANDIDATE]: Term 1 election: Requested vote from peers 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194:33547), fabe62238d32404097129ae02ed3b0b3 (127.21.64.196:32931)
I20260810 01:55:41.054188 22209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8ea0eb9e1440fbb6a729f093d9fc18" candidate_uuid: "5c71783cbed64297b17353312fcd4bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78c107f9dfbc4d3483895dda0f791bb2"
I20260810 01:55:41.054246 22587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8ea0eb9e1440fbb6a729f093d9fc18" candidate_uuid: "5c71783cbed64297b17353312fcd4bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabe62238d32404097129ae02ed3b0b3"
I20260810 01:55:41.054394 22209 raft_consensus.cc:3060] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:41.054471 22587 raft_consensus.cc:3060] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:41.056496 22587 raft_consensus.cc:2468] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P fabe62238d32404097129ae02ed3b0b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c71783cbed64297b17353312fcd4bb0 in term 1.
I20260810 01:55:41.056715 22209 raft_consensus.cc:2468] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P 78c107f9dfbc4d3483895dda0f791bb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c71783cbed64297b17353312fcd4bb0 in term 1.
I20260810 01:55:41.056922 22857 leader_election.cc:304] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P 5c71783cbed64297b17353312fcd4bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c71783cbed64297b17353312fcd4bb0, fabe62238d32404097129ae02ed3b0b3; no voters:
I20260810 01:55:41.057190 23213 raft_consensus.cc:2804] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P 5c71783cbed64297b17353312fcd4bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:55:41.057415 23213 raft_consensus.cc:697] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P 5c71783cbed64297b17353312fcd4bb0 [term 1 LEADER]: Becoming Leader. State: Replica: 5c71783cbed64297b17353312fcd4bb0, State: Running, Role: LEADER
I20260810 01:55:41.057689 23213 consensus_queue.cc:237] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P 5c71783cbed64297b17353312fcd4bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:41.060737 21826 catalog_manager.cc:5719] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P 5c71783cbed64297b17353312fcd4bb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c71783cbed64297b17353312fcd4bb0 (127.21.64.198). New cstate: current_term: 1 leader_uuid: "5c71783cbed64297b17353312fcd4bb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } health_report { overall_health: UNKNOWN } } }
I20260810 01:55:41.179705 23107 raft_consensus.cc:493] T 50e87df99e0947a294ea41b1fd5f71c1 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:55:41.179962 23107 raft_consensus.cc:515] T 50e87df99e0947a294ea41b1fd5f71c1 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:41.180898 23107 leader_election.cc:290] T 50e87df99e0947a294ea41b1fd5f71c1 P c5ca831c32e4452dba1cfc6cd296e532 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687f288b7e9d4650a758d5451483e49b (127.21.64.197:37655), 65755ebc82864dc3a3193b1ba3870613 (127.21.64.195:46103)
I20260810 01:55:41.181470 22770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e87df99e0947a294ea41b1fd5f71c1" candidate_uuid: "c5ca831c32e4452dba1cfc6cd296e532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687f288b7e9d4650a758d5451483e49b" is_pre_election: true
I20260810 01:55:41.181774 22770 raft_consensus.cc:2468] T 50e87df99e0947a294ea41b1fd5f71c1 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ca831c32e4452dba1cfc6cd296e532 in term 0.
I20260810 01:55:41.182314 21930 leader_election.cc:304] T 50e87df99e0947a294ea41b1fd5f71c1 P c5ca831c32e4452dba1cfc6cd296e532 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687f288b7e9d4650a758d5451483e49b, c5ca831c32e4452dba1cfc6cd296e532; no voters:
I20260810 01:55:41.182673 23107 raft_consensus.cc:2804] T 50e87df99e0947a294ea41b1fd5f71c1 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:55:41.182827 23107 raft_consensus.cc:493] T 50e87df99e0947a294ea41b1fd5f71c1 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:55:41.182981 23107 raft_consensus.cc:3060] T 50e87df99e0947a294ea41b1fd5f71c1 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:41.183698 23212 raft_consensus.cc:493] T 29268e7314114f5c87a36479ed0dd60e P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:55:41.183946 23212 raft_consensus.cc:515] T 29268e7314114f5c87a36479ed0dd60e P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:41.184630 23212 leader_election.cc:290] T 29268e7314114f5c87a36479ed0dd60e P 65755ebc82864dc3a3193b1ba3870613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ca831c32e4452dba1cfc6cd296e532 (127.21.64.193:39917), 687f288b7e9d4650a758d5451483e49b (127.21.64.197:37655)
I20260810 01:55:41.185122 22026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29268e7314114f5c87a36479ed0dd60e" candidate_uuid: "65755ebc82864dc3a3193b1ba3870613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ca831c32e4452dba1cfc6cd296e532" is_pre_election: true
I20260810 01:55:41.185389 22026 raft_consensus.cc:2468] T 29268e7314114f5c87a36479ed0dd60e P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65755ebc82864dc3a3193b1ba3870613 in term 0.
I20260810 01:55:41.185827 22770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29268e7314114f5c87a36479ed0dd60e" candidate_uuid: "65755ebc82864dc3a3193b1ba3870613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687f288b7e9d4650a758d5451483e49b" is_pre_election: true
I20260810 01:55:41.186058 22770 raft_consensus.cc:2468] T 29268e7314114f5c87a36479ed0dd60e P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65755ebc82864dc3a3193b1ba3870613 in term 0.
I20260810 01:55:41.186070 23107 raft_consensus.cc:515] T 50e87df99e0947a294ea41b1fd5f71c1 P c5ca831c32e4452dba1cfc6cd296e532 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:41.186563 22297 leader_election.cc:304] T 29268e7314114f5c87a36479ed0dd60e P 65755ebc82864dc3a3193b1ba3870613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65755ebc82864dc3a3193b1ba3870613, c5ca831c32e4452dba1cfc6cd296e532; no voters:
I20260810 01:55:41.186898 23107 leader_election.cc:290] T 50e87df99e0947a294ea41b1fd5f71c1 P c5ca831c32e4452dba1cfc6cd296e532 [CANDIDATE]: Term 1 election: Requested vote from peers 687f288b7e9d4650a758d5451483e49b (127.21.64.197:37655), 65755ebc82864dc3a3193b1ba3870613 (127.21.64.195:46103)
I20260810 01:55:41.186949 23212 raft_consensus.cc:2804] T 29268e7314114f5c87a36479ed0dd60e P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:55:41.187052 23212 raft_consensus.cc:493] T 29268e7314114f5c87a36479ed0dd60e P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:55:41.187160 23212 raft_consensus.cc:3060] T 29268e7314114f5c87a36479ed0dd60e P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:41.187536 22770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e87df99e0947a294ea41b1fd5f71c1" candidate_uuid: "c5ca831c32e4452dba1cfc6cd296e532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687f288b7e9d4650a758d5451483e49b"
I20260810 01:55:41.187692 22770 raft_consensus.cc:3060] T 50e87df99e0947a294ea41b1fd5f71c1 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:41.189890 22770 raft_consensus.cc:2468] T 50e87df99e0947a294ea41b1fd5f71c1 P 687f288b7e9d4650a758d5451483e49b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ca831c32e4452dba1cfc6cd296e532 in term 1.
I20260810 01:55:41.189913 22392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e87df99e0947a294ea41b1fd5f71c1" candidate_uuid: "c5ca831c32e4452dba1cfc6cd296e532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65755ebc82864dc3a3193b1ba3870613" is_pre_election: true
I20260810 01:55:41.190024 22391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e87df99e0947a294ea41b1fd5f71c1" candidate_uuid: "c5ca831c32e4452dba1cfc6cd296e532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65755ebc82864dc3a3193b1ba3870613"
I20260810 01:55:41.190131 22392 raft_consensus.cc:2468] T 50e87df99e0947a294ea41b1fd5f71c1 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ca831c32e4452dba1cfc6cd296e532 in term 0.
I20260810 01:55:41.190362 21930 leader_election.cc:304] T 50e87df99e0947a294ea41b1fd5f71c1 P c5ca831c32e4452dba1cfc6cd296e532 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687f288b7e9d4650a758d5451483e49b, c5ca831c32e4452dba1cfc6cd296e532; no voters:
I20260810 01:55:41.190426 23212 raft_consensus.cc:515] T 29268e7314114f5c87a36479ed0dd60e P 65755ebc82864dc3a3193b1ba3870613 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:41.190649 23107 raft_consensus.cc:2804] T 50e87df99e0947a294ea41b1fd5f71c1 P c5ca831c32e4452dba1cfc6cd296e532 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:55:41.190820 23107 raft_consensus.cc:697] T 50e87df99e0947a294ea41b1fd5f71c1 P c5ca831c32e4452dba1cfc6cd296e532 [term 1 LEADER]: Becoming Leader. State: Replica: c5ca831c32e4452dba1cfc6cd296e532, State: Running, Role: LEADER
I20260810 01:55:41.191196 23107 consensus_queue.cc:237] T 50e87df99e0947a294ea41b1fd5f71c1 P c5ca831c32e4452dba1cfc6cd296e532 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:41.191669 22026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29268e7314114f5c87a36479ed0dd60e" candidate_uuid: "65755ebc82864dc3a3193b1ba3870613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ca831c32e4452dba1cfc6cd296e532"
I20260810 01:55:41.191732 22770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29268e7314114f5c87a36479ed0dd60e" candidate_uuid: "65755ebc82864dc3a3193b1ba3870613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687f288b7e9d4650a758d5451483e49b"
I20260810 01:55:41.191882 22026 raft_consensus.cc:3060] T 29268e7314114f5c87a36479ed0dd60e P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:41.191910 22770 raft_consensus.cc:3060] T 29268e7314114f5c87a36479ed0dd60e P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:41.193063 23212 leader_election.cc:290] T 29268e7314114f5c87a36479ed0dd60e P 65755ebc82864dc3a3193b1ba3870613 [CANDIDATE]: Term 1 election: Requested vote from peers c5ca831c32e4452dba1cfc6cd296e532 (127.21.64.193:39917), 687f288b7e9d4650a758d5451483e49b (127.21.64.197:37655)
I20260810 01:55:41.194947 22026 raft_consensus.cc:2468] T 29268e7314114f5c87a36479ed0dd60e P c5ca831c32e4452dba1cfc6cd296e532 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65755ebc82864dc3a3193b1ba3870613 in term 1.
I20260810 01:55:41.195147 22770 raft_consensus.cc:2468] T 29268e7314114f5c87a36479ed0dd60e P 687f288b7e9d4650a758d5451483e49b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65755ebc82864dc3a3193b1ba3870613 in term 1.
I20260810 01:55:41.195340 22297 leader_election.cc:304] T 29268e7314114f5c87a36479ed0dd60e P 65755ebc82864dc3a3193b1ba3870613 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65755ebc82864dc3a3193b1ba3870613, c5ca831c32e4452dba1cfc6cd296e532; no voters:
I20260810 01:55:41.195648 23212 raft_consensus.cc:2804] T 29268e7314114f5c87a36479ed0dd60e P 65755ebc82864dc3a3193b1ba3870613 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:55:41.195816 23212 raft_consensus.cc:697] T 29268e7314114f5c87a36479ed0dd60e P 65755ebc82864dc3a3193b1ba3870613 [term 1 LEADER]: Becoming Leader. State: Replica: 65755ebc82864dc3a3193b1ba3870613, State: Running, Role: LEADER
I20260810 01:55:41.195568 21826 catalog_manager.cc:5719] T 50e87df99e0947a294ea41b1fd5f71c1 P c5ca831c32e4452dba1cfc6cd296e532 reported cstate change: term changed from 0 to 1, leader changed from <none> to c5ca831c32e4452dba1cfc6cd296e532 (127.21.64.193). New cstate: current_term: 1 leader_uuid: "c5ca831c32e4452dba1cfc6cd296e532" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } health_report { overall_health: UNKNOWN } } }
I20260810 01:55:41.196079 23212 consensus_queue.cc:237] T 29268e7314114f5c87a36479ed0dd60e P 65755ebc82864dc3a3193b1ba3870613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:41.199235 21813 catalog_manager.cc:5719] T 29268e7314114f5c87a36479ed0dd60e P 65755ebc82864dc3a3193b1ba3870613 reported cstate change: term changed from 0 to 1, leader changed from <none> to 65755ebc82864dc3a3193b1ba3870613 (127.21.64.195). New cstate: current_term: 1 leader_uuid: "65755ebc82864dc3a3193b1ba3870613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } health_report { overall_health: HEALTHY } } }
I20260810 01:55:41.588323 23213 consensus_queue.cc:1048] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P 5c71783cbed64297b17353312fcd4bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:41.596452 23213 consensus_queue.cc:1048] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P 5c71783cbed64297b17353312fcd4bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:41.601434 23212 consensus_queue.cc:1048] T 29268e7314114f5c87a36479ed0dd60e P 65755ebc82864dc3a3193b1ba3870613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:41.615916 23241 consensus_queue.cc:1048] T 29268e7314114f5c87a36479ed0dd60e P 65755ebc82864dc3a3193b1ba3870613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:41.671659 22391 raft_consensus.cc:3060] T 50e87df99e0947a294ea41b1fd5f71c1 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Advancing to term 1
W20260810 01:55:41.673709 23360 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:55:41.674230 23360 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260810 01:55:41.676240 23107 consensus_queue.cc:1048] T 50e87df99e0947a294ea41b1fd5f71c1 P c5ca831c32e4452dba1cfc6cd296e532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:41.686836 23381 consensus_queue.cc:1048] T 50e87df99e0947a294ea41b1fd5f71c1 P c5ca831c32e4452dba1cfc6cd296e532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
Using table 'rebalance_test_table_2'
INSERT report
rows total: 2000
time total: 337.47 ms
time per row: 0.168735 ms
I20260810 01:55:42.224486 21824 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60594:
name: "rebalance_test_table_3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260810 01:55:42.235239 22178 tablet_service.cc:1511] Processing CreateTablet for tablet 722c63fbaec0458f919e69376eb06f68 (DEFAULT_TABLE table=rebalance_test_table_3 [id=d47cd31158ac461da3cf5a5d0ec30957]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:42.235821 22178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 722c63fbaec0458f919e69376eb06f68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:42.236408 22922 tablet_service.cc:1511] Processing CreateTablet for tablet 722c63fbaec0458f919e69376eb06f68 (DEFAULT_TABLE table=rebalance_test_table_3 [id=d47cd31158ac461da3cf5a5d0ec30957]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:42.236845 22922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 722c63fbaec0458f919e69376eb06f68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:42.237365 22181 tablet_service.cc:1511] Processing CreateTablet for tablet 46544528d07a4f4683baee8a22eca388 (DEFAULT_TABLE table=rebalance_test_table_3 [id=d47cd31158ac461da3cf5a5d0ec30957]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:42.237789 22181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46544528d07a4f4683baee8a22eca388. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:42.237804 22559 tablet_service.cc:1511] Processing CreateTablet for tablet 722c63fbaec0458f919e69376eb06f68 (DEFAULT_TABLE table=rebalance_test_table_3 [id=d47cd31158ac461da3cf5a5d0ec30957]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:42.238224 22559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 722c63fbaec0458f919e69376eb06f68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:42.241825 22558 tablet_service.cc:1511] Processing CreateTablet for tablet 46544528d07a4f4683baee8a22eca388 (DEFAULT_TABLE table=rebalance_test_table_3 [id=d47cd31158ac461da3cf5a5d0ec30957]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:42.242321 22558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46544528d07a4f4683baee8a22eca388. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:42.245250 22921 tablet_service.cc:1511] Processing CreateTablet for tablet 46544528d07a4f4683baee8a22eca388 (DEFAULT_TABLE table=rebalance_test_table_3 [id=d47cd31158ac461da3cf5a5d0ec30957]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:42.245647 22921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46544528d07a4f4683baee8a22eca388. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:42.247740 23458 tablet_bootstrap.cc:492] T 722c63fbaec0458f919e69376eb06f68 P fabe62238d32404097129ae02ed3b0b3: Bootstrap starting.
I20260810 01:55:42.252075 23458 tablet_bootstrap.cc:654] T 722c63fbaec0458f919e69376eb06f68 P fabe62238d32404097129ae02ed3b0b3: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:42.254419 22739 tablet_service.cc:1511] Processing CreateTablet for tablet 028bbde650444c5ba3e54c4cdab941db (DEFAULT_TABLE table=rebalance_test_table_3 [id=d47cd31158ac461da3cf5a5d0ec30957]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:42.254863 22739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 028bbde650444c5ba3e54c4cdab941db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:42.263597 22363 tablet_service.cc:1511] Processing CreateTablet for tablet 028bbde650444c5ba3e54c4cdab941db (DEFAULT_TABLE table=rebalance_test_table_3 [id=d47cd31158ac461da3cf5a5d0ec30957]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:42.264091 22363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 028bbde650444c5ba3e54c4cdab941db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:42.264326 21994 tablet_service.cc:1511] Processing CreateTablet for tablet 028bbde650444c5ba3e54c4cdab941db (DEFAULT_TABLE table=rebalance_test_table_3 [id=d47cd31158ac461da3cf5a5d0ec30957]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:42.264974 21994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 028bbde650444c5ba3e54c4cdab941db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:42.269903 23457 tablet_bootstrap.cc:492] T 722c63fbaec0458f919e69376eb06f68 P 78c107f9dfbc4d3483895dda0f791bb2: Bootstrap starting.
I20260810 01:55:42.271420 23458 tablet_bootstrap.cc:492] T 722c63fbaec0458f919e69376eb06f68 P fabe62238d32404097129ae02ed3b0b3: No bootstrap required, opened a new log
I20260810 01:55:42.271663 23458 ts_tablet_manager.cc:1403] T 722c63fbaec0458f919e69376eb06f68 P fabe62238d32404097129ae02ed3b0b3: Time spent bootstrapping tablet: real 0.024s user 0.006s sys 0.000s
I20260810 01:55:42.272787 23458 raft_consensus.cc:359] T 722c63fbaec0458f919e69376eb06f68 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:42.273053 23458 raft_consensus.cc:385] T 722c63fbaec0458f919e69376eb06f68 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:42.273181 23458 raft_consensus.cc:740] T 722c63fbaec0458f919e69376eb06f68 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabe62238d32404097129ae02ed3b0b3, State: Initialized, Role: FOLLOWER
I20260810 01:55:42.273267 23457 tablet_bootstrap.cc:654] T 722c63fbaec0458f919e69376eb06f68 P 78c107f9dfbc4d3483895dda0f791bb2: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:42.273692 23458 consensus_queue.cc:260] T 722c63fbaec0458f919e69376eb06f68 P fabe62238d32404097129ae02ed3b0b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:42.274381 23458 ts_tablet_manager.cc:1434] T 722c63fbaec0458f919e69376eb06f68 P fabe62238d32404097129ae02ed3b0b3: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 01:55:42.274775 23458 tablet_bootstrap.cc:492] T 46544528d07a4f4683baee8a22eca388 P fabe62238d32404097129ae02ed3b0b3: Bootstrap starting.
I20260810 01:55:42.276355 23462 tablet_bootstrap.cc:492] T 028bbde650444c5ba3e54c4cdab941db P 65755ebc82864dc3a3193b1ba3870613: Bootstrap starting.
I20260810 01:55:42.278471 23458 tablet_bootstrap.cc:654] T 46544528d07a4f4683baee8a22eca388 P fabe62238d32404097129ae02ed3b0b3: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:42.278903 23462 tablet_bootstrap.cc:654] T 028bbde650444c5ba3e54c4cdab941db P 65755ebc82864dc3a3193b1ba3870613: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:42.287220 23461 tablet_bootstrap.cc:492] T 028bbde650444c5ba3e54c4cdab941db P 687f288b7e9d4650a758d5451483e49b: Bootstrap starting.
I20260810 01:55:42.287952 23470 tablet_bootstrap.cc:492] T 028bbde650444c5ba3e54c4cdab941db P c5ca831c32e4452dba1cfc6cd296e532: Bootstrap starting.
I20260810 01:55:42.288019 23462 tablet_bootstrap.cc:492] T 028bbde650444c5ba3e54c4cdab941db P 65755ebc82864dc3a3193b1ba3870613: No bootstrap required, opened a new log
I20260810 01:55:42.288298 23462 ts_tablet_manager.cc:1403] T 028bbde650444c5ba3e54c4cdab941db P 65755ebc82864dc3a3193b1ba3870613: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.004s
I20260810 01:55:42.289520 23462 raft_consensus.cc:359] T 028bbde650444c5ba3e54c4cdab941db P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:42.289845 23462 raft_consensus.cc:385] T 028bbde650444c5ba3e54c4cdab941db P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:42.289975 23462 raft_consensus.cc:740] T 028bbde650444c5ba3e54c4cdab941db P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65755ebc82864dc3a3193b1ba3870613, State: Initialized, Role: FOLLOWER
I20260810 01:55:42.290293 23462 consensus_queue.cc:260] T 028bbde650444c5ba3e54c4cdab941db P 65755ebc82864dc3a3193b1ba3870613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:42.291673 23462 ts_tablet_manager.cc:1434] T 028bbde650444c5ba3e54c4cdab941db P 65755ebc82864dc3a3193b1ba3870613: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 01:55:42.293506 23458 tablet_bootstrap.cc:492] T 46544528d07a4f4683baee8a22eca388 P fabe62238d32404097129ae02ed3b0b3: No bootstrap required, opened a new log
I20260810 01:55:42.293743 23458 ts_tablet_manager.cc:1403] T 46544528d07a4f4683baee8a22eca388 P fabe62238d32404097129ae02ed3b0b3: Time spent bootstrapping tablet: real 0.019s user 0.008s sys 0.000s
I20260810 01:55:42.294618 23459 tablet_bootstrap.cc:492] T 46544528d07a4f4683baee8a22eca388 P 5c71783cbed64297b17353312fcd4bb0: Bootstrap starting.
I20260810 01:55:42.295449 23458 raft_consensus.cc:359] T 46544528d07a4f4683baee8a22eca388 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:42.295753 23458 raft_consensus.cc:385] T 46544528d07a4f4683baee8a22eca388 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:42.295863 23458 raft_consensus.cc:740] T 46544528d07a4f4683baee8a22eca388 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabe62238d32404097129ae02ed3b0b3, State: Initialized, Role: FOLLOWER
I20260810 01:55:42.296169 23458 consensus_queue.cc:260] T 46544528d07a4f4683baee8a22eca388 P fabe62238d32404097129ae02ed3b0b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:42.296744 23458 ts_tablet_manager.cc:1434] T 46544528d07a4f4683baee8a22eca388 P fabe62238d32404097129ae02ed3b0b3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:55:42.298249 23461 tablet_bootstrap.cc:654] T 028bbde650444c5ba3e54c4cdab941db P 687f288b7e9d4650a758d5451483e49b: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:42.298264 23459 tablet_bootstrap.cc:654] T 46544528d07a4f4683baee8a22eca388 P 5c71783cbed64297b17353312fcd4bb0: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:42.300222 23470 tablet_bootstrap.cc:654] T 028bbde650444c5ba3e54c4cdab941db P c5ca831c32e4452dba1cfc6cd296e532: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:42.303438 23457 tablet_bootstrap.cc:492] T 722c63fbaec0458f919e69376eb06f68 P 78c107f9dfbc4d3483895dda0f791bb2: No bootstrap required, opened a new log
I20260810 01:55:42.303679 23457 ts_tablet_manager.cc:1403] T 722c63fbaec0458f919e69376eb06f68 P 78c107f9dfbc4d3483895dda0f791bb2: Time spent bootstrapping tablet: real 0.034s user 0.011s sys 0.011s
I20260810 01:55:42.303707 23470 tablet_bootstrap.cc:492] T 028bbde650444c5ba3e54c4cdab941db P c5ca831c32e4452dba1cfc6cd296e532: No bootstrap required, opened a new log
I20260810 01:55:42.303851 23470 ts_tablet_manager.cc:1403] T 028bbde650444c5ba3e54c4cdab941db P c5ca831c32e4452dba1cfc6cd296e532: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.000s
I20260810 01:55:42.303867 23461 tablet_bootstrap.cc:492] T 028bbde650444c5ba3e54c4cdab941db P 687f288b7e9d4650a758d5451483e49b: No bootstrap required, opened a new log
I20260810 01:55:42.304013 23461 ts_tablet_manager.cc:1403] T 028bbde650444c5ba3e54c4cdab941db P 687f288b7e9d4650a758d5451483e49b: Time spent bootstrapping tablet: real 0.017s user 0.007s sys 0.000s
I20260810 01:55:42.304363 23459 tablet_bootstrap.cc:492] T 46544528d07a4f4683baee8a22eca388 P 5c71783cbed64297b17353312fcd4bb0: No bootstrap required, opened a new log
I20260810 01:55:42.304567 23459 ts_tablet_manager.cc:1403] T 46544528d07a4f4683baee8a22eca388 P 5c71783cbed64297b17353312fcd4bb0: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.004s
I20260810 01:55:42.304774 23470 raft_consensus.cc:359] T 028bbde650444c5ba3e54c4cdab941db P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:42.304797 23457 raft_consensus.cc:359] T 722c63fbaec0458f919e69376eb06f68 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:42.304840 23461 raft_consensus.cc:359] T 028bbde650444c5ba3e54c4cdab941db P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:42.305028 23461 raft_consensus.cc:385] T 028bbde650444c5ba3e54c4cdab941db P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:42.305050 23470 raft_consensus.cc:385] T 028bbde650444c5ba3e54c4cdab941db P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:42.305079 23457 raft_consensus.cc:385] T 722c63fbaec0458f919e69376eb06f68 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:42.305161 23470 raft_consensus.cc:740] T 028bbde650444c5ba3e54c4cdab941db P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ca831c32e4452dba1cfc6cd296e532, State: Initialized, Role: FOLLOWER
I20260810 01:55:42.305172 23461 raft_consensus.cc:740] T 028bbde650444c5ba3e54c4cdab941db P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687f288b7e9d4650a758d5451483e49b, State: Initialized, Role: FOLLOWER
I20260810 01:55:42.305289 23457 raft_consensus.cc:740] T 722c63fbaec0458f919e69376eb06f68 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78c107f9dfbc4d3483895dda0f791bb2, State: Initialized, Role: FOLLOWER
I20260810 01:55:42.305481 23461 consensus_queue.cc:260] T 028bbde650444c5ba3e54c4cdab941db P 687f288b7e9d4650a758d5451483e49b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:42.305493 23470 consensus_queue.cc:260] T 028bbde650444c5ba3e54c4cdab941db P c5ca831c32e4452dba1cfc6cd296e532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:42.305577 23459 raft_consensus.cc:359] T 46544528d07a4f4683baee8a22eca388 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:42.305985 23459 raft_consensus.cc:385] T 46544528d07a4f4683baee8a22eca388 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:42.306056 23470 ts_tablet_manager.cc:1434] T 028bbde650444c5ba3e54c4cdab941db P c5ca831c32e4452dba1cfc6cd296e532: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260810 01:55:42.306126 23459 raft_consensus.cc:740] T 46544528d07a4f4683baee8a22eca388 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c71783cbed64297b17353312fcd4bb0, State: Initialized, Role: FOLLOWER
I20260810 01:55:42.306389 23459 consensus_queue.cc:260] T 46544528d07a4f4683baee8a22eca388 P 5c71783cbed64297b17353312fcd4bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:42.306785 23461 ts_tablet_manager.cc:1434] T 028bbde650444c5ba3e54c4cdab941db P 687f288b7e9d4650a758d5451483e49b: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260810 01:55:42.307791 23459 ts_tablet_manager.cc:1434] T 46544528d07a4f4683baee8a22eca388 P 5c71783cbed64297b17353312fcd4bb0: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 01:55:42.305691 23457 consensus_queue.cc:260] T 722c63fbaec0458f919e69376eb06f68 P 78c107f9dfbc4d3483895dda0f791bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:42.308179 23459 tablet_bootstrap.cc:492] T 722c63fbaec0458f919e69376eb06f68 P 5c71783cbed64297b17353312fcd4bb0: Bootstrap starting.
I20260810 01:55:42.311033 23459 tablet_bootstrap.cc:654] T 722c63fbaec0458f919e69376eb06f68 P 5c71783cbed64297b17353312fcd4bb0: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:42.312291 23457 ts_tablet_manager.cc:1434] T 722c63fbaec0458f919e69376eb06f68 P 78c107f9dfbc4d3483895dda0f791bb2: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260810 01:55:42.313112 23457 tablet_bootstrap.cc:492] T 46544528d07a4f4683baee8a22eca388 P 78c107f9dfbc4d3483895dda0f791bb2: Bootstrap starting.
I20260810 01:55:42.315896 23457 tablet_bootstrap.cc:654] T 46544528d07a4f4683baee8a22eca388 P 78c107f9dfbc4d3483895dda0f791bb2: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:42.318306 23457 tablet_bootstrap.cc:492] T 46544528d07a4f4683baee8a22eca388 P 78c107f9dfbc4d3483895dda0f791bb2: No bootstrap required, opened a new log
I20260810 01:55:42.318473 23459 tablet_bootstrap.cc:492] T 722c63fbaec0458f919e69376eb06f68 P 5c71783cbed64297b17353312fcd4bb0: No bootstrap required, opened a new log
I20260810 01:55:42.318531 23457 ts_tablet_manager.cc:1403] T 46544528d07a4f4683baee8a22eca388 P 78c107f9dfbc4d3483895dda0f791bb2: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260810 01:55:42.318681 23459 ts_tablet_manager.cc:1403] T 722c63fbaec0458f919e69376eb06f68 P 5c71783cbed64297b17353312fcd4bb0: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.007s
I20260810 01:55:42.319231 23457 raft_consensus.cc:359] T 46544528d07a4f4683baee8a22eca388 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:42.319275 23459 raft_consensus.cc:359] T 722c63fbaec0458f919e69376eb06f68 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:42.319375 23457 raft_consensus.cc:385] T 46544528d07a4f4683baee8a22eca388 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:42.319422 23457 raft_consensus.cc:740] T 46544528d07a4f4683baee8a22eca388 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78c107f9dfbc4d3483895dda0f791bb2, State: Initialized, Role: FOLLOWER
I20260810 01:55:42.319432 23459 raft_consensus.cc:385] T 722c63fbaec0458f919e69376eb06f68 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:42.319494 23459 raft_consensus.cc:740] T 722c63fbaec0458f919e69376eb06f68 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c71783cbed64297b17353312fcd4bb0, State: Initialized, Role: FOLLOWER
I20260810 01:55:42.319664 23457 consensus_queue.cc:260] T 46544528d07a4f4683baee8a22eca388 P 78c107f9dfbc4d3483895dda0f791bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:42.319818 23459 consensus_queue.cc:260] T 722c63fbaec0458f919e69376eb06f68 P 5c71783cbed64297b17353312fcd4bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:42.320209 23457 ts_tablet_manager.cc:1434] T 46544528d07a4f4683baee8a22eca388 P 78c107f9dfbc4d3483895dda0f791bb2: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 01:55:42.320781 23459 ts_tablet_manager.cc:1434] T 722c63fbaec0458f919e69376eb06f68 P 5c71783cbed64297b17353312fcd4bb0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:55:42.326467 23241 raft_consensus.cc:493] T 028bbde650444c5ba3e54c4cdab941db P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:55:42.326722 23241 raft_consensus.cc:515] T 028bbde650444c5ba3e54c4cdab941db P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:42.327474 23241 leader_election.cc:290] T 028bbde650444c5ba3e54c4cdab941db P 65755ebc82864dc3a3193b1ba3870613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687f288b7e9d4650a758d5451483e49b (127.21.64.197:37655), c5ca831c32e4452dba1cfc6cd296e532 (127.21.64.193:39917)
I20260810 01:55:42.328050 22770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028bbde650444c5ba3e54c4cdab941db" candidate_uuid: "65755ebc82864dc3a3193b1ba3870613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687f288b7e9d4650a758d5451483e49b" is_pre_election: true
I20260810 01:55:42.328034 22026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028bbde650444c5ba3e54c4cdab941db" candidate_uuid: "65755ebc82864dc3a3193b1ba3870613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ca831c32e4452dba1cfc6cd296e532" is_pre_election: true
I20260810 01:55:42.328279 22770 raft_consensus.cc:2468] T 028bbde650444c5ba3e54c4cdab941db P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65755ebc82864dc3a3193b1ba3870613 in term 0.
I20260810 01:55:42.328301 22026 raft_consensus.cc:2468] T 028bbde650444c5ba3e54c4cdab941db P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65755ebc82864dc3a3193b1ba3870613 in term 0.
I20260810 01:55:42.328826 22297 leader_election.cc:304] T 028bbde650444c5ba3e54c4cdab941db P 65755ebc82864dc3a3193b1ba3870613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 65755ebc82864dc3a3193b1ba3870613, 687f288b7e9d4650a758d5451483e49b, c5ca831c32e4452dba1cfc6cd296e532; no voters:
I20260810 01:55:42.329267 23241 raft_consensus.cc:2804] T 028bbde650444c5ba3e54c4cdab941db P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:55:42.329394 23241 raft_consensus.cc:493] T 028bbde650444c5ba3e54c4cdab941db P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:55:42.329495 23241 raft_consensus.cc:3060] T 028bbde650444c5ba3e54c4cdab941db P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:42.331418 23241 raft_consensus.cc:515] T 028bbde650444c5ba3e54c4cdab941db P 65755ebc82864dc3a3193b1ba3870613 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:42.332064 23241 leader_election.cc:290] T 028bbde650444c5ba3e54c4cdab941db P 65755ebc82864dc3a3193b1ba3870613 [CANDIDATE]: Term 1 election: Requested vote from peers 687f288b7e9d4650a758d5451483e49b (127.21.64.197:37655), c5ca831c32e4452dba1cfc6cd296e532 (127.21.64.193:39917)
I20260810 01:55:42.332428 22770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028bbde650444c5ba3e54c4cdab941db" candidate_uuid: "65755ebc82864dc3a3193b1ba3870613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687f288b7e9d4650a758d5451483e49b"
I20260810 01:55:42.332590 22026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028bbde650444c5ba3e54c4cdab941db" candidate_uuid: "65755ebc82864dc3a3193b1ba3870613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ca831c32e4452dba1cfc6cd296e532"
I20260810 01:55:42.332634 22770 raft_consensus.cc:3060] T 028bbde650444c5ba3e54c4cdab941db P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:42.332814 22026 raft_consensus.cc:3060] T 028bbde650444c5ba3e54c4cdab941db P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:42.335954 22770 raft_consensus.cc:2468] T 028bbde650444c5ba3e54c4cdab941db P 687f288b7e9d4650a758d5451483e49b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65755ebc82864dc3a3193b1ba3870613 in term 1.
I20260810 01:55:42.335940 22026 raft_consensus.cc:2468] T 028bbde650444c5ba3e54c4cdab941db P c5ca831c32e4452dba1cfc6cd296e532 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65755ebc82864dc3a3193b1ba3870613 in term 1.
I20260810 01:55:42.336397 22294 leader_election.cc:304] T 028bbde650444c5ba3e54c4cdab941db P 65755ebc82864dc3a3193b1ba3870613 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65755ebc82864dc3a3193b1ba3870613, 687f288b7e9d4650a758d5451483e49b; no voters:
I20260810 01:55:42.336716 23241 raft_consensus.cc:2804] T 028bbde650444c5ba3e54c4cdab941db P 65755ebc82864dc3a3193b1ba3870613 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:55:42.336894 23241 raft_consensus.cc:697] T 028bbde650444c5ba3e54c4cdab941db P 65755ebc82864dc3a3193b1ba3870613 [term 1 LEADER]: Becoming Leader. State: Replica: 65755ebc82864dc3a3193b1ba3870613, State: Running, Role: LEADER
I20260810 01:55:42.337199 23241 consensus_queue.cc:237] T 028bbde650444c5ba3e54c4cdab941db P 65755ebc82864dc3a3193b1ba3870613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:42.339988 21813 catalog_manager.cc:5719] T 028bbde650444c5ba3e54c4cdab941db P 65755ebc82864dc3a3193b1ba3870613 reported cstate change: term changed from 0 to 1, leader changed from <none> to 65755ebc82864dc3a3193b1ba3870613 (127.21.64.195). New cstate: current_term: 1 leader_uuid: "65755ebc82864dc3a3193b1ba3870613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } health_report { overall_health: UNKNOWN } } }
I20260810 01:55:42.358342 23079 raft_consensus.cc:493] T 46544528d07a4f4683baee8a22eca388 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:55:42.358538 23079 raft_consensus.cc:515] T 46544528d07a4f4683baee8a22eca388 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:42.359226 23079 leader_election.cc:290] T 46544528d07a4f4683baee8a22eca388 P 78c107f9dfbc4d3483895dda0f791bb2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c71783cbed64297b17353312fcd4bb0 (127.21.64.198:33973), fabe62238d32404097129ae02ed3b0b3 (127.21.64.196:32931)
I20260810 01:55:42.359881 22952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46544528d07a4f4683baee8a22eca388" candidate_uuid: "78c107f9dfbc4d3483895dda0f791bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c71783cbed64297b17353312fcd4bb0" is_pre_election: true
I20260810 01:55:42.360206 22952 raft_consensus.cc:2468] T 46544528d07a4f4683baee8a22eca388 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78c107f9dfbc4d3483895dda0f791bb2 in term 0.
I20260810 01:55:42.360809 22116 leader_election.cc:304] T 46544528d07a4f4683baee8a22eca388 P 78c107f9dfbc4d3483895dda0f791bb2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c71783cbed64297b17353312fcd4bb0, 78c107f9dfbc4d3483895dda0f791bb2; no voters:
I20260810 01:55:42.361186 23079 raft_consensus.cc:2804] T 46544528d07a4f4683baee8a22eca388 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:55:42.361330 23079 raft_consensus.cc:493] T 46544528d07a4f4683baee8a22eca388 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:55:42.361498 23079 raft_consensus.cc:3060] T 46544528d07a4f4683baee8a22eca388 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:42.364099 23079 raft_consensus.cc:515] T 46544528d07a4f4683baee8a22eca388 P 78c107f9dfbc4d3483895dda0f791bb2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:42.364820 23079 leader_election.cc:290] T 46544528d07a4f4683baee8a22eca388 P 78c107f9dfbc4d3483895dda0f791bb2 [CANDIDATE]: Term 1 election: Requested vote from peers 5c71783cbed64297b17353312fcd4bb0 (127.21.64.198:33973), fabe62238d32404097129ae02ed3b0b3 (127.21.64.196:32931)
I20260810 01:55:42.365317 22952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46544528d07a4f4683baee8a22eca388" candidate_uuid: "78c107f9dfbc4d3483895dda0f791bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c71783cbed64297b17353312fcd4bb0"
I20260810 01:55:42.365583 22952 raft_consensus.cc:3060] T 46544528d07a4f4683baee8a22eca388 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:42.367626 22587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46544528d07a4f4683baee8a22eca388" candidate_uuid: "78c107f9dfbc4d3483895dda0f791bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabe62238d32404097129ae02ed3b0b3" is_pre_election: true
I20260810 01:55:42.367755 22588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46544528d07a4f4683baee8a22eca388" candidate_uuid: "78c107f9dfbc4d3483895dda0f791bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabe62238d32404097129ae02ed3b0b3"
I20260810 01:55:42.367894 22587 raft_consensus.cc:2468] T 46544528d07a4f4683baee8a22eca388 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78c107f9dfbc4d3483895dda0f791bb2 in term 0.
I20260810 01:55:42.368127 22952 raft_consensus.cc:2468] T 46544528d07a4f4683baee8a22eca388 P 5c71783cbed64297b17353312fcd4bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78c107f9dfbc4d3483895dda0f791bb2 in term 1.
I20260810 01:55:42.368564 22116 leader_election.cc:304] T 46544528d07a4f4683baee8a22eca388 P 78c107f9dfbc4d3483895dda0f791bb2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c71783cbed64297b17353312fcd4bb0, 78c107f9dfbc4d3483895dda0f791bb2; no voters: fabe62238d32404097129ae02ed3b0b3
I20260810 01:55:42.368852 23079 raft_consensus.cc:2804] T 46544528d07a4f4683baee8a22eca388 P 78c107f9dfbc4d3483895dda0f791bb2 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:55:42.369294 23079 raft_consensus.cc:697] T 46544528d07a4f4683baee8a22eca388 P 78c107f9dfbc4d3483895dda0f791bb2 [term 1 LEADER]: Becoming Leader. State: Replica: 78c107f9dfbc4d3483895dda0f791bb2, State: Running, Role: LEADER
I20260810 01:55:42.369707 23079 consensus_queue.cc:237] T 46544528d07a4f4683baee8a22eca388 P 78c107f9dfbc4d3483895dda0f791bb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:42.372603 21813 catalog_manager.cc:5719] T 46544528d07a4f4683baee8a22eca388 P 78c107f9dfbc4d3483895dda0f791bb2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194). New cstate: current_term: 1 leader_uuid: "78c107f9dfbc4d3483895dda0f791bb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } health_report { overall_health: UNKNOWN } } }
I20260810 01:55:42.372769 23362 raft_consensus.cc:493] T 722c63fbaec0458f919e69376eb06f68 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:55:42.372923 23362 raft_consensus.cc:515] T 722c63fbaec0458f919e69376eb06f68 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:42.373697 23362 leader_election.cc:290] T 722c63fbaec0458f919e69376eb06f68 P 5c71783cbed64297b17353312fcd4bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194:33547), fabe62238d32404097129ae02ed3b0b3 (127.21.64.196:32931)
I20260810 01:55:42.374007 22209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722c63fbaec0458f919e69376eb06f68" candidate_uuid: "5c71783cbed64297b17353312fcd4bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78c107f9dfbc4d3483895dda0f791bb2" is_pre_election: true
I20260810 01:55:42.374231 22209 raft_consensus.cc:2468] T 722c63fbaec0458f919e69376eb06f68 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c71783cbed64297b17353312fcd4bb0 in term 0.
I20260810 01:55:42.374379 22587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722c63fbaec0458f919e69376eb06f68" candidate_uuid: "5c71783cbed64297b17353312fcd4bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabe62238d32404097129ae02ed3b0b3" is_pre_election: true
I20260810 01:55:42.374648 22587 raft_consensus.cc:2468] T 722c63fbaec0458f919e69376eb06f68 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c71783cbed64297b17353312fcd4bb0 in term 0.
I20260810 01:55:42.374774 22861 leader_election.cc:304] T 722c63fbaec0458f919e69376eb06f68 P 5c71783cbed64297b17353312fcd4bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c71783cbed64297b17353312fcd4bb0, 78c107f9dfbc4d3483895dda0f791bb2; no voters:
I20260810 01:55:42.375255 23362 raft_consensus.cc:2804] T 722c63fbaec0458f919e69376eb06f68 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:55:42.375384 23362 raft_consensus.cc:493] T 722c63fbaec0458f919e69376eb06f68 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:55:42.375478 23362 raft_consensus.cc:3060] T 722c63fbaec0458f919e69376eb06f68 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:42.377772 23362 raft_consensus.cc:515] T 722c63fbaec0458f919e69376eb06f68 P 5c71783cbed64297b17353312fcd4bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:42.378358 23362 leader_election.cc:290] T 722c63fbaec0458f919e69376eb06f68 P 5c71783cbed64297b17353312fcd4bb0 [CANDIDATE]: Term 1 election: Requested vote from peers 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194:33547), fabe62238d32404097129ae02ed3b0b3 (127.21.64.196:32931)
I20260810 01:55:42.378715 22209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722c63fbaec0458f919e69376eb06f68" candidate_uuid: "5c71783cbed64297b17353312fcd4bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78c107f9dfbc4d3483895dda0f791bb2"
I20260810 01:55:42.378859 22587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722c63fbaec0458f919e69376eb06f68" candidate_uuid: "5c71783cbed64297b17353312fcd4bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabe62238d32404097129ae02ed3b0b3"
I20260810 01:55:42.378921 22209 raft_consensus.cc:3060] T 722c63fbaec0458f919e69376eb06f68 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:42.379079 22587 raft_consensus.cc:3060] T 722c63fbaec0458f919e69376eb06f68 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:42.380968 22209 raft_consensus.cc:2468] T 722c63fbaec0458f919e69376eb06f68 P 78c107f9dfbc4d3483895dda0f791bb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c71783cbed64297b17353312fcd4bb0 in term 1.
I20260810 01:55:42.381285 22587 raft_consensus.cc:2468] T 722c63fbaec0458f919e69376eb06f68 P fabe62238d32404097129ae02ed3b0b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c71783cbed64297b17353312fcd4bb0 in term 1.
I20260810 01:55:42.381426 22861 leader_election.cc:304] T 722c63fbaec0458f919e69376eb06f68 P 5c71783cbed64297b17353312fcd4bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c71783cbed64297b17353312fcd4bb0, 78c107f9dfbc4d3483895dda0f791bb2; no voters:
I20260810 01:55:42.381736 23362 raft_consensus.cc:2804] T 722c63fbaec0458f919e69376eb06f68 P 5c71783cbed64297b17353312fcd4bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:55:42.381899 23362 raft_consensus.cc:697] T 722c63fbaec0458f919e69376eb06f68 P 5c71783cbed64297b17353312fcd4bb0 [term 1 LEADER]: Becoming Leader. State: Replica: 5c71783cbed64297b17353312fcd4bb0, State: Running, Role: LEADER
I20260810 01:55:42.382205 23362 consensus_queue.cc:237] T 722c63fbaec0458f919e69376eb06f68 P 5c71783cbed64297b17353312fcd4bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:42.384948 21813 catalog_manager.cc:5719] T 722c63fbaec0458f919e69376eb06f68 P 5c71783cbed64297b17353312fcd4bb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c71783cbed64297b17353312fcd4bb0 (127.21.64.198). New cstate: current_term: 1 leader_uuid: "5c71783cbed64297b17353312fcd4bb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } health_report { overall_health: HEALTHY } } }
W20260810 01:55:42.800246 23485 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:55:42.800832 23485 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260810 01:55:42.802165 23212 consensus_queue.cc:1048] T 028bbde650444c5ba3e54c4cdab941db P 65755ebc82864dc3a3193b1ba3870613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:42.812460 23241 consensus_queue.cc:1048] T 028bbde650444c5ba3e54c4cdab941db P 65755ebc82864dc3a3193b1ba3870613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:42.817497 23362 consensus_queue.cc:1048] T 722c63fbaec0458f919e69376eb06f68 P 5c71783cbed64297b17353312fcd4bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:42.832178 23500 consensus_queue.cc:1048] T 722c63fbaec0458f919e69376eb06f68 P 5c71783cbed64297b17353312fcd4bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
Using table 'rebalance_test_table_3'
I20260810 01:55:42.939354 23079 consensus_queue.cc:1048] T 46544528d07a4f4683baee8a22eca388 P 78c107f9dfbc4d3483895dda0f791bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:42.940821 22587 raft_consensus.cc:3060] T 46544528d07a4f4683baee8a22eca388 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:42.950255 23079 consensus_queue.cc:1048] T 46544528d07a4f4683baee8a22eca388 P 78c107f9dfbc4d3483895dda0f791bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 405.178 ms
time per row: 0.202589 ms
I20260810 01:55:43.429685 21824 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60594:
name: "rebalance_test_table_4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260810 01:55:43.440173 22739 tablet_service.cc:1511] Processing CreateTablet for tablet 8a439c266a594bce8c0b5f22c571dbc2 (DEFAULT_TABLE table=rebalance_test_table_4 [id=2c496055aec549a195c4c931474913af]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:43.440457 22363 tablet_service.cc:1511] Processing CreateTablet for tablet 8a439c266a594bce8c0b5f22c571dbc2 (DEFAULT_TABLE table=rebalance_test_table_4 [id=2c496055aec549a195c4c931474913af]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:43.440776 22739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a439c266a594bce8c0b5f22c571dbc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:43.440944 22363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a439c266a594bce8c0b5f22c571dbc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:43.441684 22178 tablet_service.cc:1511] Processing CreateTablet for tablet 20c224643c524dd4b94febd93fd28584 (DEFAULT_TABLE table=rebalance_test_table_4 [id=2c496055aec549a195c4c931474913af]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:43.441824 21994 tablet_service.cc:1511] Processing CreateTablet for tablet 8a439c266a594bce8c0b5f22c571dbc2 (DEFAULT_TABLE table=rebalance_test_table_4 [id=2c496055aec549a195c4c931474913af]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:43.442157 22178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20c224643c524dd4b94febd93fd28584. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:43.442250 21994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a439c266a594bce8c0b5f22c571dbc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:43.444384 22921 tablet_service.cc:1511] Processing CreateTablet for tablet 20c224643c524dd4b94febd93fd28584 (DEFAULT_TABLE table=rebalance_test_table_4 [id=2c496055aec549a195c4c931474913af]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:43.445016 22921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20c224643c524dd4b94febd93fd28584. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:43.449330 23586 tablet_bootstrap.cc:492] T 8a439c266a594bce8c0b5f22c571dbc2 P c5ca831c32e4452dba1cfc6cd296e532: Bootstrap starting.
I20260810 01:55:43.449692 22364 tablet_service.cc:1511] Processing CreateTablet for tablet 36b269b1f6694a1c9c741dd5dab037b9 (DEFAULT_TABLE table=rebalance_test_table_4 [id=2c496055aec549a195c4c931474913af]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:43.450093 22364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36b269b1f6694a1c9c741dd5dab037b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:43.450179 22740 tablet_service.cc:1511] Processing CreateTablet for tablet 36b269b1f6694a1c9c741dd5dab037b9 (DEFAULT_TABLE table=rebalance_test_table_4 [id=2c496055aec549a195c4c931474913af]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:43.450562 22740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36b269b1f6694a1c9c741dd5dab037b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:43.451947 21995 tablet_service.cc:1511] Processing CreateTablet for tablet 36b269b1f6694a1c9c741dd5dab037b9 (DEFAULT_TABLE table=rebalance_test_table_4 [id=2c496055aec549a195c4c931474913af]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:43.452602 21995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36b269b1f6694a1c9c741dd5dab037b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:43.453536 22558 tablet_service.cc:1511] Processing CreateTablet for tablet 20c224643c524dd4b94febd93fd28584 (DEFAULT_TABLE table=rebalance_test_table_4 [id=2c496055aec549a195c4c931474913af]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:43.453954 22558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20c224643c524dd4b94febd93fd28584. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:43.471992 23590 tablet_bootstrap.cc:492] T 8a439c266a594bce8c0b5f22c571dbc2 P 65755ebc82864dc3a3193b1ba3870613: Bootstrap starting.
I20260810 01:55:43.476459 23586 tablet_bootstrap.cc:654] T 8a439c266a594bce8c0b5f22c571dbc2 P c5ca831c32e4452dba1cfc6cd296e532: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:43.477157 23590 tablet_bootstrap.cc:654] T 8a439c266a594bce8c0b5f22c571dbc2 P 65755ebc82864dc3a3193b1ba3870613: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:43.477188 23589 tablet_bootstrap.cc:492] T 20c224643c524dd4b94febd93fd28584 P fabe62238d32404097129ae02ed3b0b3: Bootstrap starting.
I20260810 01:55:43.479671 23585 tablet_bootstrap.cc:492] T 8a439c266a594bce8c0b5f22c571dbc2 P 687f288b7e9d4650a758d5451483e49b: Bootstrap starting.
I20260810 01:55:43.479912 23589 tablet_bootstrap.cc:654] T 20c224643c524dd4b94febd93fd28584 P fabe62238d32404097129ae02ed3b0b3: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:43.481102 23588 tablet_bootstrap.cc:492] T 20c224643c524dd4b94febd93fd28584 P 5c71783cbed64297b17353312fcd4bb0: Bootstrap starting.
I20260810 01:55:43.483760 23585 tablet_bootstrap.cc:654] T 8a439c266a594bce8c0b5f22c571dbc2 P 687f288b7e9d4650a758d5451483e49b: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:43.484256 23586 tablet_bootstrap.cc:492] T 8a439c266a594bce8c0b5f22c571dbc2 P c5ca831c32e4452dba1cfc6cd296e532: No bootstrap required, opened a new log
I20260810 01:55:43.484541 23586 ts_tablet_manager.cc:1403] T 8a439c266a594bce8c0b5f22c571dbc2 P c5ca831c32e4452dba1cfc6cd296e532: Time spent bootstrapping tablet: real 0.035s user 0.003s sys 0.004s
I20260810 01:55:43.485327 23588 tablet_bootstrap.cc:654] T 20c224643c524dd4b94febd93fd28584 P 5c71783cbed64297b17353312fcd4bb0: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:43.485733 23586 raft_consensus.cc:359] T 8a439c266a594bce8c0b5f22c571dbc2 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:43.486119 23586 raft_consensus.cc:385] T 8a439c266a594bce8c0b5f22c571dbc2 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:43.486290 23586 raft_consensus.cc:740] T 8a439c266a594bce8c0b5f22c571dbc2 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ca831c32e4452dba1cfc6cd296e532, State: Initialized, Role: FOLLOWER
I20260810 01:55:43.486676 23586 consensus_queue.cc:260] T 8a439c266a594bce8c0b5f22c571dbc2 P c5ca831c32e4452dba1cfc6cd296e532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:43.487593 23586 ts_tablet_manager.cc:1434] T 8a439c266a594bce8c0b5f22c571dbc2 P c5ca831c32e4452dba1cfc6cd296e532: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 01:55:43.488356 23586 tablet_bootstrap.cc:492] T 36b269b1f6694a1c9c741dd5dab037b9 P c5ca831c32e4452dba1cfc6cd296e532: Bootstrap starting.
I20260810 01:55:43.490108 23590 tablet_bootstrap.cc:492] T 8a439c266a594bce8c0b5f22c571dbc2 P 65755ebc82864dc3a3193b1ba3870613: No bootstrap required, opened a new log
I20260810 01:55:43.490299 23590 ts_tablet_manager.cc:1403] T 8a439c266a594bce8c0b5f22c571dbc2 P 65755ebc82864dc3a3193b1ba3870613: Time spent bootstrapping tablet: real 0.018s user 0.008s sys 0.000s
I20260810 01:55:43.490494 23586 tablet_bootstrap.cc:654] T 36b269b1f6694a1c9c741dd5dab037b9 P c5ca831c32e4452dba1cfc6cd296e532: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:43.490717 23589 tablet_bootstrap.cc:492] T 20c224643c524dd4b94febd93fd28584 P fabe62238d32404097129ae02ed3b0b3: No bootstrap required, opened a new log
I20260810 01:55:43.490892 23589 ts_tablet_manager.cc:1403] T 20c224643c524dd4b94febd93fd28584 P fabe62238d32404097129ae02ed3b0b3: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.010s
I20260810 01:55:43.491189 23590 raft_consensus.cc:359] T 8a439c266a594bce8c0b5f22c571dbc2 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:43.491454 23590 raft_consensus.cc:385] T 8a439c266a594bce8c0b5f22c571dbc2 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:43.491595 23590 raft_consensus.cc:740] T 8a439c266a594bce8c0b5f22c571dbc2 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65755ebc82864dc3a3193b1ba3870613, State: Initialized, Role: FOLLOWER
I20260810 01:55:43.491765 23589 raft_consensus.cc:359] T 20c224643c524dd4b94febd93fd28584 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:43.491914 23590 consensus_queue.cc:260] T 8a439c266a594bce8c0b5f22c571dbc2 P 65755ebc82864dc3a3193b1ba3870613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:43.492187 23589 raft_consensus.cc:385] T 20c224643c524dd4b94febd93fd28584 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:43.492340 23589 raft_consensus.cc:740] T 20c224643c524dd4b94febd93fd28584 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabe62238d32404097129ae02ed3b0b3, State: Initialized, Role: FOLLOWER
I20260810 01:55:43.492674 23590 ts_tablet_manager.cc:1434] T 8a439c266a594bce8c0b5f22c571dbc2 P 65755ebc82864dc3a3193b1ba3870613: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:55:43.492630 23589 consensus_queue.cc:260] T 20c224643c524dd4b94febd93fd28584 P fabe62238d32404097129ae02ed3b0b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:43.493036 23590 tablet_bootstrap.cc:492] T 36b269b1f6694a1c9c741dd5dab037b9 P 65755ebc82864dc3a3193b1ba3870613: Bootstrap starting.
I20260810 01:55:43.493260 23589 ts_tablet_manager.cc:1434] T 20c224643c524dd4b94febd93fd28584 P fabe62238d32404097129ae02ed3b0b3: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 01:55:43.494897 23585 tablet_bootstrap.cc:492] T 8a439c266a594bce8c0b5f22c571dbc2 P 687f288b7e9d4650a758d5451483e49b: No bootstrap required, opened a new log
I20260810 01:55:43.495115 23585 ts_tablet_manager.cc:1403] T 8a439c266a594bce8c0b5f22c571dbc2 P 687f288b7e9d4650a758d5451483e49b: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.003s
I20260810 01:55:43.495754 23590 tablet_bootstrap.cc:654] T 36b269b1f6694a1c9c741dd5dab037b9 P 65755ebc82864dc3a3193b1ba3870613: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:43.496021 23585 raft_consensus.cc:359] T 8a439c266a594bce8c0b5f22c571dbc2 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:43.496302 23585 raft_consensus.cc:385] T 8a439c266a594bce8c0b5f22c571dbc2 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:43.496444 23585 raft_consensus.cc:740] T 8a439c266a594bce8c0b5f22c571dbc2 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687f288b7e9d4650a758d5451483e49b, State: Initialized, Role: FOLLOWER
I20260810 01:55:43.496834 23585 consensus_queue.cc:260] T 8a439c266a594bce8c0b5f22c571dbc2 P 687f288b7e9d4650a758d5451483e49b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:43.498972 23585 ts_tablet_manager.cc:1434] T 8a439c266a594bce8c0b5f22c571dbc2 P 687f288b7e9d4650a758d5451483e49b: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260810 01:55:43.499946 23585 tablet_bootstrap.cc:492] T 36b269b1f6694a1c9c741dd5dab037b9 P 687f288b7e9d4650a758d5451483e49b: Bootstrap starting.
I20260810 01:55:43.502569 23585 tablet_bootstrap.cc:654] T 36b269b1f6694a1c9c741dd5dab037b9 P 687f288b7e9d4650a758d5451483e49b: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:43.507283 23590 tablet_bootstrap.cc:492] T 36b269b1f6694a1c9c741dd5dab037b9 P 65755ebc82864dc3a3193b1ba3870613: No bootstrap required, opened a new log
I20260810 01:55:43.507530 23590 ts_tablet_manager.cc:1403] T 36b269b1f6694a1c9c741dd5dab037b9 P 65755ebc82864dc3a3193b1ba3870613: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.008s
I20260810 01:55:43.509595 23590 raft_consensus.cc:359] T 36b269b1f6694a1c9c741dd5dab037b9 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } }
I20260810 01:55:43.509994 23590 raft_consensus.cc:385] T 36b269b1f6694a1c9c741dd5dab037b9 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:43.510141 23590 raft_consensus.cc:740] T 36b269b1f6694a1c9c741dd5dab037b9 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65755ebc82864dc3a3193b1ba3870613, State: Initialized, Role: FOLLOWER
I20260810 01:55:43.510555 23587 tablet_bootstrap.cc:492] T 20c224643c524dd4b94febd93fd28584 P 78c107f9dfbc4d3483895dda0f791bb2: Bootstrap starting.
I20260810 01:55:43.510556 23590 consensus_queue.cc:260] T 36b269b1f6694a1c9c741dd5dab037b9 P 65755ebc82864dc3a3193b1ba3870613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } }
I20260810 01:55:43.513098 23585 tablet_bootstrap.cc:492] T 36b269b1f6694a1c9c741dd5dab037b9 P 687f288b7e9d4650a758d5451483e49b: No bootstrap required, opened a new log
I20260810 01:55:43.513319 23585 ts_tablet_manager.cc:1403] T 36b269b1f6694a1c9c741dd5dab037b9 P 687f288b7e9d4650a758d5451483e49b: Time spent bootstrapping tablet: real 0.013s user 0.007s sys 0.003s
I20260810 01:55:43.513999 23590 ts_tablet_manager.cc:1434] T 36b269b1f6694a1c9c741dd5dab037b9 P 65755ebc82864dc3a3193b1ba3870613: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260810 01:55:43.514297 23585 raft_consensus.cc:359] T 36b269b1f6694a1c9c741dd5dab037b9 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } }
I20260810 01:55:43.514611 23585 raft_consensus.cc:385] T 36b269b1f6694a1c9c741dd5dab037b9 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:43.514751 23585 raft_consensus.cc:740] T 36b269b1f6694a1c9c741dd5dab037b9 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687f288b7e9d4650a758d5451483e49b, State: Initialized, Role: FOLLOWER
I20260810 01:55:43.515753 23587 tablet_bootstrap.cc:654] T 20c224643c524dd4b94febd93fd28584 P 78c107f9dfbc4d3483895dda0f791bb2: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:43.516117 23585 consensus_queue.cc:260] T 36b269b1f6694a1c9c741dd5dab037b9 P 687f288b7e9d4650a758d5451483e49b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } }
I20260810 01:55:43.517166 23585 ts_tablet_manager.cc:1434] T 36b269b1f6694a1c9c741dd5dab037b9 P 687f288b7e9d4650a758d5451483e49b: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260810 01:55:43.518878 23588 tablet_bootstrap.cc:492] T 20c224643c524dd4b94febd93fd28584 P 5c71783cbed64297b17353312fcd4bb0: No bootstrap required, opened a new log
I20260810 01:55:43.519064 23588 ts_tablet_manager.cc:1403] T 20c224643c524dd4b94febd93fd28584 P 5c71783cbed64297b17353312fcd4bb0: Time spent bootstrapping tablet: real 0.038s user 0.002s sys 0.004s
I20260810 01:55:43.519996 23588 raft_consensus.cc:359] T 20c224643c524dd4b94febd93fd28584 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:43.520128 23586 tablet_bootstrap.cc:492] T 36b269b1f6694a1c9c741dd5dab037b9 P c5ca831c32e4452dba1cfc6cd296e532: No bootstrap required, opened a new log
I20260810 01:55:43.520231 23588 raft_consensus.cc:385] T 20c224643c524dd4b94febd93fd28584 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:43.520358 23586 ts_tablet_manager.cc:1403] T 36b269b1f6694a1c9c741dd5dab037b9 P c5ca831c32e4452dba1cfc6cd296e532: Time spent bootstrapping tablet: real 0.032s user 0.015s sys 0.014s
I20260810 01:55:43.520364 23588 raft_consensus.cc:740] T 20c224643c524dd4b94febd93fd28584 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c71783cbed64297b17353312fcd4bb0, State: Initialized, Role: FOLLOWER
I20260810 01:55:43.520639 23588 consensus_queue.cc:260] T 20c224643c524dd4b94febd93fd28584 P 5c71783cbed64297b17353312fcd4bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:43.521116 23587 tablet_bootstrap.cc:492] T 20c224643c524dd4b94febd93fd28584 P 78c107f9dfbc4d3483895dda0f791bb2: No bootstrap required, opened a new log
I20260810 01:55:43.521325 23587 ts_tablet_manager.cc:1403] T 20c224643c524dd4b94febd93fd28584 P 78c107f9dfbc4d3483895dda0f791bb2: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.000s
I20260810 01:55:43.521250 23586 raft_consensus.cc:359] T 36b269b1f6694a1c9c741dd5dab037b9 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } }
I20260810 01:55:43.521556 23586 raft_consensus.cc:385] T 36b269b1f6694a1c9c741dd5dab037b9 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:43.521651 23586 raft_consensus.cc:740] T 36b269b1f6694a1c9c741dd5dab037b9 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ca831c32e4452dba1cfc6cd296e532, State: Initialized, Role: FOLLOWER
I20260810 01:55:43.521940 23586 consensus_queue.cc:260] T 36b269b1f6694a1c9c741dd5dab037b9 P c5ca831c32e4452dba1cfc6cd296e532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } }
I20260810 01:55:43.522471 23586 ts_tablet_manager.cc:1434] T 36b269b1f6694a1c9c741dd5dab037b9 P c5ca831c32e4452dba1cfc6cd296e532: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:55:43.522441 23587 raft_consensus.cc:359] T 20c224643c524dd4b94febd93fd28584 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:43.522718 23587 raft_consensus.cc:385] T 20c224643c524dd4b94febd93fd28584 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:43.522822 23587 raft_consensus.cc:740] T 20c224643c524dd4b94febd93fd28584 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78c107f9dfbc4d3483895dda0f791bb2, State: Initialized, Role: FOLLOWER
I20260810 01:55:43.523029 23588 ts_tablet_manager.cc:1434] T 20c224643c524dd4b94febd93fd28584 P 5c71783cbed64297b17353312fcd4bb0: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260810 01:55:43.523187 23587 consensus_queue.cc:260] T 20c224643c524dd4b94febd93fd28584 P 78c107f9dfbc4d3483895dda0f791bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:43.523895 23587 ts_tablet_manager.cc:1434] T 20c224643c524dd4b94febd93fd28584 P 78c107f9dfbc4d3483895dda0f791bb2: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 01:55:43.590032 23555 raft_consensus.cc:493] T 36b269b1f6694a1c9c741dd5dab037b9 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:55:43.590265 23555 raft_consensus.cc:515] T 36b269b1f6694a1c9c741dd5dab037b9 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } }
I20260810 01:55:43.591038 23555 leader_election.cc:290] T 36b269b1f6694a1c9c741dd5dab037b9 P 65755ebc82864dc3a3193b1ba3870613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ca831c32e4452dba1cfc6cd296e532 (127.21.64.193:39917), 687f288b7e9d4650a758d5451483e49b (127.21.64.197:37655)
I20260810 01:55:43.591627 22770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b269b1f6694a1c9c741dd5dab037b9" candidate_uuid: "65755ebc82864dc3a3193b1ba3870613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687f288b7e9d4650a758d5451483e49b" is_pre_election: true
I20260810 01:55:43.591668 22026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b269b1f6694a1c9c741dd5dab037b9" candidate_uuid: "65755ebc82864dc3a3193b1ba3870613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ca831c32e4452dba1cfc6cd296e532" is_pre_election: true
I20260810 01:55:43.591879 22770 raft_consensus.cc:2468] T 36b269b1f6694a1c9c741dd5dab037b9 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65755ebc82864dc3a3193b1ba3870613 in term 0.
I20260810 01:55:43.591899 22026 raft_consensus.cc:2468] T 36b269b1f6694a1c9c741dd5dab037b9 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65755ebc82864dc3a3193b1ba3870613 in term 0.
I20260810 01:55:43.592468 22294 leader_election.cc:304] T 36b269b1f6694a1c9c741dd5dab037b9 P 65755ebc82864dc3a3193b1ba3870613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65755ebc82864dc3a3193b1ba3870613, 687f288b7e9d4650a758d5451483e49b; no voters:
I20260810 01:55:43.592769 23555 raft_consensus.cc:2804] T 36b269b1f6694a1c9c741dd5dab037b9 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:55:43.592935 23555 raft_consensus.cc:493] T 36b269b1f6694a1c9c741dd5dab037b9 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:55:43.593060 23555 raft_consensus.cc:3060] T 36b269b1f6694a1c9c741dd5dab037b9 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:43.595872 23555 raft_consensus.cc:515] T 36b269b1f6694a1c9c741dd5dab037b9 P 65755ebc82864dc3a3193b1ba3870613 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } }
I20260810 01:55:43.596434 23555 leader_election.cc:290] T 36b269b1f6694a1c9c741dd5dab037b9 P 65755ebc82864dc3a3193b1ba3870613 [CANDIDATE]: Term 1 election: Requested vote from peers c5ca831c32e4452dba1cfc6cd296e532 (127.21.64.193:39917), 687f288b7e9d4650a758d5451483e49b (127.21.64.197:37655)
I20260810 01:55:43.596863 22770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b269b1f6694a1c9c741dd5dab037b9" candidate_uuid: "65755ebc82864dc3a3193b1ba3870613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687f288b7e9d4650a758d5451483e49b"
I20260810 01:55:43.596925 22026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b269b1f6694a1c9c741dd5dab037b9" candidate_uuid: "65755ebc82864dc3a3193b1ba3870613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ca831c32e4452dba1cfc6cd296e532"
I20260810 01:55:43.597070 22770 raft_consensus.cc:3060] T 36b269b1f6694a1c9c741dd5dab037b9 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:43.597150 22026 raft_consensus.cc:3060] T 36b269b1f6694a1c9c741dd5dab037b9 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:43.599327 22770 raft_consensus.cc:2468] T 36b269b1f6694a1c9c741dd5dab037b9 P 687f288b7e9d4650a758d5451483e49b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65755ebc82864dc3a3193b1ba3870613 in term 1.
I20260810 01:55:43.599496 22026 raft_consensus.cc:2468] T 36b269b1f6694a1c9c741dd5dab037b9 P c5ca831c32e4452dba1cfc6cd296e532 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65755ebc82864dc3a3193b1ba3870613 in term 1.
I20260810 01:55:43.599944 22294 leader_election.cc:304] T 36b269b1f6694a1c9c741dd5dab037b9 P 65755ebc82864dc3a3193b1ba3870613 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65755ebc82864dc3a3193b1ba3870613, 687f288b7e9d4650a758d5451483e49b; no voters:
I20260810 01:55:43.600277 23555 raft_consensus.cc:2804] T 36b269b1f6694a1c9c741dd5dab037b9 P 65755ebc82864dc3a3193b1ba3870613 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:55:43.600476 23555 raft_consensus.cc:697] T 36b269b1f6694a1c9c741dd5dab037b9 P 65755ebc82864dc3a3193b1ba3870613 [term 1 LEADER]: Becoming Leader. State: Replica: 65755ebc82864dc3a3193b1ba3870613, State: Running, Role: LEADER
I20260810 01:55:43.600769 23555 consensus_queue.cc:237] T 36b269b1f6694a1c9c741dd5dab037b9 P 65755ebc82864dc3a3193b1ba3870613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } }
I20260810 01:55:43.603492 21815 catalog_manager.cc:5719] T 36b269b1f6694a1c9c741dd5dab037b9 P 65755ebc82864dc3a3193b1ba3870613 reported cstate change: term changed from 0 to 1, leader changed from <none> to 65755ebc82864dc3a3193b1ba3870613 (127.21.64.195). New cstate: current_term: 1 leader_uuid: "65755ebc82864dc3a3193b1ba3870613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } health_report { overall_health: UNKNOWN } } }
I20260810 01:55:43.690835 23362 raft_consensus.cc:493] T 20c224643c524dd4b94febd93fd28584 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:55:43.691043 23362 raft_consensus.cc:515] T 20c224643c524dd4b94febd93fd28584 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:43.691721 23362 leader_election.cc:290] T 20c224643c524dd4b94febd93fd28584 P 5c71783cbed64297b17353312fcd4bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194:33547), fabe62238d32404097129ae02ed3b0b3 (127.21.64.196:32931)
I20260810 01:55:43.692178 22209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c224643c524dd4b94febd93fd28584" candidate_uuid: "5c71783cbed64297b17353312fcd4bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78c107f9dfbc4d3483895dda0f791bb2" is_pre_election: true
I20260810 01:55:43.692345 22587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c224643c524dd4b94febd93fd28584" candidate_uuid: "5c71783cbed64297b17353312fcd4bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabe62238d32404097129ae02ed3b0b3" is_pre_election: true
I20260810 01:55:43.692431 22209 raft_consensus.cc:2468] T 20c224643c524dd4b94febd93fd28584 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c71783cbed64297b17353312fcd4bb0 in term 0.
I20260810 01:55:43.692610 22587 raft_consensus.cc:2468] T 20c224643c524dd4b94febd93fd28584 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c71783cbed64297b17353312fcd4bb0 in term 0.
I20260810 01:55:43.692934 22861 leader_election.cc:304] T 20c224643c524dd4b94febd93fd28584 P 5c71783cbed64297b17353312fcd4bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c71783cbed64297b17353312fcd4bb0, 78c107f9dfbc4d3483895dda0f791bb2; no voters:
I20260810 01:55:43.693277 23362 raft_consensus.cc:2804] T 20c224643c524dd4b94febd93fd28584 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:55:43.693424 23362 raft_consensus.cc:493] T 20c224643c524dd4b94febd93fd28584 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:55:43.693507 23362 raft_consensus.cc:3060] T 20c224643c524dd4b94febd93fd28584 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:43.695416 23362 raft_consensus.cc:515] T 20c224643c524dd4b94febd93fd28584 P 5c71783cbed64297b17353312fcd4bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:43.695964 23362 leader_election.cc:290] T 20c224643c524dd4b94febd93fd28584 P 5c71783cbed64297b17353312fcd4bb0 [CANDIDATE]: Term 1 election: Requested vote from peers 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194:33547), fabe62238d32404097129ae02ed3b0b3 (127.21.64.196:32931)
I20260810 01:55:43.696362 22209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c224643c524dd4b94febd93fd28584" candidate_uuid: "5c71783cbed64297b17353312fcd4bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78c107f9dfbc4d3483895dda0f791bb2"
I20260810 01:55:43.696497 22587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c224643c524dd4b94febd93fd28584" candidate_uuid: "5c71783cbed64297b17353312fcd4bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabe62238d32404097129ae02ed3b0b3"
I20260810 01:55:43.696583 22209 raft_consensus.cc:3060] T 20c224643c524dd4b94febd93fd28584 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:43.696702 22587 raft_consensus.cc:3060] T 20c224643c524dd4b94febd93fd28584 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:43.699723 22209 raft_consensus.cc:2468] T 20c224643c524dd4b94febd93fd28584 P 78c107f9dfbc4d3483895dda0f791bb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c71783cbed64297b17353312fcd4bb0 in term 1.
I20260810 01:55:43.699744 22587 raft_consensus.cc:2468] T 20c224643c524dd4b94febd93fd28584 P fabe62238d32404097129ae02ed3b0b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c71783cbed64297b17353312fcd4bb0 in term 1.
I20260810 01:55:43.700147 22857 leader_election.cc:304] T 20c224643c524dd4b94febd93fd28584 P 5c71783cbed64297b17353312fcd4bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c71783cbed64297b17353312fcd4bb0, fabe62238d32404097129ae02ed3b0b3; no voters:
I20260810 01:55:43.700519 23362 raft_consensus.cc:2804] T 20c224643c524dd4b94febd93fd28584 P 5c71783cbed64297b17353312fcd4bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:55:43.700677 23362 raft_consensus.cc:697] T 20c224643c524dd4b94febd93fd28584 P 5c71783cbed64297b17353312fcd4bb0 [term 1 LEADER]: Becoming Leader. State: Replica: 5c71783cbed64297b17353312fcd4bb0, State: Running, Role: LEADER
I20260810 01:55:43.701315 23362 consensus_queue.cc:237] T 20c224643c524dd4b94febd93fd28584 P 5c71783cbed64297b17353312fcd4bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:43.704236 21815 catalog_manager.cc:5719] T 20c224643c524dd4b94febd93fd28584 P 5c71783cbed64297b17353312fcd4bb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c71783cbed64297b17353312fcd4bb0 (127.21.64.198). New cstate: current_term: 1 leader_uuid: "5c71783cbed64297b17353312fcd4bb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } health_report { overall_health: HEALTHY } } }
I20260810 01:55:43.909474 23555 raft_consensus.cc:493] T 8a439c266a594bce8c0b5f22c571dbc2 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:55:43.909657 23555 raft_consensus.cc:515] T 8a439c266a594bce8c0b5f22c571dbc2 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:43.910423 23555 leader_election.cc:290] T 8a439c266a594bce8c0b5f22c571dbc2 P 65755ebc82864dc3a3193b1ba3870613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687f288b7e9d4650a758d5451483e49b (127.21.64.197:37655), c5ca831c32e4452dba1cfc6cd296e532 (127.21.64.193:39917)
I20260810 01:55:43.911028 22770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a439c266a594bce8c0b5f22c571dbc2" candidate_uuid: "65755ebc82864dc3a3193b1ba3870613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687f288b7e9d4650a758d5451483e49b" is_pre_election: true
I20260810 01:55:43.911087 22026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a439c266a594bce8c0b5f22c571dbc2" candidate_uuid: "65755ebc82864dc3a3193b1ba3870613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ca831c32e4452dba1cfc6cd296e532" is_pre_election: true
I20260810 01:55:43.911245 22770 raft_consensus.cc:2468] T 8a439c266a594bce8c0b5f22c571dbc2 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65755ebc82864dc3a3193b1ba3870613 in term 0.
I20260810 01:55:43.911412 22026 raft_consensus.cc:2468] T 8a439c266a594bce8c0b5f22c571dbc2 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65755ebc82864dc3a3193b1ba3870613 in term 0.
I20260810 01:55:43.911777 22294 leader_election.cc:304] T 8a439c266a594bce8c0b5f22c571dbc2 P 65755ebc82864dc3a3193b1ba3870613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65755ebc82864dc3a3193b1ba3870613, 687f288b7e9d4650a758d5451483e49b; no voters:
I20260810 01:55:43.912106 23555 raft_consensus.cc:2804] T 8a439c266a594bce8c0b5f22c571dbc2 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:55:43.912204 23555 raft_consensus.cc:493] T 8a439c266a594bce8c0b5f22c571dbc2 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:55:43.912325 23555 raft_consensus.cc:3060] T 8a439c266a594bce8c0b5f22c571dbc2 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:43.914414 23555 raft_consensus.cc:515] T 8a439c266a594bce8c0b5f22c571dbc2 P 65755ebc82864dc3a3193b1ba3870613 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:43.915035 23555 leader_election.cc:290] T 8a439c266a594bce8c0b5f22c571dbc2 P 65755ebc82864dc3a3193b1ba3870613 [CANDIDATE]: Term 1 election: Requested vote from peers 687f288b7e9d4650a758d5451483e49b (127.21.64.197:37655), c5ca831c32e4452dba1cfc6cd296e532 (127.21.64.193:39917)
I20260810 01:55:43.915441 22026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a439c266a594bce8c0b5f22c571dbc2" candidate_uuid: "65755ebc82864dc3a3193b1ba3870613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ca831c32e4452dba1cfc6cd296e532"
I20260810 01:55:43.915473 22770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a439c266a594bce8c0b5f22c571dbc2" candidate_uuid: "65755ebc82864dc3a3193b1ba3870613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687f288b7e9d4650a758d5451483e49b"
I20260810 01:55:43.915625 22026 raft_consensus.cc:3060] T 8a439c266a594bce8c0b5f22c571dbc2 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:43.915678 22770 raft_consensus.cc:3060] T 8a439c266a594bce8c0b5f22c571dbc2 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:43.917665 22026 raft_consensus.cc:2468] T 8a439c266a594bce8c0b5f22c571dbc2 P c5ca831c32e4452dba1cfc6cd296e532 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65755ebc82864dc3a3193b1ba3870613 in term 1.
I20260810 01:55:43.917807 22770 raft_consensus.cc:2468] T 8a439c266a594bce8c0b5f22c571dbc2 P 687f288b7e9d4650a758d5451483e49b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65755ebc82864dc3a3193b1ba3870613 in term 1.
I20260810 01:55:43.918226 22297 leader_election.cc:304] T 8a439c266a594bce8c0b5f22c571dbc2 P 65755ebc82864dc3a3193b1ba3870613 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65755ebc82864dc3a3193b1ba3870613, c5ca831c32e4452dba1cfc6cd296e532; no voters:
I20260810 01:55:43.918577 23555 raft_consensus.cc:2804] T 8a439c266a594bce8c0b5f22c571dbc2 P 65755ebc82864dc3a3193b1ba3870613 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:55:43.918782 23555 raft_consensus.cc:697] T 8a439c266a594bce8c0b5f22c571dbc2 P 65755ebc82864dc3a3193b1ba3870613 [term 1 LEADER]: Becoming Leader. State: Replica: 65755ebc82864dc3a3193b1ba3870613, State: Running, Role: LEADER
I20260810 01:55:43.919101 23555 consensus_queue.cc:237] T 8a439c266a594bce8c0b5f22c571dbc2 P 65755ebc82864dc3a3193b1ba3870613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:43.921855 21815 catalog_manager.cc:5719] T 8a439c266a594bce8c0b5f22c571dbc2 P 65755ebc82864dc3a3193b1ba3870613 reported cstate change: term changed from 0 to 1, leader changed from <none> to 65755ebc82864dc3a3193b1ba3870613 (127.21.64.195). New cstate: current_term: 1 leader_uuid: "65755ebc82864dc3a3193b1ba3870613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } health_report { overall_health: UNKNOWN } } }
I20260810 01:55:44.118561 23555 consensus_queue.cc:1048] T 36b269b1f6694a1c9c741dd5dab037b9 P 65755ebc82864dc3a3193b1ba3870613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:44.125182 23555 consensus_queue.cc:1048] T 36b269b1f6694a1c9c741dd5dab037b9 P 65755ebc82864dc3a3193b1ba3870613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:44.165726 23362 consensus_queue.cc:1048] T 20c224643c524dd4b94febd93fd28584 P 5c71783cbed64297b17353312fcd4bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:44.180699 23362 consensus_queue.cc:1048] T 20c224643c524dd4b94febd93fd28584 P 5c71783cbed64297b17353312fcd4bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:44.437616 23555 consensus_queue.cc:1048] T 8a439c266a594bce8c0b5f22c571dbc2 P 65755ebc82864dc3a3193b1ba3870613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 01:55:44.440143 23609 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:55:44.440855 23609 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260810 01:55:44.443511 23212 consensus_queue.cc:1048] T 8a439c266a594bce8c0b5f22c571dbc2 P 65755ebc82864dc3a3193b1ba3870613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
Using table 'rebalance_test_table_4'
INSERT report
rows total: 2000
time total: 308.276 ms
time per row: 0.154138 ms
I20260810 01:55:44.964771 21826 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60594:
name: "rebalance_test_table_5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260810 01:55:44.975958 22178 tablet_service.cc:1511] Processing CreateTablet for tablet 7436e2843ee4428887e108699ed25663 (DEFAULT_TABLE table=rebalance_test_table_5 [id=1bfe75d989874492884a2aa4ce067dda]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:44.976608 22178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7436e2843ee4428887e108699ed25663. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:44.976501 22558 tablet_service.cc:1511] Processing CreateTablet for tablet 7436e2843ee4428887e108699ed25663 (DEFAULT_TABLE table=rebalance_test_table_5 [id=1bfe75d989874492884a2aa4ce067dda]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:44.976861 22181 tablet_service.cc:1511] Processing CreateTablet for tablet 7e1b884fb1e24b90a854a6a0d582d16e (DEFAULT_TABLE table=rebalance_test_table_5 [id=1bfe75d989874492884a2aa4ce067dda]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:44.976845 22559 tablet_service.cc:1511] Processing CreateTablet for tablet 7e1b884fb1e24b90a854a6a0d582d16e (DEFAULT_TABLE table=rebalance_test_table_5 [id=1bfe75d989874492884a2aa4ce067dda]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:44.977035 22558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7436e2843ee4428887e108699ed25663. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:44.977241 22181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e1b884fb1e24b90a854a6a0d582d16e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:44.978114 22921 tablet_service.cc:1511] Processing CreateTablet for tablet 7436e2843ee4428887e108699ed25663 (DEFAULT_TABLE table=rebalance_test_table_5 [id=1bfe75d989874492884a2aa4ce067dda]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:44.978703 22921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7436e2843ee4428887e108699ed25663. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:44.977301 22559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e1b884fb1e24b90a854a6a0d582d16e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:44.987315 22922 tablet_service.cc:1511] Processing CreateTablet for tablet 7e1b884fb1e24b90a854a6a0d582d16e (DEFAULT_TABLE table=rebalance_test_table_5 [id=1bfe75d989874492884a2aa4ce067dda]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:44.987886 22922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e1b884fb1e24b90a854a6a0d582d16e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:44.992491 21995 tablet_service.cc:1511] Processing CreateTablet for tablet 7d1f61329cf44dfbb36cbf585bc56493 (DEFAULT_TABLE table=rebalance_test_table_5 [id=1bfe75d989874492884a2aa4ce067dda]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:44.993042 21995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d1f61329cf44dfbb36cbf585bc56493. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:44.993091 22739 tablet_service.cc:1511] Processing CreateTablet for tablet 7d1f61329cf44dfbb36cbf585bc56493 (DEFAULT_TABLE table=rebalance_test_table_5 [id=1bfe75d989874492884a2aa4ce067dda]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:44.993605 22739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d1f61329cf44dfbb36cbf585bc56493. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:44.997932 22363 tablet_service.cc:1511] Processing CreateTablet for tablet 7d1f61329cf44dfbb36cbf585bc56493 (DEFAULT_TABLE table=rebalance_test_table_5 [id=1bfe75d989874492884a2aa4ce067dda]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:44.998500 22363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d1f61329cf44dfbb36cbf585bc56493. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:45.002123 23691 tablet_bootstrap.cc:492] T 7e1b884fb1e24b90a854a6a0d582d16e P 78c107f9dfbc4d3483895dda0f791bb2: Bootstrap starting.
I20260810 01:55:45.003971 23691 tablet_bootstrap.cc:654] T 7e1b884fb1e24b90a854a6a0d582d16e P 78c107f9dfbc4d3483895dda0f791bb2: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:45.008833 23694 tablet_bootstrap.cc:492] T 7d1f61329cf44dfbb36cbf585bc56493 P c5ca831c32e4452dba1cfc6cd296e532: Bootstrap starting.
I20260810 01:55:45.013130 23691 tablet_bootstrap.cc:492] T 7e1b884fb1e24b90a854a6a0d582d16e P 78c107f9dfbc4d3483895dda0f791bb2: No bootstrap required, opened a new log
I20260810 01:55:45.013289 23691 ts_tablet_manager.cc:1403] T 7e1b884fb1e24b90a854a6a0d582d16e P 78c107f9dfbc4d3483895dda0f791bb2: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.000s
I20260810 01:55:45.014191 23691 raft_consensus.cc:359] T 7e1b884fb1e24b90a854a6a0d582d16e P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:45.017103 23691 raft_consensus.cc:385] T 7e1b884fb1e24b90a854a6a0d582d16e P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:45.017537 23694 tablet_bootstrap.cc:654] T 7d1f61329cf44dfbb36cbf585bc56493 P c5ca831c32e4452dba1cfc6cd296e532: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:45.017763 23691 raft_consensus.cc:740] T 7e1b884fb1e24b90a854a6a0d582d16e P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78c107f9dfbc4d3483895dda0f791bb2, State: Initialized, Role: FOLLOWER
I20260810 01:55:45.018208 23691 consensus_queue.cc:260] T 7e1b884fb1e24b90a854a6a0d582d16e P 78c107f9dfbc4d3483895dda0f791bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:45.019881 23691 ts_tablet_manager.cc:1434] T 7e1b884fb1e24b90a854a6a0d582d16e P 78c107f9dfbc4d3483895dda0f791bb2: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260810 01:55:45.021456 23691 tablet_bootstrap.cc:492] T 7436e2843ee4428887e108699ed25663 P 78c107f9dfbc4d3483895dda0f791bb2: Bootstrap starting.
I20260810 01:55:45.023769 23691 tablet_bootstrap.cc:654] T 7436e2843ee4428887e108699ed25663 P 78c107f9dfbc4d3483895dda0f791bb2: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:45.028770 23698 tablet_bootstrap.cc:492] T 7d1f61329cf44dfbb36cbf585bc56493 P 687f288b7e9d4650a758d5451483e49b: Bootstrap starting.
I20260810 01:55:45.031494 23698 tablet_bootstrap.cc:654] T 7d1f61329cf44dfbb36cbf585bc56493 P 687f288b7e9d4650a758d5451483e49b: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:45.042600 23698 tablet_bootstrap.cc:492] T 7d1f61329cf44dfbb36cbf585bc56493 P 687f288b7e9d4650a758d5451483e49b: No bootstrap required, opened a new log
I20260810 01:55:45.042862 23698 ts_tablet_manager.cc:1403] T 7d1f61329cf44dfbb36cbf585bc56493 P 687f288b7e9d4650a758d5451483e49b: Time spent bootstrapping tablet: real 0.014s user 0.011s sys 0.000s
I20260810 01:55:45.044131 23698 raft_consensus.cc:359] T 7d1f61329cf44dfbb36cbf585bc56493 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:45.044544 23698 raft_consensus.cc:385] T 7d1f61329cf44dfbb36cbf585bc56493 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:45.044715 23698 raft_consensus.cc:740] T 7d1f61329cf44dfbb36cbf585bc56493 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687f288b7e9d4650a758d5451483e49b, State: Initialized, Role: FOLLOWER
I20260810 01:55:45.045230 23698 consensus_queue.cc:260] T 7d1f61329cf44dfbb36cbf585bc56493 P 687f288b7e9d4650a758d5451483e49b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:45.047327 23698 ts_tablet_manager.cc:1434] T 7d1f61329cf44dfbb36cbf585bc56493 P 687f288b7e9d4650a758d5451483e49b: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260810 01:55:45.048808 23692 tablet_bootstrap.cc:492] T 7436e2843ee4428887e108699ed25663 P 5c71783cbed64297b17353312fcd4bb0: Bootstrap starting.
I20260810 01:55:45.052336 23692 tablet_bootstrap.cc:654] T 7436e2843ee4428887e108699ed25663 P 5c71783cbed64297b17353312fcd4bb0: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:45.052701 23702 tablet_bootstrap.cc:492] T 7d1f61329cf44dfbb36cbf585bc56493 P 65755ebc82864dc3a3193b1ba3870613: Bootstrap starting.
I20260810 01:55:45.054848 23702 tablet_bootstrap.cc:654] T 7d1f61329cf44dfbb36cbf585bc56493 P 65755ebc82864dc3a3193b1ba3870613: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:45.057098 23694 tablet_bootstrap.cc:492] T 7d1f61329cf44dfbb36cbf585bc56493 P c5ca831c32e4452dba1cfc6cd296e532: No bootstrap required, opened a new log
I20260810 01:55:45.058380 23691 tablet_bootstrap.cc:492] T 7436e2843ee4428887e108699ed25663 P 78c107f9dfbc4d3483895dda0f791bb2: No bootstrap required, opened a new log
I20260810 01:55:45.058612 23691 ts_tablet_manager.cc:1403] T 7436e2843ee4428887e108699ed25663 P 78c107f9dfbc4d3483895dda0f791bb2: Time spent bootstrapping tablet: real 0.037s user 0.006s sys 0.000s
I20260810 01:55:45.059594 23691 raft_consensus.cc:359] T 7436e2843ee4428887e108699ed25663 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:45.059887 23691 raft_consensus.cc:385] T 7436e2843ee4428887e108699ed25663 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:45.059983 23691 raft_consensus.cc:740] T 7436e2843ee4428887e108699ed25663 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78c107f9dfbc4d3483895dda0f791bb2, State: Initialized, Role: FOLLOWER
I20260810 01:55:45.057313 23694 ts_tablet_manager.cc:1403] T 7d1f61329cf44dfbb36cbf585bc56493 P c5ca831c32e4452dba1cfc6cd296e532: Time spent bootstrapping tablet: real 0.049s user 0.003s sys 0.006s
I20260810 01:55:45.060467 23693 tablet_bootstrap.cc:492] T 7436e2843ee4428887e108699ed25663 P fabe62238d32404097129ae02ed3b0b3: Bootstrap starting.
I20260810 01:55:45.060837 23702 tablet_bootstrap.cc:492] T 7d1f61329cf44dfbb36cbf585bc56493 P 65755ebc82864dc3a3193b1ba3870613: No bootstrap required, opened a new log
I20260810 01:55:45.061435 23694 raft_consensus.cc:359] T 7d1f61329cf44dfbb36cbf585bc56493 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:45.061658 23694 raft_consensus.cc:385] T 7d1f61329cf44dfbb36cbf585bc56493 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:45.061816 23694 raft_consensus.cc:740] T 7d1f61329cf44dfbb36cbf585bc56493 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ca831c32e4452dba1cfc6cd296e532, State: Initialized, Role: FOLLOWER
I20260810 01:55:45.062255 23702 ts_tablet_manager.cc:1403] T 7d1f61329cf44dfbb36cbf585bc56493 P 65755ebc82864dc3a3193b1ba3870613: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.004s
I20260810 01:55:45.062403 23691 consensus_queue.cc:260] T 7436e2843ee4428887e108699ed25663 P 78c107f9dfbc4d3483895dda0f791bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:45.062069 23694 consensus_queue.cc:260] T 7d1f61329cf44dfbb36cbf585bc56493 P c5ca831c32e4452dba1cfc6cd296e532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:45.063408 23702 raft_consensus.cc:359] T 7d1f61329cf44dfbb36cbf585bc56493 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:45.063666 23702 raft_consensus.cc:385] T 7d1f61329cf44dfbb36cbf585bc56493 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:45.063813 23702 raft_consensus.cc:740] T 7d1f61329cf44dfbb36cbf585bc56493 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65755ebc82864dc3a3193b1ba3870613, State: Initialized, Role: FOLLOWER
I20260810 01:55:45.063817 23693 tablet_bootstrap.cc:654] T 7436e2843ee4428887e108699ed25663 P fabe62238d32404097129ae02ed3b0b3: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:45.064114 23702 consensus_queue.cc:260] T 7d1f61329cf44dfbb36cbf585bc56493 P 65755ebc82864dc3a3193b1ba3870613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:45.064764 23702 ts_tablet_manager.cc:1434] T 7d1f61329cf44dfbb36cbf585bc56493 P 65755ebc82864dc3a3193b1ba3870613: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 01:55:45.066236 23694 ts_tablet_manager.cc:1434] T 7d1f61329cf44dfbb36cbf585bc56493 P c5ca831c32e4452dba1cfc6cd296e532: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260810 01:55:45.066479 23692 tablet_bootstrap.cc:492] T 7436e2843ee4428887e108699ed25663 P 5c71783cbed64297b17353312fcd4bb0: No bootstrap required, opened a new log
I20260810 01:55:45.066834 23691 ts_tablet_manager.cc:1434] T 7436e2843ee4428887e108699ed25663 P 78c107f9dfbc4d3483895dda0f791bb2: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20260810 01:55:45.067016 23692 ts_tablet_manager.cc:1403] T 7436e2843ee4428887e108699ed25663 P 5c71783cbed64297b17353312fcd4bb0: Time spent bootstrapping tablet: real 0.019s user 0.013s sys 0.005s
I20260810 01:55:45.067942 23692 raft_consensus.cc:359] T 7436e2843ee4428887e108699ed25663 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:45.068223 23692 raft_consensus.cc:385] T 7436e2843ee4428887e108699ed25663 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:45.068372 23692 raft_consensus.cc:740] T 7436e2843ee4428887e108699ed25663 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c71783cbed64297b17353312fcd4bb0, State: Initialized, Role: FOLLOWER
I20260810 01:55:45.068702 23692 consensus_queue.cc:260] T 7436e2843ee4428887e108699ed25663 P 5c71783cbed64297b17353312fcd4bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:45.069257 23693 tablet_bootstrap.cc:492] T 7436e2843ee4428887e108699ed25663 P fabe62238d32404097129ae02ed3b0b3: No bootstrap required, opened a new log
I20260810 01:55:45.069481 23693 ts_tablet_manager.cc:1403] T 7436e2843ee4428887e108699ed25663 P fabe62238d32404097129ae02ed3b0b3: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260810 01:55:45.069489 23692 ts_tablet_manager.cc:1434] T 7436e2843ee4428887e108699ed25663 P 5c71783cbed64297b17353312fcd4bb0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 01:55:45.069753 23692 tablet_bootstrap.cc:492] T 7e1b884fb1e24b90a854a6a0d582d16e P 5c71783cbed64297b17353312fcd4bb0: Bootstrap starting.
I20260810 01:55:45.070392 23693 raft_consensus.cc:359] T 7436e2843ee4428887e108699ed25663 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:45.070667 23693 raft_consensus.cc:385] T 7436e2843ee4428887e108699ed25663 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:45.070799 23693 raft_consensus.cc:740] T 7436e2843ee4428887e108699ed25663 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabe62238d32404097129ae02ed3b0b3, State: Initialized, Role: FOLLOWER
I20260810 01:55:45.071089 23693 consensus_queue.cc:260] T 7436e2843ee4428887e108699ed25663 P fabe62238d32404097129ae02ed3b0b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:45.071744 23692 tablet_bootstrap.cc:654] T 7e1b884fb1e24b90a854a6a0d582d16e P 5c71783cbed64297b17353312fcd4bb0: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:45.071732 23693 ts_tablet_manager.cc:1434] T 7436e2843ee4428887e108699ed25663 P fabe62238d32404097129ae02ed3b0b3: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 01:55:45.072115 23693 tablet_bootstrap.cc:492] T 7e1b884fb1e24b90a854a6a0d582d16e P fabe62238d32404097129ae02ed3b0b3: Bootstrap starting.
I20260810 01:55:45.075306 23693 tablet_bootstrap.cc:654] T 7e1b884fb1e24b90a854a6a0d582d16e P fabe62238d32404097129ae02ed3b0b3: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:45.091627 23692 tablet_bootstrap.cc:492] T 7e1b884fb1e24b90a854a6a0d582d16e P 5c71783cbed64297b17353312fcd4bb0: No bootstrap required, opened a new log
I20260810 01:55:45.091714 23693 tablet_bootstrap.cc:492] T 7e1b884fb1e24b90a854a6a0d582d16e P fabe62238d32404097129ae02ed3b0b3: No bootstrap required, opened a new log
I20260810 01:55:45.091965 23692 ts_tablet_manager.cc:1403] T 7e1b884fb1e24b90a854a6a0d582d16e P 5c71783cbed64297b17353312fcd4bb0: Time spent bootstrapping tablet: real 0.022s user 0.010s sys 0.010s
I20260810 01:55:45.091989 23693 ts_tablet_manager.cc:1403] T 7e1b884fb1e24b90a854a6a0d582d16e P fabe62238d32404097129ae02ed3b0b3: Time spent bootstrapping tablet: real 0.020s user 0.005s sys 0.012s
I20260810 01:55:45.092902 23692 raft_consensus.cc:359] T 7e1b884fb1e24b90a854a6a0d582d16e P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:45.093227 23692 raft_consensus.cc:385] T 7e1b884fb1e24b90a854a6a0d582d16e P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:45.093418 23692 raft_consensus.cc:740] T 7e1b884fb1e24b90a854a6a0d582d16e P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c71783cbed64297b17353312fcd4bb0, State: Initialized, Role: FOLLOWER
I20260810 01:55:45.093269 23693 raft_consensus.cc:359] T 7e1b884fb1e24b90a854a6a0d582d16e P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:45.093693 23693 raft_consensus.cc:385] T 7e1b884fb1e24b90a854a6a0d582d16e P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:45.093852 23693 raft_consensus.cc:740] T 7e1b884fb1e24b90a854a6a0d582d16e P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabe62238d32404097129ae02ed3b0b3, State: Initialized, Role: FOLLOWER
I20260810 01:55:45.093775 23692 consensus_queue.cc:260] T 7e1b884fb1e24b90a854a6a0d582d16e P 5c71783cbed64297b17353312fcd4bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:45.094254 23693 consensus_queue.cc:260] T 7e1b884fb1e24b90a854a6a0d582d16e P fabe62238d32404097129ae02ed3b0b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:45.094537 23692 ts_tablet_manager.cc:1434] T 7e1b884fb1e24b90a854a6a0d582d16e P 5c71783cbed64297b17353312fcd4bb0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:55:45.095029 23693 ts_tablet_manager.cc:1434] T 7e1b884fb1e24b90a854a6a0d582d16e P fabe62238d32404097129ae02ed3b0b3: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260810 01:55:45.151018 23618 raft_consensus.cc:493] T 7e1b884fb1e24b90a854a6a0d582d16e P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:55:45.151214 23618 raft_consensus.cc:515] T 7e1b884fb1e24b90a854a6a0d582d16e P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:45.151993 23618 leader_election.cc:290] T 7e1b884fb1e24b90a854a6a0d582d16e P 5c71783cbed64297b17353312fcd4bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194:33547), fabe62238d32404097129ae02ed3b0b3 (127.21.64.196:32931)
I20260810 01:55:45.152467 22209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1b884fb1e24b90a854a6a0d582d16e" candidate_uuid: "5c71783cbed64297b17353312fcd4bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78c107f9dfbc4d3483895dda0f791bb2" is_pre_election: true
I20260810 01:55:45.152693 22209 raft_consensus.cc:2468] T 7e1b884fb1e24b90a854a6a0d582d16e P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c71783cbed64297b17353312fcd4bb0 in term 0.
I20260810 01:55:45.152767 22587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1b884fb1e24b90a854a6a0d582d16e" candidate_uuid: "5c71783cbed64297b17353312fcd4bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabe62238d32404097129ae02ed3b0b3" is_pre_election: true
I20260810 01:55:45.153033 22587 raft_consensus.cc:2468] T 7e1b884fb1e24b90a854a6a0d582d16e P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c71783cbed64297b17353312fcd4bb0 in term 0.
I20260810 01:55:45.153409 22861 leader_election.cc:304] T 7e1b884fb1e24b90a854a6a0d582d16e P 5c71783cbed64297b17353312fcd4bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c71783cbed64297b17353312fcd4bb0, 78c107f9dfbc4d3483895dda0f791bb2; no voters:
I20260810 01:55:45.153710 23618 raft_consensus.cc:2804] T 7e1b884fb1e24b90a854a6a0d582d16e P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:55:45.153877 23618 raft_consensus.cc:493] T 7e1b884fb1e24b90a854a6a0d582d16e P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:55:45.153971 23618 raft_consensus.cc:3060] T 7e1b884fb1e24b90a854a6a0d582d16e P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:45.157032 23618 raft_consensus.cc:515] T 7e1b884fb1e24b90a854a6a0d582d16e P 5c71783cbed64297b17353312fcd4bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:45.158105 22209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1b884fb1e24b90a854a6a0d582d16e" candidate_uuid: "5c71783cbed64297b17353312fcd4bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78c107f9dfbc4d3483895dda0f791bb2"
I20260810 01:55:45.158102 22587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1b884fb1e24b90a854a6a0d582d16e" candidate_uuid: "5c71783cbed64297b17353312fcd4bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabe62238d32404097129ae02ed3b0b3"
I20260810 01:55:45.158280 22587 raft_consensus.cc:3060] T 7e1b884fb1e24b90a854a6a0d582d16e P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:45.158313 22209 raft_consensus.cc:3060] T 7e1b884fb1e24b90a854a6a0d582d16e P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:45.159353 23618 leader_election.cc:290] T 7e1b884fb1e24b90a854a6a0d582d16e P 5c71783cbed64297b17353312fcd4bb0 [CANDIDATE]: Term 1 election: Requested vote from peers 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194:33547), fabe62238d32404097129ae02ed3b0b3 (127.21.64.196:32931)
I20260810 01:55:45.160820 22209 raft_consensus.cc:2468] T 7e1b884fb1e24b90a854a6a0d582d16e P 78c107f9dfbc4d3483895dda0f791bb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c71783cbed64297b17353312fcd4bb0 in term 1.
I20260810 01:55:45.161266 22861 leader_election.cc:304] T 7e1b884fb1e24b90a854a6a0d582d16e P 5c71783cbed64297b17353312fcd4bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c71783cbed64297b17353312fcd4bb0, 78c107f9dfbc4d3483895dda0f791bb2; no voters:
I20260810 01:55:45.161392 22587 raft_consensus.cc:2468] T 7e1b884fb1e24b90a854a6a0d582d16e P fabe62238d32404097129ae02ed3b0b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c71783cbed64297b17353312fcd4bb0 in term 1.
I20260810 01:55:45.161638 23618 raft_consensus.cc:2804] T 7e1b884fb1e24b90a854a6a0d582d16e P 5c71783cbed64297b17353312fcd4bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:55:45.162212 23618 raft_consensus.cc:697] T 7e1b884fb1e24b90a854a6a0d582d16e P 5c71783cbed64297b17353312fcd4bb0 [term 1 LEADER]: Becoming Leader. State: Replica: 5c71783cbed64297b17353312fcd4bb0, State: Running, Role: LEADER
I20260810 01:55:45.162590 23618 consensus_queue.cc:237] T 7e1b884fb1e24b90a854a6a0d582d16e P 5c71783cbed64297b17353312fcd4bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:45.166582 21820 catalog_manager.cc:5719] T 7e1b884fb1e24b90a854a6a0d582d16e P 5c71783cbed64297b17353312fcd4bb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c71783cbed64297b17353312fcd4bb0 (127.21.64.198). New cstate: current_term: 1 leader_uuid: "5c71783cbed64297b17353312fcd4bb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } health_report { overall_health: HEALTHY } } }
I20260810 01:55:45.208444 23249 raft_consensus.cc:493] T 7436e2843ee4428887e108699ed25663 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:55:45.208664 23249 raft_consensus.cc:515] T 7436e2843ee4428887e108699ed25663 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:45.209309 23249 leader_election.cc:290] T 7436e2843ee4428887e108699ed25663 P fabe62238d32404097129ae02ed3b0b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194:33547), 5c71783cbed64297b17353312fcd4bb0 (127.21.64.198:33973)
I20260810 01:55:45.209848 22209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7436e2843ee4428887e108699ed25663" candidate_uuid: "fabe62238d32404097129ae02ed3b0b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78c107f9dfbc4d3483895dda0f791bb2" is_pre_election: true
I20260810 01:55:45.209960 22952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7436e2843ee4428887e108699ed25663" candidate_uuid: "fabe62238d32404097129ae02ed3b0b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c71783cbed64297b17353312fcd4bb0" is_pre_election: true
I20260810 01:55:45.210093 22209 raft_consensus.cc:2468] T 7436e2843ee4428887e108699ed25663 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabe62238d32404097129ae02ed3b0b3 in term 0.
I20260810 01:55:45.210274 22952 raft_consensus.cc:2468] T 7436e2843ee4428887e108699ed25663 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabe62238d32404097129ae02ed3b0b3 in term 0.
I20260810 01:55:45.210587 22502 leader_election.cc:304] T 7436e2843ee4428887e108699ed25663 P fabe62238d32404097129ae02ed3b0b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78c107f9dfbc4d3483895dda0f791bb2, fabe62238d32404097129ae02ed3b0b3; no voters:
I20260810 01:55:45.210883 23249 raft_consensus.cc:2804] T 7436e2843ee4428887e108699ed25663 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:55:45.211042 23249 raft_consensus.cc:493] T 7436e2843ee4428887e108699ed25663 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:55:45.211158 23249 raft_consensus.cc:3060] T 7436e2843ee4428887e108699ed25663 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:45.213420 23249 raft_consensus.cc:515] T 7436e2843ee4428887e108699ed25663 P fabe62238d32404097129ae02ed3b0b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:45.213941 23249 leader_election.cc:290] T 7436e2843ee4428887e108699ed25663 P fabe62238d32404097129ae02ed3b0b3 [CANDIDATE]: Term 1 election: Requested vote from peers 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194:33547), 5c71783cbed64297b17353312fcd4bb0 (127.21.64.198:33973)
I20260810 01:55:45.214461 22209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7436e2843ee4428887e108699ed25663" candidate_uuid: "fabe62238d32404097129ae02ed3b0b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78c107f9dfbc4d3483895dda0f791bb2"
I20260810 01:55:45.214566 22952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7436e2843ee4428887e108699ed25663" candidate_uuid: "fabe62238d32404097129ae02ed3b0b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c71783cbed64297b17353312fcd4bb0"
I20260810 01:55:45.214671 22209 raft_consensus.cc:3060] T 7436e2843ee4428887e108699ed25663 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:45.214812 22952 raft_consensus.cc:3060] T 7436e2843ee4428887e108699ed25663 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:45.216744 22952 raft_consensus.cc:2468] T 7436e2843ee4428887e108699ed25663 P 5c71783cbed64297b17353312fcd4bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabe62238d32404097129ae02ed3b0b3 in term 1.
I20260810 01:55:45.216720 22209 raft_consensus.cc:2468] T 7436e2843ee4428887e108699ed25663 P 78c107f9dfbc4d3483895dda0f791bb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabe62238d32404097129ae02ed3b0b3 in term 1.
I20260810 01:55:45.217139 22502 leader_election.cc:304] T 7436e2843ee4428887e108699ed25663 P fabe62238d32404097129ae02ed3b0b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c71783cbed64297b17353312fcd4bb0, fabe62238d32404097129ae02ed3b0b3; no voters:
I20260810 01:55:45.217527 23249 raft_consensus.cc:2804] T 7436e2843ee4428887e108699ed25663 P fabe62238d32404097129ae02ed3b0b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:55:45.217965 23249 raft_consensus.cc:697] T 7436e2843ee4428887e108699ed25663 P fabe62238d32404097129ae02ed3b0b3 [term 1 LEADER]: Becoming Leader. State: Replica: fabe62238d32404097129ae02ed3b0b3, State: Running, Role: LEADER
I20260810 01:55:45.218380 23249 consensus_queue.cc:237] T 7436e2843ee4428887e108699ed25663 P fabe62238d32404097129ae02ed3b0b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:45.221517 21820 catalog_manager.cc:5719] T 7436e2843ee4428887e108699ed25663 P fabe62238d32404097129ae02ed3b0b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to fabe62238d32404097129ae02ed3b0b3 (127.21.64.196). New cstate: current_term: 1 leader_uuid: "fabe62238d32404097129ae02ed3b0b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } health_report { overall_health: HEALTHY } } }
I20260810 01:55:45.381027 23107 raft_consensus.cc:493] T 7d1f61329cf44dfbb36cbf585bc56493 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:55:45.381266 23107 raft_consensus.cc:515] T 7d1f61329cf44dfbb36cbf585bc56493 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:45.382138 23107 leader_election.cc:290] T 7d1f61329cf44dfbb36cbf585bc56493 P c5ca831c32e4452dba1cfc6cd296e532 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687f288b7e9d4650a758d5451483e49b (127.21.64.197:37655), 65755ebc82864dc3a3193b1ba3870613 (127.21.64.195:46103)
I20260810 01:55:45.382643 22767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1f61329cf44dfbb36cbf585bc56493" candidate_uuid: "c5ca831c32e4452dba1cfc6cd296e532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687f288b7e9d4650a758d5451483e49b" is_pre_election: true
I20260810 01:55:45.382650 22391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1f61329cf44dfbb36cbf585bc56493" candidate_uuid: "c5ca831c32e4452dba1cfc6cd296e532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65755ebc82864dc3a3193b1ba3870613" is_pre_election: true
I20260810 01:55:45.382861 22767 raft_consensus.cc:2468] T 7d1f61329cf44dfbb36cbf585bc56493 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ca831c32e4452dba1cfc6cd296e532 in term 0.
I20260810 01:55:45.382896 22391 raft_consensus.cc:2468] T 7d1f61329cf44dfbb36cbf585bc56493 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ca831c32e4452dba1cfc6cd296e532 in term 0.
I20260810 01:55:45.383375 21930 leader_election.cc:304] T 7d1f61329cf44dfbb36cbf585bc56493 P c5ca831c32e4452dba1cfc6cd296e532 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687f288b7e9d4650a758d5451483e49b, c5ca831c32e4452dba1cfc6cd296e532; no voters:
I20260810 01:55:45.383687 23107 raft_consensus.cc:2804] T 7d1f61329cf44dfbb36cbf585bc56493 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:55:45.383817 23107 raft_consensus.cc:493] T 7d1f61329cf44dfbb36cbf585bc56493 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:55:45.383942 23107 raft_consensus.cc:3060] T 7d1f61329cf44dfbb36cbf585bc56493 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:45.386307 23107 raft_consensus.cc:515] T 7d1f61329cf44dfbb36cbf585bc56493 P c5ca831c32e4452dba1cfc6cd296e532 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:45.386917 23107 leader_election.cc:290] T 7d1f61329cf44dfbb36cbf585bc56493 P c5ca831c32e4452dba1cfc6cd296e532 [CANDIDATE]: Term 1 election: Requested vote from peers 687f288b7e9d4650a758d5451483e49b (127.21.64.197:37655), 65755ebc82864dc3a3193b1ba3870613 (127.21.64.195:46103)
I20260810 01:55:45.387269 22767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1f61329cf44dfbb36cbf585bc56493" candidate_uuid: "c5ca831c32e4452dba1cfc6cd296e532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687f288b7e9d4650a758d5451483e49b"
I20260810 01:55:45.387502 22767 raft_consensus.cc:3060] T 7d1f61329cf44dfbb36cbf585bc56493 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:45.387511 22391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1f61329cf44dfbb36cbf585bc56493" candidate_uuid: "c5ca831c32e4452dba1cfc6cd296e532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65755ebc82864dc3a3193b1ba3870613"
I20260810 01:55:45.387712 22391 raft_consensus.cc:3060] T 7d1f61329cf44dfbb36cbf585bc56493 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:45.389616 22767 raft_consensus.cc:2468] T 7d1f61329cf44dfbb36cbf585bc56493 P 687f288b7e9d4650a758d5451483e49b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ca831c32e4452dba1cfc6cd296e532 in term 1.
I20260810 01:55:45.389719 22391 raft_consensus.cc:2468] T 7d1f61329cf44dfbb36cbf585bc56493 P 65755ebc82864dc3a3193b1ba3870613 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ca831c32e4452dba1cfc6cd296e532 in term 1.
I20260810 01:55:45.390030 21930 leader_election.cc:304] T 7d1f61329cf44dfbb36cbf585bc56493 P c5ca831c32e4452dba1cfc6cd296e532 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687f288b7e9d4650a758d5451483e49b, c5ca831c32e4452dba1cfc6cd296e532; no voters:
I20260810 01:55:45.390326 23107 raft_consensus.cc:2804] T 7d1f61329cf44dfbb36cbf585bc56493 P c5ca831c32e4452dba1cfc6cd296e532 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:55:45.390479 23107 raft_consensus.cc:697] T 7d1f61329cf44dfbb36cbf585bc56493 P c5ca831c32e4452dba1cfc6cd296e532 [term 1 LEADER]: Becoming Leader. State: Replica: c5ca831c32e4452dba1cfc6cd296e532, State: Running, Role: LEADER
I20260810 01:55:45.390771 23107 consensus_queue.cc:237] T 7d1f61329cf44dfbb36cbf585bc56493 P c5ca831c32e4452dba1cfc6cd296e532 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:45.394120 21820 catalog_manager.cc:5719] T 7d1f61329cf44dfbb36cbf585bc56493 P c5ca831c32e4452dba1cfc6cd296e532 reported cstate change: term changed from 0 to 1, leader changed from <none> to c5ca831c32e4452dba1cfc6cd296e532 (127.21.64.193). New cstate: current_term: 1 leader_uuid: "c5ca831c32e4452dba1cfc6cd296e532" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } health_report { overall_health: UNKNOWN } } }
I20260810 01:55:45.634995 23618 consensus_queue.cc:1048] T 7e1b884fb1e24b90a854a6a0d582d16e P 5c71783cbed64297b17353312fcd4bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:45.661561 23709 consensus_queue.cc:1048] T 7436e2843ee4428887e108699ed25663 P fabe62238d32404097129ae02ed3b0b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:45.662034 23709 consensus_queue.cc:1048] T 7436e2843ee4428887e108699ed25663 P fabe62238d32404097129ae02ed3b0b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:45.669672 23365 consensus_queue.cc:1048] T 7e1b884fb1e24b90a854a6a0d582d16e P 5c71783cbed64297b17353312fcd4bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:45.883992 23107 consensus_queue.cc:1048] T 7d1f61329cf44dfbb36cbf585bc56493 P c5ca831c32e4452dba1cfc6cd296e532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:45.892663 23717 consensus_queue.cc:1048] T 7d1f61329cf44dfbb36cbf585bc56493 P c5ca831c32e4452dba1cfc6cd296e532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 01:55:45.902971 23719 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:55:45.903424 23719 flags.cc:432] Enabled unsafe flag: --never_fsync=true
Using table 'rebalance_test_table_5'
INSERT report
rows total: 2000
time total: 355.944 ms
time per row: 0.177972 ms
I20260810 01:55:46.497330 21826 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60594:
name: "rebalance_test_table_6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260810 01:55:46.507798 22739 tablet_service.cc:1511] Processing CreateTablet for tablet fe76acfea4c64d9985e2fe554c0414b8 (DEFAULT_TABLE table=rebalance_test_table_6 [id=148731fac3e147de9b7600ac9d70a434]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:46.507823 21995 tablet_service.cc:1511] Processing CreateTablet for tablet fe76acfea4c64d9985e2fe554c0414b8 (DEFAULT_TABLE table=rebalance_test_table_6 [id=148731fac3e147de9b7600ac9d70a434]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:46.508168 22363 tablet_service.cc:1511] Processing CreateTablet for tablet fe76acfea4c64d9985e2fe554c0414b8 (DEFAULT_TABLE table=rebalance_test_table_6 [id=148731fac3e147de9b7600ac9d70a434]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:46.508344 22739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe76acfea4c64d9985e2fe554c0414b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:46.508358 21995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe76acfea4c64d9985e2fe554c0414b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:46.508589 22363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe76acfea4c64d9985e2fe554c0414b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:46.510632 22364 tablet_service.cc:1511] Processing CreateTablet for tablet b2ee0c4723ab4043947371e655488eae (DEFAULT_TABLE table=rebalance_test_table_6 [id=148731fac3e147de9b7600ac9d70a434]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:46.510862 21994 tablet_service.cc:1511] Processing CreateTablet for tablet b2ee0c4723ab4043947371e655488eae (DEFAULT_TABLE table=rebalance_test_table_6 [id=148731fac3e147de9b7600ac9d70a434]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:46.511040 22364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2ee0c4723ab4043947371e655488eae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:46.511226 21994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2ee0c4723ab4043947371e655488eae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:46.514027 22181 tablet_service.cc:1511] Processing CreateTablet for tablet dfa2ad0ddcec4fb19c574b24af26a9c8 (DEFAULT_TABLE table=rebalance_test_table_6 [id=148731fac3e147de9b7600ac9d70a434]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:46.514488 22181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfa2ad0ddcec4fb19c574b24af26a9c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:46.517877 22921 tablet_service.cc:1511] Processing CreateTablet for tablet dfa2ad0ddcec4fb19c574b24af26a9c8 (DEFAULT_TABLE table=rebalance_test_table_6 [id=148731fac3e147de9b7600ac9d70a434]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:46.518319 22921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfa2ad0ddcec4fb19c574b24af26a9c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:46.519507 22740 tablet_service.cc:1511] Processing CreateTablet for tablet b2ee0c4723ab4043947371e655488eae (DEFAULT_TABLE table=rebalance_test_table_6 [id=148731fac3e147de9b7600ac9d70a434]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:46.519902 22740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2ee0c4723ab4043947371e655488eae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:46.522720 22558 tablet_service.cc:1511] Processing CreateTablet for tablet dfa2ad0ddcec4fb19c574b24af26a9c8 (DEFAULT_TABLE table=rebalance_test_table_6 [id=148731fac3e147de9b7600ac9d70a434]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:46.523141 22558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfa2ad0ddcec4fb19c574b24af26a9c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:46.530158 23812 tablet_bootstrap.cc:492] T fe76acfea4c64d9985e2fe554c0414b8 P c5ca831c32e4452dba1cfc6cd296e532: Bootstrap starting.
I20260810 01:55:46.530792 23811 tablet_bootstrap.cc:492] T b2ee0c4723ab4043947371e655488eae P 65755ebc82864dc3a3193b1ba3870613: Bootstrap starting.
I20260810 01:55:46.532795 23812 tablet_bootstrap.cc:654] T fe76acfea4c64d9985e2fe554c0414b8 P c5ca831c32e4452dba1cfc6cd296e532: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:46.533241 23811 tablet_bootstrap.cc:654] T b2ee0c4723ab4043947371e655488eae P 65755ebc82864dc3a3193b1ba3870613: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:46.542555 23815 tablet_bootstrap.cc:492] T b2ee0c4723ab4043947371e655488eae P 687f288b7e9d4650a758d5451483e49b: Bootstrap starting.
I20260810 01:55:46.542675 23811 tablet_bootstrap.cc:492] T b2ee0c4723ab4043947371e655488eae P 65755ebc82864dc3a3193b1ba3870613: No bootstrap required, opened a new log
I20260810 01:55:46.542846 23811 ts_tablet_manager.cc:1403] T b2ee0c4723ab4043947371e655488eae P 65755ebc82864dc3a3193b1ba3870613: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.008s
I20260810 01:55:46.543073 23817 tablet_bootstrap.cc:492] T dfa2ad0ddcec4fb19c574b24af26a9c8 P 78c107f9dfbc4d3483895dda0f791bb2: Bootstrap starting.
I20260810 01:55:46.543771 23811 raft_consensus.cc:359] T b2ee0c4723ab4043947371e655488eae P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } }
I20260810 01:55:46.543992 23811 raft_consensus.cc:385] T b2ee0c4723ab4043947371e655488eae P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:46.544100 23811 raft_consensus.cc:740] T b2ee0c4723ab4043947371e655488eae P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65755ebc82864dc3a3193b1ba3870613, State: Initialized, Role: FOLLOWER
I20260810 01:55:46.544886 23823 tablet_bootstrap.cc:492] T dfa2ad0ddcec4fb19c574b24af26a9c8 P 5c71783cbed64297b17353312fcd4bb0: Bootstrap starting.
I20260810 01:55:46.545291 23815 tablet_bootstrap.cc:654] T b2ee0c4723ab4043947371e655488eae P 687f288b7e9d4650a758d5451483e49b: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:46.545598 23822 tablet_bootstrap.cc:492] T dfa2ad0ddcec4fb19c574b24af26a9c8 P fabe62238d32404097129ae02ed3b0b3: Bootstrap starting.
I20260810 01:55:46.545778 23812 tablet_bootstrap.cc:492] T fe76acfea4c64d9985e2fe554c0414b8 P c5ca831c32e4452dba1cfc6cd296e532: No bootstrap required, opened a new log
I20260810 01:55:46.545935 23812 ts_tablet_manager.cc:1403] T fe76acfea4c64d9985e2fe554c0414b8 P c5ca831c32e4452dba1cfc6cd296e532: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.007s
I20260810 01:55:46.544438 23811 consensus_queue.cc:260] T b2ee0c4723ab4043947371e655488eae P 65755ebc82864dc3a3193b1ba3870613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } }
I20260810 01:55:46.546802 23811 ts_tablet_manager.cc:1434] T b2ee0c4723ab4043947371e655488eae P 65755ebc82864dc3a3193b1ba3870613: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260810 01:55:46.547269 23811 tablet_bootstrap.cc:492] T fe76acfea4c64d9985e2fe554c0414b8 P 65755ebc82864dc3a3193b1ba3870613: Bootstrap starting.
I20260810 01:55:46.547884 23812 raft_consensus.cc:359] T fe76acfea4c64d9985e2fe554c0414b8 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:46.548172 23812 raft_consensus.cc:385] T fe76acfea4c64d9985e2fe554c0414b8 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:46.548352 23812 raft_consensus.cc:740] T fe76acfea4c64d9985e2fe554c0414b8 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ca831c32e4452dba1cfc6cd296e532, State: Initialized, Role: FOLLOWER
I20260810 01:55:46.548748 23812 consensus_queue.cc:260] T fe76acfea4c64d9985e2fe554c0414b8 P c5ca831c32e4452dba1cfc6cd296e532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:46.549590 23812 ts_tablet_manager.cc:1434] T fe76acfea4c64d9985e2fe554c0414b8 P c5ca831c32e4452dba1cfc6cd296e532: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 01:55:46.550359 23811 tablet_bootstrap.cc:654] T fe76acfea4c64d9985e2fe554c0414b8 P 65755ebc82864dc3a3193b1ba3870613: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:46.552014 23812 tablet_bootstrap.cc:492] T b2ee0c4723ab4043947371e655488eae P c5ca831c32e4452dba1cfc6cd296e532: Bootstrap starting.
I20260810 01:55:46.554265 23812 tablet_bootstrap.cc:654] T b2ee0c4723ab4043947371e655488eae P c5ca831c32e4452dba1cfc6cd296e532: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:46.554699 23811 tablet_bootstrap.cc:492] T fe76acfea4c64d9985e2fe554c0414b8 P 65755ebc82864dc3a3193b1ba3870613: No bootstrap required, opened a new log
I20260810 01:55:46.554913 23811 ts_tablet_manager.cc:1403] T fe76acfea4c64d9985e2fe554c0414b8 P 65755ebc82864dc3a3193b1ba3870613: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.006s
I20260810 01:55:46.555853 23823 tablet_bootstrap.cc:654] T dfa2ad0ddcec4fb19c574b24af26a9c8 P 5c71783cbed64297b17353312fcd4bb0: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:46.555989 23811 raft_consensus.cc:359] T fe76acfea4c64d9985e2fe554c0414b8 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:46.556303 23811 raft_consensus.cc:385] T fe76acfea4c64d9985e2fe554c0414b8 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:46.556447 23811 raft_consensus.cc:740] T fe76acfea4c64d9985e2fe554c0414b8 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65755ebc82864dc3a3193b1ba3870613, State: Initialized, Role: FOLLOWER
I20260810 01:55:46.556825 23811 consensus_queue.cc:260] T fe76acfea4c64d9985e2fe554c0414b8 P 65755ebc82864dc3a3193b1ba3870613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:46.557420 23817 tablet_bootstrap.cc:654] T dfa2ad0ddcec4fb19c574b24af26a9c8 P 78c107f9dfbc4d3483895dda0f791bb2: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:46.557427 23811 ts_tablet_manager.cc:1434] T fe76acfea4c64d9985e2fe554c0414b8 P 65755ebc82864dc3a3193b1ba3870613: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 01:55:46.551716 23822 tablet_bootstrap.cc:654] T dfa2ad0ddcec4fb19c574b24af26a9c8 P fabe62238d32404097129ae02ed3b0b3: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:46.559219 23812 tablet_bootstrap.cc:492] T b2ee0c4723ab4043947371e655488eae P c5ca831c32e4452dba1cfc6cd296e532: No bootstrap required, opened a new log
I20260810 01:55:46.559491 23812 ts_tablet_manager.cc:1403] T b2ee0c4723ab4043947371e655488eae P c5ca831c32e4452dba1cfc6cd296e532: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260810 01:55:46.561388 23812 raft_consensus.cc:359] T b2ee0c4723ab4043947371e655488eae P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } }
I20260810 01:55:46.561781 23812 raft_consensus.cc:385] T b2ee0c4723ab4043947371e655488eae P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:46.561916 23812 raft_consensus.cc:740] T b2ee0c4723ab4043947371e655488eae P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ca831c32e4452dba1cfc6cd296e532, State: Initialized, Role: FOLLOWER
I20260810 01:55:46.562338 23812 consensus_queue.cc:260] T b2ee0c4723ab4043947371e655488eae P c5ca831c32e4452dba1cfc6cd296e532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } }
I20260810 01:55:46.563333 23812 ts_tablet_manager.cc:1434] T b2ee0c4723ab4043947371e655488eae P c5ca831c32e4452dba1cfc6cd296e532: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260810 01:55:46.564947 23823 tablet_bootstrap.cc:492] T dfa2ad0ddcec4fb19c574b24af26a9c8 P 5c71783cbed64297b17353312fcd4bb0: No bootstrap required, opened a new log
I20260810 01:55:46.565196 23823 ts_tablet_manager.cc:1403] T dfa2ad0ddcec4fb19c574b24af26a9c8 P 5c71783cbed64297b17353312fcd4bb0: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.002s
I20260810 01:55:46.567299 23823 raft_consensus.cc:359] T dfa2ad0ddcec4fb19c574b24af26a9c8 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:46.567610 23823 raft_consensus.cc:385] T dfa2ad0ddcec4fb19c574b24af26a9c8 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:46.567772 23823 raft_consensus.cc:740] T dfa2ad0ddcec4fb19c574b24af26a9c8 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c71783cbed64297b17353312fcd4bb0, State: Initialized, Role: FOLLOWER
I20260810 01:55:46.568151 23823 consensus_queue.cc:260] T dfa2ad0ddcec4fb19c574b24af26a9c8 P 5c71783cbed64297b17353312fcd4bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:46.568967 23822 tablet_bootstrap.cc:492] T dfa2ad0ddcec4fb19c574b24af26a9c8 P fabe62238d32404097129ae02ed3b0b3: No bootstrap required, opened a new log
I20260810 01:55:46.569165 23822 ts_tablet_manager.cc:1403] T dfa2ad0ddcec4fb19c574b24af26a9c8 P fabe62238d32404097129ae02ed3b0b3: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.007s
I20260810 01:55:46.570281 23815 tablet_bootstrap.cc:492] T b2ee0c4723ab4043947371e655488eae P 687f288b7e9d4650a758d5451483e49b: No bootstrap required, opened a new log
I20260810 01:55:46.570232 23822 raft_consensus.cc:359] T dfa2ad0ddcec4fb19c574b24af26a9c8 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:46.570508 23815 ts_tablet_manager.cc:1403] T b2ee0c4723ab4043947371e655488eae P 687f288b7e9d4650a758d5451483e49b: Time spent bootstrapping tablet: real 0.028s user 0.007s sys 0.004s
I20260810 01:55:46.570572 23822 raft_consensus.cc:385] T dfa2ad0ddcec4fb19c574b24af26a9c8 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:46.570732 23822 raft_consensus.cc:740] T dfa2ad0ddcec4fb19c574b24af26a9c8 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabe62238d32404097129ae02ed3b0b3, State: Initialized, Role: FOLLOWER
I20260810 01:55:46.571205 23822 consensus_queue.cc:260] T dfa2ad0ddcec4fb19c574b24af26a9c8 P fabe62238d32404097129ae02ed3b0b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:46.572032 23822 ts_tablet_manager.cc:1434] T dfa2ad0ddcec4fb19c574b24af26a9c8 P fabe62238d32404097129ae02ed3b0b3: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 01:55:46.572101 23823 ts_tablet_manager.cc:1434] T dfa2ad0ddcec4fb19c574b24af26a9c8 P 5c71783cbed64297b17353312fcd4bb0: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260810 01:55:46.572685 23815 raft_consensus.cc:359] T b2ee0c4723ab4043947371e655488eae P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } }
I20260810 01:55:46.573066 23815 raft_consensus.cc:385] T b2ee0c4723ab4043947371e655488eae P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:46.573213 23815 raft_consensus.cc:740] T b2ee0c4723ab4043947371e655488eae P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687f288b7e9d4650a758d5451483e49b, State: Initialized, Role: FOLLOWER
I20260810 01:55:46.573627 23815 consensus_queue.cc:260] T b2ee0c4723ab4043947371e655488eae P 687f288b7e9d4650a758d5451483e49b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } }
I20260810 01:55:46.574575 23815 ts_tablet_manager.cc:1434] T b2ee0c4723ab4043947371e655488eae P 687f288b7e9d4650a758d5451483e49b: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260810 01:55:46.574968 23815 tablet_bootstrap.cc:492] T fe76acfea4c64d9985e2fe554c0414b8 P 687f288b7e9d4650a758d5451483e49b: Bootstrap starting.
I20260810 01:55:46.577019 23817 tablet_bootstrap.cc:492] T dfa2ad0ddcec4fb19c574b24af26a9c8 P 78c107f9dfbc4d3483895dda0f791bb2: No bootstrap required, opened a new log
I20260810 01:55:46.577255 23817 ts_tablet_manager.cc:1403] T dfa2ad0ddcec4fb19c574b24af26a9c8 P 78c107f9dfbc4d3483895dda0f791bb2: Time spent bootstrapping tablet: real 0.034s user 0.009s sys 0.009s
I20260810 01:55:46.578065 23815 tablet_bootstrap.cc:654] T fe76acfea4c64d9985e2fe554c0414b8 P 687f288b7e9d4650a758d5451483e49b: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:46.578354 23817 raft_consensus.cc:359] T dfa2ad0ddcec4fb19c574b24af26a9c8 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:46.578649 23817 raft_consensus.cc:385] T dfa2ad0ddcec4fb19c574b24af26a9c8 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:46.578814 23817 raft_consensus.cc:740] T dfa2ad0ddcec4fb19c574b24af26a9c8 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78c107f9dfbc4d3483895dda0f791bb2, State: Initialized, Role: FOLLOWER
I20260810 01:55:46.579221 23817 consensus_queue.cc:260] T dfa2ad0ddcec4fb19c574b24af26a9c8 P 78c107f9dfbc4d3483895dda0f791bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:46.579876 23817 ts_tablet_manager.cc:1434] T dfa2ad0ddcec4fb19c574b24af26a9c8 P 78c107f9dfbc4d3483895dda0f791bb2: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 01:55:46.580035 23212 raft_consensus.cc:493] T fe76acfea4c64d9985e2fe554c0414b8 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:55:46.580226 23212 raft_consensus.cc:515] T fe76acfea4c64d9985e2fe554c0414b8 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:46.581001 23212 leader_election.cc:290] T fe76acfea4c64d9985e2fe554c0414b8 P 65755ebc82864dc3a3193b1ba3870613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687f288b7e9d4650a758d5451483e49b (127.21.64.197:37655), c5ca831c32e4452dba1cfc6cd296e532 (127.21.64.193:39917)
I20260810 01:55:46.581537 22026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe76acfea4c64d9985e2fe554c0414b8" candidate_uuid: "65755ebc82864dc3a3193b1ba3870613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ca831c32e4452dba1cfc6cd296e532" is_pre_election: true
I20260810 01:55:46.581744 22767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe76acfea4c64d9985e2fe554c0414b8" candidate_uuid: "65755ebc82864dc3a3193b1ba3870613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687f288b7e9d4650a758d5451483e49b" is_pre_election: true
I20260810 01:55:46.581780 22026 raft_consensus.cc:2468] T fe76acfea4c64d9985e2fe554c0414b8 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65755ebc82864dc3a3193b1ba3870613 in term 0.
I20260810 01:55:46.582417 22297 leader_election.cc:304] T fe76acfea4c64d9985e2fe554c0414b8 P 65755ebc82864dc3a3193b1ba3870613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65755ebc82864dc3a3193b1ba3870613, c5ca831c32e4452dba1cfc6cd296e532; no voters:
I20260810 01:55:46.582664 23815 tablet_bootstrap.cc:492] T fe76acfea4c64d9985e2fe554c0414b8 P 687f288b7e9d4650a758d5451483e49b: No bootstrap required, opened a new log
I20260810 01:55:46.582791 23212 raft_consensus.cc:2804] T fe76acfea4c64d9985e2fe554c0414b8 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:55:46.582911 23212 raft_consensus.cc:493] T fe76acfea4c64d9985e2fe554c0414b8 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:55:46.583035 23815 ts_tablet_manager.cc:1403] T fe76acfea4c64d9985e2fe554c0414b8 P 687f288b7e9d4650a758d5451483e49b: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260810 01:55:46.583041 23212 raft_consensus.cc:3060] T fe76acfea4c64d9985e2fe554c0414b8 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Advancing to term 1
W20260810 01:55:46.582994 22294 leader_election.cc:343] T fe76acfea4c64d9985e2fe554c0414b8 P 65755ebc82864dc3a3193b1ba3870613 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 687f288b7e9d4650a758d5451483e49b (127.21.64.197:37655): Illegal state: must be running to vote when last-logged opid is not known
I20260810 01:55:46.583984 23815 raft_consensus.cc:359] T fe76acfea4c64d9985e2fe554c0414b8 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:46.584223 23815 raft_consensus.cc:385] T fe76acfea4c64d9985e2fe554c0414b8 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:46.584309 23815 raft_consensus.cc:740] T fe76acfea4c64d9985e2fe554c0414b8 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687f288b7e9d4650a758d5451483e49b, State: Initialized, Role: FOLLOWER
I20260810 01:55:46.584584 23815 consensus_queue.cc:260] T fe76acfea4c64d9985e2fe554c0414b8 P 687f288b7e9d4650a758d5451483e49b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:46.585072 23815 ts_tablet_manager.cc:1434] T fe76acfea4c64d9985e2fe554c0414b8 P 687f288b7e9d4650a758d5451483e49b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 01:55:46.585775 23212 raft_consensus.cc:515] T fe76acfea4c64d9985e2fe554c0414b8 P 65755ebc82864dc3a3193b1ba3870613 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:46.586880 22767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe76acfea4c64d9985e2fe554c0414b8" candidate_uuid: "65755ebc82864dc3a3193b1ba3870613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687f288b7e9d4650a758d5451483e49b"
I20260810 01:55:46.586922 22026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe76acfea4c64d9985e2fe554c0414b8" candidate_uuid: "65755ebc82864dc3a3193b1ba3870613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ca831c32e4452dba1cfc6cd296e532"
I20260810 01:55:46.587092 22767 raft_consensus.cc:3060] T fe76acfea4c64d9985e2fe554c0414b8 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:46.587106 22026 raft_consensus.cc:3060] T fe76acfea4c64d9985e2fe554c0414b8 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:46.589201 23836 raft_consensus.cc:493] T b2ee0c4723ab4043947371e655488eae P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:55:46.589550 22767 raft_consensus.cc:2468] T fe76acfea4c64d9985e2fe554c0414b8 P 687f288b7e9d4650a758d5451483e49b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65755ebc82864dc3a3193b1ba3870613 in term 1.
I20260810 01:55:46.589454 23836 raft_consensus.cc:515] T b2ee0c4723ab4043947371e655488eae P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } }
I20260810 01:55:46.589630 22026 raft_consensus.cc:2468] T fe76acfea4c64d9985e2fe554c0414b8 P c5ca831c32e4452dba1cfc6cd296e532 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65755ebc82864dc3a3193b1ba3870613 in term 1.
I20260810 01:55:46.590067 22294 leader_election.cc:304] T fe76acfea4c64d9985e2fe554c0414b8 P 65755ebc82864dc3a3193b1ba3870613 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65755ebc82864dc3a3193b1ba3870613, 687f288b7e9d4650a758d5451483e49b; no voters:
I20260810 01:55:46.590286 23836 leader_election.cc:290] T b2ee0c4723ab4043947371e655488eae P 65755ebc82864dc3a3193b1ba3870613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ca831c32e4452dba1cfc6cd296e532 (127.21.64.193:39917), 687f288b7e9d4650a758d5451483e49b (127.21.64.197:37655)
I20260810 01:55:46.590458 23836 raft_consensus.cc:2804] T fe76acfea4c64d9985e2fe554c0414b8 P 65755ebc82864dc3a3193b1ba3870613 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:55:46.590662 23836 raft_consensus.cc:697] T fe76acfea4c64d9985e2fe554c0414b8 P 65755ebc82864dc3a3193b1ba3870613 [term 1 LEADER]: Becoming Leader. State: Replica: 65755ebc82864dc3a3193b1ba3870613, State: Running, Role: LEADER
I20260810 01:55:46.591058 23836 consensus_queue.cc:237] T fe76acfea4c64d9985e2fe554c0414b8 P 65755ebc82864dc3a3193b1ba3870613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } }
I20260810 01:55:46.592428 23212 leader_election.cc:290] T fe76acfea4c64d9985e2fe554c0414b8 P 65755ebc82864dc3a3193b1ba3870613 [CANDIDATE]: Term 1 election: Requested vote from peers 687f288b7e9d4650a758d5451483e49b (127.21.64.197:37655), c5ca831c32e4452dba1cfc6cd296e532 (127.21.64.193:39917)
I20260810 01:55:46.592548 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ee0c4723ab4043947371e655488eae" candidate_uuid: "65755ebc82864dc3a3193b1ba3870613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ca831c32e4452dba1cfc6cd296e532" is_pre_election: true
I20260810 01:55:46.592839 22024 raft_consensus.cc:2468] T b2ee0c4723ab4043947371e655488eae P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65755ebc82864dc3a3193b1ba3870613 in term 0.
I20260810 01:55:46.593631 22297 leader_election.cc:304] T b2ee0c4723ab4043947371e655488eae P 65755ebc82864dc3a3193b1ba3870613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65755ebc82864dc3a3193b1ba3870613, c5ca831c32e4452dba1cfc6cd296e532; no voters:
I20260810 01:55:46.593976 23836 raft_consensus.cc:2804] T b2ee0c4723ab4043947371e655488eae P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:55:46.594055 23836 raft_consensus.cc:493] T b2ee0c4723ab4043947371e655488eae P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:55:46.594200 23836 raft_consensus.cc:3060] T b2ee0c4723ab4043947371e655488eae P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:46.594381 22767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ee0c4723ab4043947371e655488eae" candidate_uuid: "65755ebc82864dc3a3193b1ba3870613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687f288b7e9d4650a758d5451483e49b" is_pre_election: true
I20260810 01:55:46.594640 22767 raft_consensus.cc:2468] T b2ee0c4723ab4043947371e655488eae P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65755ebc82864dc3a3193b1ba3870613 in term 0.
I20260810 01:55:46.595228 21815 catalog_manager.cc:5719] T fe76acfea4c64d9985e2fe554c0414b8 P 65755ebc82864dc3a3193b1ba3870613 reported cstate change: term changed from 0 to 1, leader changed from <none> to 65755ebc82864dc3a3193b1ba3870613 (127.21.64.195). New cstate: current_term: 1 leader_uuid: "65755ebc82864dc3a3193b1ba3870613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } health_report { overall_health: HEALTHY } } }
I20260810 01:55:46.596642 23836 raft_consensus.cc:515] T b2ee0c4723ab4043947371e655488eae P 65755ebc82864dc3a3193b1ba3870613 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } }
I20260810 01:55:46.597143 23836 leader_election.cc:290] T b2ee0c4723ab4043947371e655488eae P 65755ebc82864dc3a3193b1ba3870613 [CANDIDATE]: Term 1 election: Requested vote from peers c5ca831c32e4452dba1cfc6cd296e532 (127.21.64.193:39917), 687f288b7e9d4650a758d5451483e49b (127.21.64.197:37655)
I20260810 01:55:46.597733 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ee0c4723ab4043947371e655488eae" candidate_uuid: "65755ebc82864dc3a3193b1ba3870613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ca831c32e4452dba1cfc6cd296e532"
I20260810 01:55:46.597931 22024 raft_consensus.cc:3060] T b2ee0c4723ab4043947371e655488eae P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:46.598948 22767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ee0c4723ab4043947371e655488eae" candidate_uuid: "65755ebc82864dc3a3193b1ba3870613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687f288b7e9d4650a758d5451483e49b"
I20260810 01:55:46.599108 22767 raft_consensus.cc:3060] T b2ee0c4723ab4043947371e655488eae P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:46.600354 22024 raft_consensus.cc:2468] T b2ee0c4723ab4043947371e655488eae P c5ca831c32e4452dba1cfc6cd296e532 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65755ebc82864dc3a3193b1ba3870613 in term 1.
I20260810 01:55:46.600826 22297 leader_election.cc:304] T b2ee0c4723ab4043947371e655488eae P 65755ebc82864dc3a3193b1ba3870613 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65755ebc82864dc3a3193b1ba3870613, c5ca831c32e4452dba1cfc6cd296e532; no voters:
I20260810 01:55:46.601070 22767 raft_consensus.cc:2468] T b2ee0c4723ab4043947371e655488eae P 687f288b7e9d4650a758d5451483e49b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65755ebc82864dc3a3193b1ba3870613 in term 1.
I20260810 01:55:46.601248 23836 raft_consensus.cc:2804] T b2ee0c4723ab4043947371e655488eae P 65755ebc82864dc3a3193b1ba3870613 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:55:46.601639 23836 raft_consensus.cc:697] T b2ee0c4723ab4043947371e655488eae P 65755ebc82864dc3a3193b1ba3870613 [term 1 LEADER]: Becoming Leader. State: Replica: 65755ebc82864dc3a3193b1ba3870613, State: Running, Role: LEADER
I20260810 01:55:46.601914 23836 consensus_queue.cc:237] T b2ee0c4723ab4043947371e655488eae P 65755ebc82864dc3a3193b1ba3870613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } }
I20260810 01:55:46.604768 21815 catalog_manager.cc:5719] T b2ee0c4723ab4043947371e655488eae P 65755ebc82864dc3a3193b1ba3870613 reported cstate change: term changed from 0 to 1, leader changed from <none> to 65755ebc82864dc3a3193b1ba3870613 (127.21.64.195). New cstate: current_term: 1 leader_uuid: "65755ebc82864dc3a3193b1ba3870613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } health_report { overall_health: UNKNOWN } } }
I20260810 01:55:46.627496 23249 raft_consensus.cc:493] T dfa2ad0ddcec4fb19c574b24af26a9c8 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:55:46.627753 23249 raft_consensus.cc:515] T dfa2ad0ddcec4fb19c574b24af26a9c8 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:46.628561 23249 leader_election.cc:290] T dfa2ad0ddcec4fb19c574b24af26a9c8 P fabe62238d32404097129ae02ed3b0b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194:33547), 5c71783cbed64297b17353312fcd4bb0 (127.21.64.198:33973)
I20260810 01:55:46.629168 22952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa2ad0ddcec4fb19c574b24af26a9c8" candidate_uuid: "fabe62238d32404097129ae02ed3b0b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c71783cbed64297b17353312fcd4bb0" is_pre_election: true
I20260810 01:55:46.629179 22207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa2ad0ddcec4fb19c574b24af26a9c8" candidate_uuid: "fabe62238d32404097129ae02ed3b0b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78c107f9dfbc4d3483895dda0f791bb2" is_pre_election: true
I20260810 01:55:46.629418 22207 raft_consensus.cc:2468] T dfa2ad0ddcec4fb19c574b24af26a9c8 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabe62238d32404097129ae02ed3b0b3 in term 0.
I20260810 01:55:46.629467 22952 raft_consensus.cc:2468] T dfa2ad0ddcec4fb19c574b24af26a9c8 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabe62238d32404097129ae02ed3b0b3 in term 0.
I20260810 01:55:46.629983 22502 leader_election.cc:304] T dfa2ad0ddcec4fb19c574b24af26a9c8 P fabe62238d32404097129ae02ed3b0b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78c107f9dfbc4d3483895dda0f791bb2, fabe62238d32404097129ae02ed3b0b3; no voters:
I20260810 01:55:46.630354 23249 raft_consensus.cc:2804] T dfa2ad0ddcec4fb19c574b24af26a9c8 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:55:46.630463 23249 raft_consensus.cc:493] T dfa2ad0ddcec4fb19c574b24af26a9c8 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:55:46.630586 23249 raft_consensus.cc:3060] T dfa2ad0ddcec4fb19c574b24af26a9c8 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:46.632604 23249 raft_consensus.cc:515] T dfa2ad0ddcec4fb19c574b24af26a9c8 P fabe62238d32404097129ae02ed3b0b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:46.633378 23249 leader_election.cc:290] T dfa2ad0ddcec4fb19c574b24af26a9c8 P fabe62238d32404097129ae02ed3b0b3 [CANDIDATE]: Term 1 election: Requested vote from peers 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194:33547), 5c71783cbed64297b17353312fcd4bb0 (127.21.64.198:33973)
I20260810 01:55:46.633769 22207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa2ad0ddcec4fb19c574b24af26a9c8" candidate_uuid: "fabe62238d32404097129ae02ed3b0b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78c107f9dfbc4d3483895dda0f791bb2"
I20260810 01:55:46.633917 22952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa2ad0ddcec4fb19c574b24af26a9c8" candidate_uuid: "fabe62238d32404097129ae02ed3b0b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c71783cbed64297b17353312fcd4bb0"
I20260810 01:55:46.633994 22207 raft_consensus.cc:3060] T dfa2ad0ddcec4fb19c574b24af26a9c8 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:46.634116 22952 raft_consensus.cc:3060] T dfa2ad0ddcec4fb19c574b24af26a9c8 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:46.636323 22207 raft_consensus.cc:2468] T dfa2ad0ddcec4fb19c574b24af26a9c8 P 78c107f9dfbc4d3483895dda0f791bb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabe62238d32404097129ae02ed3b0b3 in term 1.
I20260810 01:55:46.636772 22502 leader_election.cc:304] T dfa2ad0ddcec4fb19c574b24af26a9c8 P fabe62238d32404097129ae02ed3b0b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78c107f9dfbc4d3483895dda0f791bb2, fabe62238d32404097129ae02ed3b0b3; no voters:
I20260810 01:55:46.637051 23249 raft_consensus.cc:2804] T dfa2ad0ddcec4fb19c574b24af26a9c8 P fabe62238d32404097129ae02ed3b0b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:55:46.637137 22952 raft_consensus.cc:2468] T dfa2ad0ddcec4fb19c574b24af26a9c8 P 5c71783cbed64297b17353312fcd4bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabe62238d32404097129ae02ed3b0b3 in term 1.
I20260810 01:55:46.637303 23249 raft_consensus.cc:697] T dfa2ad0ddcec4fb19c574b24af26a9c8 P fabe62238d32404097129ae02ed3b0b3 [term 1 LEADER]: Becoming Leader. State: Replica: fabe62238d32404097129ae02ed3b0b3, State: Running, Role: LEADER
I20260810 01:55:46.637593 23249 consensus_queue.cc:237] T dfa2ad0ddcec4fb19c574b24af26a9c8 P fabe62238d32404097129ae02ed3b0b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:46.640904 21815 catalog_manager.cc:5719] T dfa2ad0ddcec4fb19c574b24af26a9c8 P fabe62238d32404097129ae02ed3b0b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to fabe62238d32404097129ae02ed3b0b3 (127.21.64.196). New cstate: current_term: 1 leader_uuid: "fabe62238d32404097129ae02ed3b0b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } health_report { overall_health: UNKNOWN } } }
I20260810 01:55:47.019893 23836 consensus_queue.cc:1048] T b2ee0c4723ab4043947371e655488eae P 65755ebc82864dc3a3193b1ba3870613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:47.027617 23836 consensus_queue.cc:1048] T b2ee0c4723ab4043947371e655488eae P 65755ebc82864dc3a3193b1ba3870613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:47.031631 23249 consensus_queue.cc:1048] T dfa2ad0ddcec4fb19c574b24af26a9c8 P fabe62238d32404097129ae02ed3b0b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:47.046775 23709 consensus_queue.cc:1048] T dfa2ad0ddcec4fb19c574b24af26a9c8 P fabe62238d32404097129ae02ed3b0b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:47.066931 23836 consensus_queue.cc:1048] T fe76acfea4c64d9985e2fe554c0414b8 P 65755ebc82864dc3a3193b1ba3870613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:47.072294 23837 consensus_queue.cc:1048] T fe76acfea4c64d9985e2fe554c0414b8 P 65755ebc82864dc3a3193b1ba3870613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 01:55:47.083592 23845 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:55:47.084092 23845 flags.cc:432] Enabled unsafe flag: --never_fsync=true
Using table 'rebalance_test_table_6'
INSERT report
rows total: 2000
time total: 303.499 ms
time per row: 0.151749 ms
I20260810 01:55:47.655330 21815 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60594:
name: "rebalance_test_table_7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260810 01:55:47.679035 22921 tablet_service.cc:1511] Processing CreateTablet for tablet 70ababa88c614a8487937414d3d01c09 (DEFAULT_TABLE table=rebalance_test_table_7 [id=3a054cbae18b4be299041537b6a6b139]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:47.679522 22921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70ababa88c614a8487937414d3d01c09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:47.679512 22181 tablet_service.cc:1511] Processing CreateTablet for tablet 70ababa88c614a8487937414d3d01c09 (DEFAULT_TABLE table=rebalance_test_table_7 [id=3a054cbae18b4be299041537b6a6b139]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:47.679993 22181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70ababa88c614a8487937414d3d01c09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:47.680052 22558 tablet_service.cc:1511] Processing CreateTablet for tablet 70ababa88c614a8487937414d3d01c09 (DEFAULT_TABLE table=rebalance_test_table_7 [id=3a054cbae18b4be299041537b6a6b139]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:47.680469 22558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70ababa88c614a8487937414d3d01c09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:47.682775 22178 tablet_service.cc:1511] Processing CreateTablet for tablet f6642e361e1e4813b740fe13644c511f (DEFAULT_TABLE table=rebalance_test_table_7 [id=3a054cbae18b4be299041537b6a6b139]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:47.683166 22178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6642e361e1e4813b740fe13644c511f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:47.683248 22922 tablet_service.cc:1511] Processing CreateTablet for tablet f6642e361e1e4813b740fe13644c511f (DEFAULT_TABLE table=rebalance_test_table_7 [id=3a054cbae18b4be299041537b6a6b139]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:47.683606 22922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6642e361e1e4813b740fe13644c511f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:47.689796 22559 tablet_service.cc:1511] Processing CreateTablet for tablet f6642e361e1e4813b740fe13644c511f (DEFAULT_TABLE table=rebalance_test_table_7 [id=3a054cbae18b4be299041537b6a6b139]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:47.690232 22559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6642e361e1e4813b740fe13644c511f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:47.692233 22364 tablet_service.cc:1511] Processing CreateTablet for tablet d6a98598516f48c2a4e52595dca944a6 (DEFAULT_TABLE table=rebalance_test_table_7 [id=3a054cbae18b4be299041537b6a6b139]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:47.692636 22364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6a98598516f48c2a4e52595dca944a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:47.693261 22740 tablet_service.cc:1511] Processing CreateTablet for tablet d6a98598516f48c2a4e52595dca944a6 (DEFAULT_TABLE table=rebalance_test_table_7 [id=3a054cbae18b4be299041537b6a6b139]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:47.693897 22740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6a98598516f48c2a4e52595dca944a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:47.694995 23934 tablet_bootstrap.cc:492] T 70ababa88c614a8487937414d3d01c09 P 78c107f9dfbc4d3483895dda0f791bb2: Bootstrap starting.
I20260810 01:55:47.697052 23934 tablet_bootstrap.cc:654] T 70ababa88c614a8487937414d3d01c09 P 78c107f9dfbc4d3483895dda0f791bb2: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:47.700407 21995 tablet_service.cc:1511] Processing CreateTablet for tablet d6a98598516f48c2a4e52595dca944a6 (DEFAULT_TABLE table=rebalance_test_table_7 [id=3a054cbae18b4be299041537b6a6b139]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:47.700995 21995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6a98598516f48c2a4e52595dca944a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:47.722096 23939 tablet_bootstrap.cc:492] T d6a98598516f48c2a4e52595dca944a6 P 687f288b7e9d4650a758d5451483e49b: Bootstrap starting.
I20260810 01:55:47.722504 23938 tablet_bootstrap.cc:492] T d6a98598516f48c2a4e52595dca944a6 P 65755ebc82864dc3a3193b1ba3870613: Bootstrap starting.
I20260810 01:55:47.726356 23940 tablet_bootstrap.cc:492] T d6a98598516f48c2a4e52595dca944a6 P c5ca831c32e4452dba1cfc6cd296e532: Bootstrap starting.
I20260810 01:55:47.727526 23938 tablet_bootstrap.cc:654] T d6a98598516f48c2a4e52595dca944a6 P 65755ebc82864dc3a3193b1ba3870613: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:47.729151 23940 tablet_bootstrap.cc:654] T d6a98598516f48c2a4e52595dca944a6 P c5ca831c32e4452dba1cfc6cd296e532: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:47.730011 23937 tablet_bootstrap.cc:492] T 70ababa88c614a8487937414d3d01c09 P 5c71783cbed64297b17353312fcd4bb0: Bootstrap starting.
I20260810 01:55:47.731114 23939 tablet_bootstrap.cc:654] T d6a98598516f48c2a4e52595dca944a6 P 687f288b7e9d4650a758d5451483e49b: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:47.732275 23938 tablet_bootstrap.cc:492] T d6a98598516f48c2a4e52595dca944a6 P 65755ebc82864dc3a3193b1ba3870613: No bootstrap required, opened a new log
I20260810 01:55:47.732687 23938 ts_tablet_manager.cc:1403] T d6a98598516f48c2a4e52595dca944a6 P 65755ebc82864dc3a3193b1ba3870613: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.000s
I20260810 01:55:47.733636 23937 tablet_bootstrap.cc:654] T 70ababa88c614a8487937414d3d01c09 P 5c71783cbed64297b17353312fcd4bb0: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:47.734253 23938 raft_consensus.cc:359] T d6a98598516f48c2a4e52595dca944a6 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:47.734442 23938 raft_consensus.cc:385] T d6a98598516f48c2a4e52595dca944a6 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:47.735200 23938 raft_consensus.cc:740] T d6a98598516f48c2a4e52595dca944a6 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65755ebc82864dc3a3193b1ba3870613, State: Initialized, Role: FOLLOWER
I20260810 01:55:47.735734 23938 consensus_queue.cc:260] T d6a98598516f48c2a4e52595dca944a6 P 65755ebc82864dc3a3193b1ba3870613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:47.736802 23938 ts_tablet_manager.cc:1434] T d6a98598516f48c2a4e52595dca944a6 P 65755ebc82864dc3a3193b1ba3870613: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260810 01:55:47.738405 23934 tablet_bootstrap.cc:492] T 70ababa88c614a8487937414d3d01c09 P 78c107f9dfbc4d3483895dda0f791bb2: No bootstrap required, opened a new log
I20260810 01:55:47.738652 23934 ts_tablet_manager.cc:1403] T 70ababa88c614a8487937414d3d01c09 P 78c107f9dfbc4d3483895dda0f791bb2: Time spent bootstrapping tablet: real 0.044s user 0.013s sys 0.030s
I20260810 01:55:47.739151 23935 tablet_bootstrap.cc:492] T 70ababa88c614a8487937414d3d01c09 P fabe62238d32404097129ae02ed3b0b3: Bootstrap starting.
I20260810 01:55:47.739605 23934 raft_consensus.cc:359] T 70ababa88c614a8487937414d3d01c09 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:47.740015 23934 raft_consensus.cc:385] T 70ababa88c614a8487937414d3d01c09 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:47.740125 23934 raft_consensus.cc:740] T 70ababa88c614a8487937414d3d01c09 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78c107f9dfbc4d3483895dda0f791bb2, State: Initialized, Role: FOLLOWER
I20260810 01:55:47.740226 23937 tablet_bootstrap.cc:492] T 70ababa88c614a8487937414d3d01c09 P 5c71783cbed64297b17353312fcd4bb0: No bootstrap required, opened a new log
I20260810 01:55:47.740388 23937 ts_tablet_manager.cc:1403] T 70ababa88c614a8487937414d3d01c09 P 5c71783cbed64297b17353312fcd4bb0: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.004s
I20260810 01:55:47.740448 23934 consensus_queue.cc:260] T 70ababa88c614a8487937414d3d01c09 P 78c107f9dfbc4d3483895dda0f791bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:47.741139 23934 ts_tablet_manager.cc:1434] T 70ababa88c614a8487937414d3d01c09 P 78c107f9dfbc4d3483895dda0f791bb2: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 01:55:47.741559 23940 tablet_bootstrap.cc:492] T d6a98598516f48c2a4e52595dca944a6 P c5ca831c32e4452dba1cfc6cd296e532: No bootstrap required, opened a new log
I20260810 01:55:47.741566 23934 tablet_bootstrap.cc:492] T f6642e361e1e4813b740fe13644c511f P 78c107f9dfbc4d3483895dda0f791bb2: Bootstrap starting.
I20260810 01:55:47.742218 23940 ts_tablet_manager.cc:1403] T d6a98598516f48c2a4e52595dca944a6 P c5ca831c32e4452dba1cfc6cd296e532: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.002s
I20260810 01:55:47.742399 23935 tablet_bootstrap.cc:654] T 70ababa88c614a8487937414d3d01c09 P fabe62238d32404097129ae02ed3b0b3: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:47.743314 23934 tablet_bootstrap.cc:654] T f6642e361e1e4813b740fe13644c511f P 78c107f9dfbc4d3483895dda0f791bb2: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:47.743278 23937 raft_consensus.cc:359] T 70ababa88c614a8487937414d3d01c09 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:47.743665 23940 raft_consensus.cc:359] T d6a98598516f48c2a4e52595dca944a6 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:47.743970 23940 raft_consensus.cc:385] T d6a98598516f48c2a4e52595dca944a6 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:47.744124 23940 raft_consensus.cc:740] T d6a98598516f48c2a4e52595dca944a6 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ca831c32e4452dba1cfc6cd296e532, State: Initialized, Role: FOLLOWER
I20260810 01:55:47.744746 23940 consensus_queue.cc:260] T d6a98598516f48c2a4e52595dca944a6 P c5ca831c32e4452dba1cfc6cd296e532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:47.745373 23939 tablet_bootstrap.cc:492] T d6a98598516f48c2a4e52595dca944a6 P 687f288b7e9d4650a758d5451483e49b: No bootstrap required, opened a new log
I20260810 01:55:47.745630 23939 ts_tablet_manager.cc:1403] T d6a98598516f48c2a4e52595dca944a6 P 687f288b7e9d4650a758d5451483e49b: Time spent bootstrapping tablet: real 0.024s user 0.006s sys 0.000s
I20260810 01:55:47.746183 23940 ts_tablet_manager.cc:1434] T d6a98598516f48c2a4e52595dca944a6 P c5ca831c32e4452dba1cfc6cd296e532: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260810 01:55:47.746732 23939 raft_consensus.cc:359] T d6a98598516f48c2a4e52595dca944a6 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:47.747097 23939 raft_consensus.cc:385] T d6a98598516f48c2a4e52595dca944a6 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:47.747270 23939 raft_consensus.cc:740] T d6a98598516f48c2a4e52595dca944a6 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687f288b7e9d4650a758d5451483e49b, State: Initialized, Role: FOLLOWER
I20260810 01:55:47.747684 23939 consensus_queue.cc:260] T d6a98598516f48c2a4e52595dca944a6 P 687f288b7e9d4650a758d5451483e49b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:47.749774 23939 ts_tablet_manager.cc:1434] T d6a98598516f48c2a4e52595dca944a6 P 687f288b7e9d4650a758d5451483e49b: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260810 01:55:47.749970 23937 raft_consensus.cc:385] T 70ababa88c614a8487937414d3d01c09 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:47.750130 23937 raft_consensus.cc:740] T 70ababa88c614a8487937414d3d01c09 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c71783cbed64297b17353312fcd4bb0, State: Initialized, Role: FOLLOWER
I20260810 01:55:47.750489 23937 consensus_queue.cc:260] T 70ababa88c614a8487937414d3d01c09 P 5c71783cbed64297b17353312fcd4bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:47.751405 23937 ts_tablet_manager.cc:1434] T 70ababa88c614a8487937414d3d01c09 P 5c71783cbed64297b17353312fcd4bb0: Time spent starting tablet: real 0.009s user 0.000s sys 0.002s
I20260810 01:55:47.751792 23937 tablet_bootstrap.cc:492] T f6642e361e1e4813b740fe13644c511f P 5c71783cbed64297b17353312fcd4bb0: Bootstrap starting.
I20260810 01:55:47.755380 23937 tablet_bootstrap.cc:654] T f6642e361e1e4813b740fe13644c511f P 5c71783cbed64297b17353312fcd4bb0: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:47.760855 23937 tablet_bootstrap.cc:492] T f6642e361e1e4813b740fe13644c511f P 5c71783cbed64297b17353312fcd4bb0: No bootstrap required, opened a new log
I20260810 01:55:47.760931 23934 tablet_bootstrap.cc:492] T f6642e361e1e4813b740fe13644c511f P 78c107f9dfbc4d3483895dda0f791bb2: No bootstrap required, opened a new log
I20260810 01:55:47.761130 23937 ts_tablet_manager.cc:1403] T f6642e361e1e4813b740fe13644c511f P 5c71783cbed64297b17353312fcd4bb0: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s
I20260810 01:55:47.761183 23934 ts_tablet_manager.cc:1403] T f6642e361e1e4813b740fe13644c511f P 78c107f9dfbc4d3483895dda0f791bb2: Time spent bootstrapping tablet: real 0.020s user 0.007s sys 0.011s
I20260810 01:55:47.762148 23937 raft_consensus.cc:359] T f6642e361e1e4813b740fe13644c511f P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } }
I20260810 01:55:47.762172 23934 raft_consensus.cc:359] T f6642e361e1e4813b740fe13644c511f P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } }
I20260810 01:55:47.762377 23937 raft_consensus.cc:385] T f6642e361e1e4813b740fe13644c511f P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:47.762456 23937 raft_consensus.cc:740] T f6642e361e1e4813b740fe13644c511f P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c71783cbed64297b17353312fcd4bb0, State: Initialized, Role: FOLLOWER
I20260810 01:55:47.762519 23934 raft_consensus.cc:385] T f6642e361e1e4813b740fe13644c511f P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:47.762574 23935 tablet_bootstrap.cc:492] T 70ababa88c614a8487937414d3d01c09 P fabe62238d32404097129ae02ed3b0b3: No bootstrap required, opened a new log
I20260810 01:55:47.762630 23934 raft_consensus.cc:740] T f6642e361e1e4813b740fe13644c511f P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78c107f9dfbc4d3483895dda0f791bb2, State: Initialized, Role: FOLLOWER
I20260810 01:55:47.762722 23935 ts_tablet_manager.cc:1403] T 70ababa88c614a8487937414d3d01c09 P fabe62238d32404097129ae02ed3b0b3: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.000s
I20260810 01:55:47.762779 23937 consensus_queue.cc:260] T f6642e361e1e4813b740fe13644c511f P 5c71783cbed64297b17353312fcd4bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } }
I20260810 01:55:47.762959 23934 consensus_queue.cc:260] T f6642e361e1e4813b740fe13644c511f P 78c107f9dfbc4d3483895dda0f791bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } }
I20260810 01:55:47.763331 23937 ts_tablet_manager.cc:1434] T f6642e361e1e4813b740fe13644c511f P 5c71783cbed64297b17353312fcd4bb0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 01:55:47.763499 23934 ts_tablet_manager.cc:1434] T f6642e361e1e4813b740fe13644c511f P 78c107f9dfbc4d3483895dda0f791bb2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:55:47.764083 23935 raft_consensus.cc:359] T 70ababa88c614a8487937414d3d01c09 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:47.764333 23935 raft_consensus.cc:385] T 70ababa88c614a8487937414d3d01c09 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:47.764438 23935 raft_consensus.cc:740] T 70ababa88c614a8487937414d3d01c09 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabe62238d32404097129ae02ed3b0b3, State: Initialized, Role: FOLLOWER
I20260810 01:55:47.764664 23935 consensus_queue.cc:260] T 70ababa88c614a8487937414d3d01c09 P fabe62238d32404097129ae02ed3b0b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:47.765209 23935 ts_tablet_manager.cc:1434] T 70ababa88c614a8487937414d3d01c09 P fabe62238d32404097129ae02ed3b0b3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:55:47.765566 23935 tablet_bootstrap.cc:492] T f6642e361e1e4813b740fe13644c511f P fabe62238d32404097129ae02ed3b0b3: Bootstrap starting.
I20260810 01:55:47.767396 23935 tablet_bootstrap.cc:654] T f6642e361e1e4813b740fe13644c511f P fabe62238d32404097129ae02ed3b0b3: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:47.771008 23935 tablet_bootstrap.cc:492] T f6642e361e1e4813b740fe13644c511f P fabe62238d32404097129ae02ed3b0b3: No bootstrap required, opened a new log
I20260810 01:55:47.771217 23935 ts_tablet_manager.cc:1403] T f6642e361e1e4813b740fe13644c511f P fabe62238d32404097129ae02ed3b0b3: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.003s
I20260810 01:55:47.771901 23935 raft_consensus.cc:359] T f6642e361e1e4813b740fe13644c511f P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } }
I20260810 01:55:47.772100 23935 raft_consensus.cc:385] T f6642e361e1e4813b740fe13644c511f P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:47.772177 23935 raft_consensus.cc:740] T f6642e361e1e4813b740fe13644c511f P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabe62238d32404097129ae02ed3b0b3, State: Initialized, Role: FOLLOWER
I20260810 01:55:47.772429 23935 consensus_queue.cc:260] T f6642e361e1e4813b740fe13644c511f P fabe62238d32404097129ae02ed3b0b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } }
I20260810 01:55:47.772933 23935 ts_tablet_manager.cc:1434] T f6642e361e1e4813b740fe13644c511f P fabe62238d32404097129ae02ed3b0b3: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 01:55:47.797061 23927 raft_consensus.cc:493] T d6a98598516f48c2a4e52595dca944a6 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:55:47.797266 23927 raft_consensus.cc:515] T d6a98598516f48c2a4e52595dca944a6 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:47.798199 23927 leader_election.cc:290] T d6a98598516f48c2a4e52595dca944a6 P c5ca831c32e4452dba1cfc6cd296e532 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65755ebc82864dc3a3193b1ba3870613 (127.21.64.195:46103), 687f288b7e9d4650a758d5451483e49b (127.21.64.197:37655)
I20260810 01:55:47.798694 22767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a98598516f48c2a4e52595dca944a6" candidate_uuid: "c5ca831c32e4452dba1cfc6cd296e532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687f288b7e9d4650a758d5451483e49b" is_pre_election: true
I20260810 01:55:47.798844 22391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a98598516f48c2a4e52595dca944a6" candidate_uuid: "c5ca831c32e4452dba1cfc6cd296e532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65755ebc82864dc3a3193b1ba3870613" is_pre_election: true
I20260810 01:55:47.798920 22767 raft_consensus.cc:2468] T d6a98598516f48c2a4e52595dca944a6 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ca831c32e4452dba1cfc6cd296e532 in term 0.
I20260810 01:55:47.799099 22391 raft_consensus.cc:2468] T d6a98598516f48c2a4e52595dca944a6 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ca831c32e4452dba1cfc6cd296e532 in term 0.
I20260810 01:55:47.799427 21930 leader_election.cc:304] T d6a98598516f48c2a4e52595dca944a6 P c5ca831c32e4452dba1cfc6cd296e532 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687f288b7e9d4650a758d5451483e49b, c5ca831c32e4452dba1cfc6cd296e532; no voters:
I20260810 01:55:47.799738 23927 raft_consensus.cc:2804] T d6a98598516f48c2a4e52595dca944a6 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:55:47.799862 23927 raft_consensus.cc:493] T d6a98598516f48c2a4e52595dca944a6 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:55:47.799955 23927 raft_consensus.cc:3060] T d6a98598516f48c2a4e52595dca944a6 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:47.802080 23927 raft_consensus.cc:515] T d6a98598516f48c2a4e52595dca944a6 P c5ca831c32e4452dba1cfc6cd296e532 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:47.802551 23927 leader_election.cc:290] T d6a98598516f48c2a4e52595dca944a6 P c5ca831c32e4452dba1cfc6cd296e532 [CANDIDATE]: Term 1 election: Requested vote from peers 65755ebc82864dc3a3193b1ba3870613 (127.21.64.195:46103), 687f288b7e9d4650a758d5451483e49b (127.21.64.197:37655)
I20260810 01:55:47.803032 22391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a98598516f48c2a4e52595dca944a6" candidate_uuid: "c5ca831c32e4452dba1cfc6cd296e532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65755ebc82864dc3a3193b1ba3870613"
I20260810 01:55:47.803061 22767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a98598516f48c2a4e52595dca944a6" candidate_uuid: "c5ca831c32e4452dba1cfc6cd296e532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687f288b7e9d4650a758d5451483e49b"
I20260810 01:55:47.803237 22767 raft_consensus.cc:3060] T d6a98598516f48c2a4e52595dca944a6 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:47.803258 22391 raft_consensus.cc:3060] T d6a98598516f48c2a4e52595dca944a6 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:47.806243 22391 raft_consensus.cc:2468] T d6a98598516f48c2a4e52595dca944a6 P 65755ebc82864dc3a3193b1ba3870613 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ca831c32e4452dba1cfc6cd296e532 in term 1.
I20260810 01:55:47.806257 22767 raft_consensus.cc:2468] T d6a98598516f48c2a4e52595dca944a6 P 687f288b7e9d4650a758d5451483e49b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ca831c32e4452dba1cfc6cd296e532 in term 1.
I20260810 01:55:47.806676 21930 leader_election.cc:304] T d6a98598516f48c2a4e52595dca944a6 P c5ca831c32e4452dba1cfc6cd296e532 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687f288b7e9d4650a758d5451483e49b, c5ca831c32e4452dba1cfc6cd296e532; no voters:
I20260810 01:55:47.806963 23927 raft_consensus.cc:2804] T d6a98598516f48c2a4e52595dca944a6 P c5ca831c32e4452dba1cfc6cd296e532 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:55:47.807135 23927 raft_consensus.cc:697] T d6a98598516f48c2a4e52595dca944a6 P c5ca831c32e4452dba1cfc6cd296e532 [term 1 LEADER]: Becoming Leader. State: Replica: c5ca831c32e4452dba1cfc6cd296e532, State: Running, Role: LEADER
I20260810 01:55:47.807420 23927 consensus_queue.cc:237] T d6a98598516f48c2a4e52595dca944a6 P c5ca831c32e4452dba1cfc6cd296e532 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:47.810428 21815 catalog_manager.cc:5719] T d6a98598516f48c2a4e52595dca944a6 P c5ca831c32e4452dba1cfc6cd296e532 reported cstate change: term changed from 0 to 1, leader changed from <none> to c5ca831c32e4452dba1cfc6cd296e532 (127.21.64.193). New cstate: current_term: 1 leader_uuid: "c5ca831c32e4452dba1cfc6cd296e532" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } health_report { overall_health: HEALTHY } } }
I20260810 01:55:47.829913 23249 raft_consensus.cc:493] T f6642e361e1e4813b740fe13644c511f P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:55:47.830098 23249 raft_consensus.cc:515] T f6642e361e1e4813b740fe13644c511f P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } }
I20260810 01:55:47.830615 23249 leader_election.cc:290] T f6642e361e1e4813b740fe13644c511f P fabe62238d32404097129ae02ed3b0b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c71783cbed64297b17353312fcd4bb0 (127.21.64.198:33973), 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194:33547)
I20260810 01:55:47.831177 22952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6642e361e1e4813b740fe13644c511f" candidate_uuid: "fabe62238d32404097129ae02ed3b0b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c71783cbed64297b17353312fcd4bb0" is_pre_election: true
I20260810 01:55:47.831287 22207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6642e361e1e4813b740fe13644c511f" candidate_uuid: "fabe62238d32404097129ae02ed3b0b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78c107f9dfbc4d3483895dda0f791bb2" is_pre_election: true
I20260810 01:55:47.831425 22952 raft_consensus.cc:2468] T f6642e361e1e4813b740fe13644c511f P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabe62238d32404097129ae02ed3b0b3 in term 0.
I20260810 01:55:47.831573 22207 raft_consensus.cc:2468] T f6642e361e1e4813b740fe13644c511f P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabe62238d32404097129ae02ed3b0b3 in term 0.
I20260810 01:55:47.831965 22502 leader_election.cc:304] T f6642e361e1e4813b740fe13644c511f P fabe62238d32404097129ae02ed3b0b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c71783cbed64297b17353312fcd4bb0, fabe62238d32404097129ae02ed3b0b3; no voters:
I20260810 01:55:47.832301 23249 raft_consensus.cc:2804] T f6642e361e1e4813b740fe13644c511f P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:55:47.832427 23249 raft_consensus.cc:493] T f6642e361e1e4813b740fe13644c511f P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:55:47.832558 23249 raft_consensus.cc:3060] T f6642e361e1e4813b740fe13644c511f P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:47.834774 23249 raft_consensus.cc:515] T f6642e361e1e4813b740fe13644c511f P fabe62238d32404097129ae02ed3b0b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } }
I20260810 01:55:47.835296 23249 leader_election.cc:290] T f6642e361e1e4813b740fe13644c511f P fabe62238d32404097129ae02ed3b0b3 [CANDIDATE]: Term 1 election: Requested vote from peers 5c71783cbed64297b17353312fcd4bb0 (127.21.64.198:33973), 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194:33547)
I20260810 01:55:47.835708 22952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6642e361e1e4813b740fe13644c511f" candidate_uuid: "fabe62238d32404097129ae02ed3b0b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c71783cbed64297b17353312fcd4bb0"
I20260810 01:55:47.835911 22207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6642e361e1e4813b740fe13644c511f" candidate_uuid: "fabe62238d32404097129ae02ed3b0b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78c107f9dfbc4d3483895dda0f791bb2"
I20260810 01:55:47.835932 22952 raft_consensus.cc:3060] T f6642e361e1e4813b740fe13644c511f P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:47.836117 22207 raft_consensus.cc:3060] T f6642e361e1e4813b740fe13644c511f P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:47.838043 22952 raft_consensus.cc:2468] T f6642e361e1e4813b740fe13644c511f P 5c71783cbed64297b17353312fcd4bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabe62238d32404097129ae02ed3b0b3 in term 1.
I20260810 01:55:47.838150 22207 raft_consensus.cc:2468] T f6642e361e1e4813b740fe13644c511f P 78c107f9dfbc4d3483895dda0f791bb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabe62238d32404097129ae02ed3b0b3 in term 1.
I20260810 01:55:47.838490 22502 leader_election.cc:304] T f6642e361e1e4813b740fe13644c511f P fabe62238d32404097129ae02ed3b0b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c71783cbed64297b17353312fcd4bb0, fabe62238d32404097129ae02ed3b0b3; no voters:
I20260810 01:55:47.838722 23249 raft_consensus.cc:2804] T f6642e361e1e4813b740fe13644c511f P fabe62238d32404097129ae02ed3b0b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:55:47.838900 23249 raft_consensus.cc:697] T f6642e361e1e4813b740fe13644c511f P fabe62238d32404097129ae02ed3b0b3 [term 1 LEADER]: Becoming Leader. State: Replica: fabe62238d32404097129ae02ed3b0b3, State: Running, Role: LEADER
I20260810 01:55:47.839222 23249 consensus_queue.cc:237] T f6642e361e1e4813b740fe13644c511f P fabe62238d32404097129ae02ed3b0b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } }
I20260810 01:55:47.842729 21815 catalog_manager.cc:5719] T f6642e361e1e4813b740fe13644c511f P fabe62238d32404097129ae02ed3b0b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to fabe62238d32404097129ae02ed3b0b3 (127.21.64.196). New cstate: current_term: 1 leader_uuid: "fabe62238d32404097129ae02ed3b0b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } health_report { overall_health: UNKNOWN } } }
I20260810 01:55:48.028213 23249 raft_consensus.cc:493] T 70ababa88c614a8487937414d3d01c09 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:55:48.028461 23249 raft_consensus.cc:515] T 70ababa88c614a8487937414d3d01c09 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:48.029234 23249 leader_election.cc:290] T 70ababa88c614a8487937414d3d01c09 P fabe62238d32404097129ae02ed3b0b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c71783cbed64297b17353312fcd4bb0 (127.21.64.198:33973), 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194:33547)
I20260810 01:55:48.029914 22952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70ababa88c614a8487937414d3d01c09" candidate_uuid: "fabe62238d32404097129ae02ed3b0b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c71783cbed64297b17353312fcd4bb0" is_pre_election: true
I20260810 01:55:48.030028 22207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70ababa88c614a8487937414d3d01c09" candidate_uuid: "fabe62238d32404097129ae02ed3b0b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78c107f9dfbc4d3483895dda0f791bb2" is_pre_election: true
I20260810 01:55:48.030161 22952 raft_consensus.cc:2468] T 70ababa88c614a8487937414d3d01c09 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabe62238d32404097129ae02ed3b0b3 in term 0.
I20260810 01:55:48.030337 22207 raft_consensus.cc:2468] T 70ababa88c614a8487937414d3d01c09 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabe62238d32404097129ae02ed3b0b3 in term 0.
I20260810 01:55:48.030711 22502 leader_election.cc:304] T 70ababa88c614a8487937414d3d01c09 P fabe62238d32404097129ae02ed3b0b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c71783cbed64297b17353312fcd4bb0, fabe62238d32404097129ae02ed3b0b3; no voters:
I20260810 01:55:48.031077 23249 raft_consensus.cc:2804] T 70ababa88c614a8487937414d3d01c09 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:55:48.031291 23249 raft_consensus.cc:493] T 70ababa88c614a8487937414d3d01c09 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:55:48.031477 23249 raft_consensus.cc:3060] T 70ababa88c614a8487937414d3d01c09 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:48.034092 23249 raft_consensus.cc:515] T 70ababa88c614a8487937414d3d01c09 P fabe62238d32404097129ae02ed3b0b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:48.034793 23249 leader_election.cc:290] T 70ababa88c614a8487937414d3d01c09 P fabe62238d32404097129ae02ed3b0b3 [CANDIDATE]: Term 1 election: Requested vote from peers 5c71783cbed64297b17353312fcd4bb0 (127.21.64.198:33973), 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194:33547)
I20260810 01:55:48.035213 22952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70ababa88c614a8487937414d3d01c09" candidate_uuid: "fabe62238d32404097129ae02ed3b0b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c71783cbed64297b17353312fcd4bb0"
I20260810 01:55:48.035434 22952 raft_consensus.cc:3060] T 70ababa88c614a8487937414d3d01c09 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:48.035383 22207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70ababa88c614a8487937414d3d01c09" candidate_uuid: "fabe62238d32404097129ae02ed3b0b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78c107f9dfbc4d3483895dda0f791bb2"
I20260810 01:55:48.035612 22207 raft_consensus.cc:3060] T 70ababa88c614a8487937414d3d01c09 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:48.038496 22952 raft_consensus.cc:2468] T 70ababa88c614a8487937414d3d01c09 P 5c71783cbed64297b17353312fcd4bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabe62238d32404097129ae02ed3b0b3 in term 1.
I20260810 01:55:48.038765 22207 raft_consensus.cc:2468] T 70ababa88c614a8487937414d3d01c09 P 78c107f9dfbc4d3483895dda0f791bb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabe62238d32404097129ae02ed3b0b3 in term 1.
I20260810 01:55:48.039022 22502 leader_election.cc:304] T 70ababa88c614a8487937414d3d01c09 P fabe62238d32404097129ae02ed3b0b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c71783cbed64297b17353312fcd4bb0, fabe62238d32404097129ae02ed3b0b3; no voters:
I20260810 01:55:48.039366 23249 raft_consensus.cc:2804] T 70ababa88c614a8487937414d3d01c09 P fabe62238d32404097129ae02ed3b0b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:55:48.039526 23249 raft_consensus.cc:697] T 70ababa88c614a8487937414d3d01c09 P fabe62238d32404097129ae02ed3b0b3 [term 1 LEADER]: Becoming Leader. State: Replica: fabe62238d32404097129ae02ed3b0b3, State: Running, Role: LEADER
I20260810 01:55:48.039821 23249 consensus_queue.cc:237] T 70ababa88c614a8487937414d3d01c09 P fabe62238d32404097129ae02ed3b0b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:48.042721 21815 catalog_manager.cc:5719] T 70ababa88c614a8487937414d3d01c09 P fabe62238d32404097129ae02ed3b0b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to fabe62238d32404097129ae02ed3b0b3 (127.21.64.196). New cstate: current_term: 1 leader_uuid: "fabe62238d32404097129ae02ed3b0b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } health_report { overall_health: HEALTHY } } }
I20260810 01:55:48.221217 23927 consensus_queue.cc:1048] T d6a98598516f48c2a4e52595dca944a6 P c5ca831c32e4452dba1cfc6cd296e532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:48.221421 23249 consensus_queue.cc:1048] T f6642e361e1e4813b740fe13644c511f P fabe62238d32404097129ae02ed3b0b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:48.223381 23249 consensus_queue.cc:1048] T f6642e361e1e4813b740fe13644c511f P fabe62238d32404097129ae02ed3b0b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:48.228835 23717 consensus_queue.cc:1048] T d6a98598516f48c2a4e52595dca944a6 P c5ca831c32e4452dba1cfc6cd296e532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 01:55:48.482826 23958 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:55:48.483296 23958 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260810 01:55:48.501124 23709 consensus_queue.cc:1048] T 70ababa88c614a8487937414d3d01c09 P fabe62238d32404097129ae02ed3b0b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:48.510046 23966 consensus_queue.cc:1048] T 70ababa88c614a8487937414d3d01c09 P fabe62238d32404097129ae02ed3b0b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
Using table 'rebalance_test_table_7'
INSERT report
rows total: 2000
time total: 303.915 ms
time per row: 0.151957 ms
I20260810 01:55:48.988627 21825 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60594:
name: "rebalance_test_table_8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260810 01:55:48.999971 22740 tablet_service.cc:1511] Processing CreateTablet for tablet 35d4c74a46c44d1c9e98530d00061bdc (DEFAULT_TABLE table=rebalance_test_table_8 [id=9d87fd0e73274cba854d365df819261c]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:49.000308 22364 tablet_service.cc:1511] Processing CreateTablet for tablet 35d4c74a46c44d1c9e98530d00061bdc (DEFAULT_TABLE table=rebalance_test_table_8 [id=9d87fd0e73274cba854d365df819261c]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:49.000507 22740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35d4c74a46c44d1c9e98530d00061bdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:49.000643 21995 tablet_service.cc:1511] Processing CreateTablet for tablet 35d4c74a46c44d1c9e98530d00061bdc (DEFAULT_TABLE table=rebalance_test_table_8 [id=9d87fd0e73274cba854d365df819261c]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:49.000857 22364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35d4c74a46c44d1c9e98530d00061bdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:49.001132 21995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35d4c74a46c44d1c9e98530d00061bdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:49.001390 22921 tablet_service.cc:1511] Processing CreateTablet for tablet adc7dc90da474e878d33fb70f40448f0 (DEFAULT_TABLE table=rebalance_test_table_8 [id=9d87fd0e73274cba854d365df819261c]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:49.001868 22921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adc7dc90da474e878d33fb70f40448f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:49.008199 22178 tablet_service.cc:1511] Processing CreateTablet for tablet adc7dc90da474e878d33fb70f40448f0 (DEFAULT_TABLE table=rebalance_test_table_8 [id=9d87fd0e73274cba854d365df819261c]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:49.008790 22178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adc7dc90da474e878d33fb70f40448f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:49.009183 22558 tablet_service.cc:1511] Processing CreateTablet for tablet adc7dc90da474e878d33fb70f40448f0 (DEFAULT_TABLE table=rebalance_test_table_8 [id=9d87fd0e73274cba854d365df819261c]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:49.009729 22558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adc7dc90da474e878d33fb70f40448f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:49.018183 24059 tablet_bootstrap.cc:492] T 35d4c74a46c44d1c9e98530d00061bdc P 687f288b7e9d4650a758d5451483e49b: Bootstrap starting.
I20260810 01:55:49.021139 24059 tablet_bootstrap.cc:654] T 35d4c74a46c44d1c9e98530d00061bdc P 687f288b7e9d4650a758d5451483e49b: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:49.029525 24063 tablet_bootstrap.cc:492] T adc7dc90da474e878d33fb70f40448f0 P 78c107f9dfbc4d3483895dda0f791bb2: Bootstrap starting.
I20260810 01:55:49.031224 24060 tablet_bootstrap.cc:492] T adc7dc90da474e878d33fb70f40448f0 P 5c71783cbed64297b17353312fcd4bb0: Bootstrap starting.
I20260810 01:55:49.031886 22363 tablet_service.cc:1511] Processing CreateTablet for tablet ea63e0d471f84790a30e81a01d40d131 (DEFAULT_TABLE table=rebalance_test_table_8 [id=9d87fd0e73274cba854d365df819261c]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:49.032459 22363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea63e0d471f84790a30e81a01d40d131. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:49.034049 24063 tablet_bootstrap.cc:654] T adc7dc90da474e878d33fb70f40448f0 P 78c107f9dfbc4d3483895dda0f791bb2: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:49.038115 24060 tablet_bootstrap.cc:654] T adc7dc90da474e878d33fb70f40448f0 P 5c71783cbed64297b17353312fcd4bb0: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:49.039567 22740 tablet_service.cc:1511] Processing CreateTablet for tablet ea63e0d471f84790a30e81a01d40d131 (DEFAULT_TABLE table=rebalance_test_table_8 [id=9d87fd0e73274cba854d365df819261c]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:49.040021 22740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea63e0d471f84790a30e81a01d40d131. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:49.041229 24063 tablet_bootstrap.cc:492] T adc7dc90da474e878d33fb70f40448f0 P 78c107f9dfbc4d3483895dda0f791bb2: No bootstrap required, opened a new log
I20260810 01:55:49.042230 24063 ts_tablet_manager.cc:1403] T adc7dc90da474e878d33fb70f40448f0 P 78c107f9dfbc4d3483895dda0f791bb2: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.002s
I20260810 01:55:49.043179 24063 raft_consensus.cc:359] T adc7dc90da474e878d33fb70f40448f0 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } }
I20260810 01:55:49.043672 24058 tablet_bootstrap.cc:492] T 35d4c74a46c44d1c9e98530d00061bdc P c5ca831c32e4452dba1cfc6cd296e532: Bootstrap starting.
I20260810 01:55:49.045480 24063 raft_consensus.cc:385] T adc7dc90da474e878d33fb70f40448f0 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:49.045657 24063 raft_consensus.cc:740] T adc7dc90da474e878d33fb70f40448f0 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78c107f9dfbc4d3483895dda0f791bb2, State: Initialized, Role: FOLLOWER
I20260810 01:55:49.046006 24063 consensus_queue.cc:260] T adc7dc90da474e878d33fb70f40448f0 P 78c107f9dfbc4d3483895dda0f791bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } }
I20260810 01:55:49.046078 21995 tablet_service.cc:1511] Processing CreateTablet for tablet ea63e0d471f84790a30e81a01d40d131 (DEFAULT_TABLE table=rebalance_test_table_8 [id=9d87fd0e73274cba854d365df819261c]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:49.046726 21995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea63e0d471f84790a30e81a01d40d131. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:49.048043 24063 ts_tablet_manager.cc:1434] T adc7dc90da474e878d33fb70f40448f0 P 78c107f9dfbc4d3483895dda0f791bb2: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260810 01:55:49.048741 24058 tablet_bootstrap.cc:654] T 35d4c74a46c44d1c9e98530d00061bdc P c5ca831c32e4452dba1cfc6cd296e532: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:49.051738 24060 tablet_bootstrap.cc:492] T adc7dc90da474e878d33fb70f40448f0 P 5c71783cbed64297b17353312fcd4bb0: No bootstrap required, opened a new log
I20260810 01:55:49.052014 24060 ts_tablet_manager.cc:1403] T adc7dc90da474e878d33fb70f40448f0 P 5c71783cbed64297b17353312fcd4bb0: Time spent bootstrapping tablet: real 0.021s user 0.005s sys 0.000s
I20260810 01:55:49.053201 24060 raft_consensus.cc:359] T adc7dc90da474e878d33fb70f40448f0 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } }
I20260810 01:55:49.053553 24060 raft_consensus.cc:385] T adc7dc90da474e878d33fb70f40448f0 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:49.053752 24060 raft_consensus.cc:740] T adc7dc90da474e878d33fb70f40448f0 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c71783cbed64297b17353312fcd4bb0, State: Initialized, Role: FOLLOWER
I20260810 01:55:49.054147 24060 consensus_queue.cc:260] T adc7dc90da474e878d33fb70f40448f0 P 5c71783cbed64297b17353312fcd4bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } }
I20260810 01:55:49.055100 24065 tablet_bootstrap.cc:492] T 35d4c74a46c44d1c9e98530d00061bdc P 65755ebc82864dc3a3193b1ba3870613: Bootstrap starting.
I20260810 01:55:49.056030 24060 ts_tablet_manager.cc:1434] T adc7dc90da474e878d33fb70f40448f0 P 5c71783cbed64297b17353312fcd4bb0: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260810 01:55:49.060999 24064 tablet_bootstrap.cc:492] T adc7dc90da474e878d33fb70f40448f0 P fabe62238d32404097129ae02ed3b0b3: Bootstrap starting.
I20260810 01:55:49.066246 24064 tablet_bootstrap.cc:654] T adc7dc90da474e878d33fb70f40448f0 P fabe62238d32404097129ae02ed3b0b3: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:49.067173 24065 tablet_bootstrap.cc:654] T 35d4c74a46c44d1c9e98530d00061bdc P 65755ebc82864dc3a3193b1ba3870613: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:49.069427 24058 tablet_bootstrap.cc:492] T 35d4c74a46c44d1c9e98530d00061bdc P c5ca831c32e4452dba1cfc6cd296e532: No bootstrap required, opened a new log
I20260810 01:55:49.069640 24058 ts_tablet_manager.cc:1403] T 35d4c74a46c44d1c9e98530d00061bdc P c5ca831c32e4452dba1cfc6cd296e532: Time spent bootstrapping tablet: real 0.028s user 0.007s sys 0.000s
I20260810 01:55:49.070693 24058 raft_consensus.cc:359] T 35d4c74a46c44d1c9e98530d00061bdc P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:49.070921 24058 raft_consensus.cc:385] T 35d4c74a46c44d1c9e98530d00061bdc P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:49.071048 24058 raft_consensus.cc:740] T 35d4c74a46c44d1c9e98530d00061bdc P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ca831c32e4452dba1cfc6cd296e532, State: Initialized, Role: FOLLOWER
I20260810 01:55:49.071286 24058 consensus_queue.cc:260] T 35d4c74a46c44d1c9e98530d00061bdc P c5ca831c32e4452dba1cfc6cd296e532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:49.072048 24058 ts_tablet_manager.cc:1434] T 35d4c74a46c44d1c9e98530d00061bdc P c5ca831c32e4452dba1cfc6cd296e532: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:55:49.072422 24058 tablet_bootstrap.cc:492] T ea63e0d471f84790a30e81a01d40d131 P c5ca831c32e4452dba1cfc6cd296e532: Bootstrap starting.
I20260810 01:55:49.074193 24059 tablet_bootstrap.cc:492] T 35d4c74a46c44d1c9e98530d00061bdc P 687f288b7e9d4650a758d5451483e49b: No bootstrap required, opened a new log
I20260810 01:55:49.074390 24059 ts_tablet_manager.cc:1403] T 35d4c74a46c44d1c9e98530d00061bdc P 687f288b7e9d4650a758d5451483e49b: Time spent bootstrapping tablet: real 0.056s user 0.015s sys 0.026s
I20260810 01:55:49.075618 24058 tablet_bootstrap.cc:654] T ea63e0d471f84790a30e81a01d40d131 P c5ca831c32e4452dba1cfc6cd296e532: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:49.077596 24059 raft_consensus.cc:359] T 35d4c74a46c44d1c9e98530d00061bdc P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:49.077850 24059 raft_consensus.cc:385] T 35d4c74a46c44d1c9e98530d00061bdc P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:49.079167 24059 raft_consensus.cc:740] T 35d4c74a46c44d1c9e98530d00061bdc P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687f288b7e9d4650a758d5451483e49b, State: Initialized, Role: FOLLOWER
I20260810 01:55:49.079576 24059 consensus_queue.cc:260] T 35d4c74a46c44d1c9e98530d00061bdc P 687f288b7e9d4650a758d5451483e49b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:49.081396 24065 tablet_bootstrap.cc:492] T 35d4c74a46c44d1c9e98530d00061bdc P 65755ebc82864dc3a3193b1ba3870613: No bootstrap required, opened a new log
I20260810 01:55:49.081950 24065 ts_tablet_manager.cc:1403] T 35d4c74a46c44d1c9e98530d00061bdc P 65755ebc82864dc3a3193b1ba3870613: Time spent bootstrapping tablet: real 0.027s user 0.008s sys 0.001s
I20260810 01:55:49.082708 24059 ts_tablet_manager.cc:1434] T 35d4c74a46c44d1c9e98530d00061bdc P 687f288b7e9d4650a758d5451483e49b: Time spent starting tablet: real 0.008s user 0.002s sys 0.001s
I20260810 01:55:49.083078 24059 tablet_bootstrap.cc:492] T ea63e0d471f84790a30e81a01d40d131 P 687f288b7e9d4650a758d5451483e49b: Bootstrap starting.
I20260810 01:55:49.084720 24065 raft_consensus.cc:359] T 35d4c74a46c44d1c9e98530d00061bdc P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:49.086615 24059 tablet_bootstrap.cc:654] T ea63e0d471f84790a30e81a01d40d131 P 687f288b7e9d4650a758d5451483e49b: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:49.088280 24065 raft_consensus.cc:385] T 35d4c74a46c44d1c9e98530d00061bdc P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:49.088492 24065 raft_consensus.cc:740] T 35d4c74a46c44d1c9e98530d00061bdc P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65755ebc82864dc3a3193b1ba3870613, State: Initialized, Role: FOLLOWER
I20260810 01:55:49.090389 24065 consensus_queue.cc:260] T 35d4c74a46c44d1c9e98530d00061bdc P 65755ebc82864dc3a3193b1ba3870613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:49.092813 24065 ts_tablet_manager.cc:1434] T 35d4c74a46c44d1c9e98530d00061bdc P 65755ebc82864dc3a3193b1ba3870613: Time spent starting tablet: real 0.011s user 0.000s sys 0.003s
I20260810 01:55:49.093897 24064 tablet_bootstrap.cc:492] T adc7dc90da474e878d33fb70f40448f0 P fabe62238d32404097129ae02ed3b0b3: No bootstrap required, opened a new log
I20260810 01:55:49.094086 24064 ts_tablet_manager.cc:1403] T adc7dc90da474e878d33fb70f40448f0 P fabe62238d32404097129ae02ed3b0b3: Time spent bootstrapping tablet: real 0.033s user 0.003s sys 0.012s
I20260810 01:55:49.095664 24064 raft_consensus.cc:359] T adc7dc90da474e878d33fb70f40448f0 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } }
I20260810 01:55:49.096077 24064 raft_consensus.cc:385] T adc7dc90da474e878d33fb70f40448f0 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:49.096262 24064 raft_consensus.cc:740] T adc7dc90da474e878d33fb70f40448f0 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabe62238d32404097129ae02ed3b0b3, State: Initialized, Role: FOLLOWER
I20260810 01:55:49.097702 24064 consensus_queue.cc:260] T adc7dc90da474e878d33fb70f40448f0 P fabe62238d32404097129ae02ed3b0b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } }
I20260810 01:55:49.101050 24064 ts_tablet_manager.cc:1434] T adc7dc90da474e878d33fb70f40448f0 P fabe62238d32404097129ae02ed3b0b3: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260810 01:55:49.108095 24059 tablet_bootstrap.cc:492] T ea63e0d471f84790a30e81a01d40d131 P 687f288b7e9d4650a758d5451483e49b: No bootstrap required, opened a new log
I20260810 01:55:49.108294 24059 ts_tablet_manager.cc:1403] T ea63e0d471f84790a30e81a01d40d131 P 687f288b7e9d4650a758d5451483e49b: Time spent bootstrapping tablet: real 0.025s user 0.011s sys 0.007s
I20260810 01:55:49.109118 24065 tablet_bootstrap.cc:492] T ea63e0d471f84790a30e81a01d40d131 P 65755ebc82864dc3a3193b1ba3870613: Bootstrap starting.
I20260810 01:55:49.109301 24059 raft_consensus.cc:359] T ea63e0d471f84790a30e81a01d40d131 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:49.109606 24059 raft_consensus.cc:385] T ea63e0d471f84790a30e81a01d40d131 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:49.109733 24059 raft_consensus.cc:740] T ea63e0d471f84790a30e81a01d40d131 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687f288b7e9d4650a758d5451483e49b, State: Initialized, Role: FOLLOWER
I20260810 01:55:49.110082 24059 consensus_queue.cc:260] T ea63e0d471f84790a30e81a01d40d131 P 687f288b7e9d4650a758d5451483e49b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:49.110829 24059 ts_tablet_manager.cc:1434] T ea63e0d471f84790a30e81a01d40d131 P 687f288b7e9d4650a758d5451483e49b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:55:49.112216 24065 tablet_bootstrap.cc:654] T ea63e0d471f84790a30e81a01d40d131 P 65755ebc82864dc3a3193b1ba3870613: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:49.114682 23973 raft_consensus.cc:493] T adc7dc90da474e878d33fb70f40448f0 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:55:49.114868 23973 raft_consensus.cc:515] T adc7dc90da474e878d33fb70f40448f0 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } }
I20260810 01:55:49.115718 23973 leader_election.cc:290] T adc7dc90da474e878d33fb70f40448f0 P 5c71783cbed64297b17353312fcd4bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fabe62238d32404097129ae02ed3b0b3 (127.21.64.196:32931), 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194:33547)
I20260810 01:55:49.116876 22209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc7dc90da474e878d33fb70f40448f0" candidate_uuid: "5c71783cbed64297b17353312fcd4bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78c107f9dfbc4d3483895dda0f791bb2" is_pre_election: true
I20260810 01:55:49.117193 22209 raft_consensus.cc:2468] T adc7dc90da474e878d33fb70f40448f0 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c71783cbed64297b17353312fcd4bb0 in term 0.
I20260810 01:55:49.117587 22587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc7dc90da474e878d33fb70f40448f0" candidate_uuid: "5c71783cbed64297b17353312fcd4bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabe62238d32404097129ae02ed3b0b3" is_pre_election: true
I20260810 01:55:49.117826 22587 raft_consensus.cc:2468] T adc7dc90da474e878d33fb70f40448f0 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c71783cbed64297b17353312fcd4bb0 in term 0.
I20260810 01:55:49.117843 22861 leader_election.cc:304] T adc7dc90da474e878d33fb70f40448f0 P 5c71783cbed64297b17353312fcd4bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c71783cbed64297b17353312fcd4bb0, 78c107f9dfbc4d3483895dda0f791bb2; no voters:
I20260810 01:55:49.118218 23973 raft_consensus.cc:2804] T adc7dc90da474e878d33fb70f40448f0 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:55:49.118386 23973 raft_consensus.cc:493] T adc7dc90da474e878d33fb70f40448f0 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:55:49.118517 23973 raft_consensus.cc:3060] T adc7dc90da474e878d33fb70f40448f0 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:49.124701 24058 tablet_bootstrap.cc:492] T ea63e0d471f84790a30e81a01d40d131 P c5ca831c32e4452dba1cfc6cd296e532: No bootstrap required, opened a new log
I20260810 01:55:49.125008 24058 ts_tablet_manager.cc:1403] T ea63e0d471f84790a30e81a01d40d131 P c5ca831c32e4452dba1cfc6cd296e532: Time spent bootstrapping tablet: real 0.053s user 0.011s sys 0.008s
I20260810 01:55:49.125931 24058 raft_consensus.cc:359] T ea63e0d471f84790a30e81a01d40d131 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:49.126187 24058 raft_consensus.cc:385] T ea63e0d471f84790a30e81a01d40d131 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:49.126268 24058 raft_consensus.cc:740] T ea63e0d471f84790a30e81a01d40d131 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ca831c32e4452dba1cfc6cd296e532, State: Initialized, Role: FOLLOWER
I20260810 01:55:49.126525 24058 consensus_queue.cc:260] T ea63e0d471f84790a30e81a01d40d131 P c5ca831c32e4452dba1cfc6cd296e532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:49.127065 24058 ts_tablet_manager.cc:1434] T ea63e0d471f84790a30e81a01d40d131 P c5ca831c32e4452dba1cfc6cd296e532: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 01:55:49.128309 23973 raft_consensus.cc:515] T adc7dc90da474e878d33fb70f40448f0 P 5c71783cbed64297b17353312fcd4bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } }
I20260810 01:55:49.129537 24065 tablet_bootstrap.cc:492] T ea63e0d471f84790a30e81a01d40d131 P 65755ebc82864dc3a3193b1ba3870613: No bootstrap required, opened a new log
I20260810 01:55:49.129734 24065 ts_tablet_manager.cc:1403] T ea63e0d471f84790a30e81a01d40d131 P 65755ebc82864dc3a3193b1ba3870613: Time spent bootstrapping tablet: real 0.021s user 0.007s sys 0.011s
I20260810 01:55:49.130584 23973 leader_election.cc:290] T adc7dc90da474e878d33fb70f40448f0 P 5c71783cbed64297b17353312fcd4bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fabe62238d32404097129ae02ed3b0b3 (127.21.64.196:32931), 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194:33547)
I20260810 01:55:49.130651 24065 raft_consensus.cc:359] T ea63e0d471f84790a30e81a01d40d131 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:49.130894 24065 raft_consensus.cc:385] T ea63e0d471f84790a30e81a01d40d131 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:49.131127 24065 raft_consensus.cc:740] T ea63e0d471f84790a30e81a01d40d131 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65755ebc82864dc3a3193b1ba3870613, State: Initialized, Role: FOLLOWER
I20260810 01:55:49.131407 24065 consensus_queue.cc:260] T ea63e0d471f84790a30e81a01d40d131 P 65755ebc82864dc3a3193b1ba3870613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:49.131457 22209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc7dc90da474e878d33fb70f40448f0" candidate_uuid: "5c71783cbed64297b17353312fcd4bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78c107f9dfbc4d3483895dda0f791bb2"
I20260810 01:55:49.131736 22209 raft_consensus.cc:3060] T adc7dc90da474e878d33fb70f40448f0 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:49.132018 24065 ts_tablet_manager.cc:1434] T ea63e0d471f84790a30e81a01d40d131 P 65755ebc82864dc3a3193b1ba3870613: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:55:49.136425 22209 raft_consensus.cc:2468] T adc7dc90da474e878d33fb70f40448f0 P 78c107f9dfbc4d3483895dda0f791bb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c71783cbed64297b17353312fcd4bb0 in term 1.
I20260810 01:55:49.137320 22861 leader_election.cc:304] T adc7dc90da474e878d33fb70f40448f0 P 5c71783cbed64297b17353312fcd4bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c71783cbed64297b17353312fcd4bb0, 78c107f9dfbc4d3483895dda0f791bb2; no voters:
I20260810 01:55:49.137702 23973 raft_consensus.cc:2804] T adc7dc90da474e878d33fb70f40448f0 P 5c71783cbed64297b17353312fcd4bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:55:49.137811 23973 raft_consensus.cc:697] T adc7dc90da474e878d33fb70f40448f0 P 5c71783cbed64297b17353312fcd4bb0 [term 1 LEADER]: Becoming Leader. State: Replica: 5c71783cbed64297b17353312fcd4bb0, State: Running, Role: LEADER
I20260810 01:55:49.138087 23973 consensus_queue.cc:237] T adc7dc90da474e878d33fb70f40448f0 P 5c71783cbed64297b17353312fcd4bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } }
I20260810 01:55:49.141415 22587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc7dc90da474e878d33fb70f40448f0" candidate_uuid: "5c71783cbed64297b17353312fcd4bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabe62238d32404097129ae02ed3b0b3"
I20260810 01:55:49.141659 22587 raft_consensus.cc:3060] T adc7dc90da474e878d33fb70f40448f0 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:49.145004 22587 raft_consensus.cc:2468] T adc7dc90da474e878d33fb70f40448f0 P fabe62238d32404097129ae02ed3b0b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c71783cbed64297b17353312fcd4bb0 in term 1.
I20260810 01:55:49.148658 21825 catalog_manager.cc:5719] T adc7dc90da474e878d33fb70f40448f0 P 5c71783cbed64297b17353312fcd4bb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c71783cbed64297b17353312fcd4bb0 (127.21.64.198). New cstate: current_term: 1 leader_uuid: "5c71783cbed64297b17353312fcd4bb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } health_report { overall_health: UNKNOWN } } }
I20260810 01:55:49.166393 23909 raft_consensus.cc:493] T ea63e0d471f84790a30e81a01d40d131 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:55:49.166586 23909 raft_consensus.cc:515] T ea63e0d471f84790a30e81a01d40d131 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:49.167330 23909 leader_election.cc:290] T ea63e0d471f84790a30e81a01d40d131 P 65755ebc82864dc3a3193b1ba3870613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687f288b7e9d4650a758d5451483e49b (127.21.64.197:37655), c5ca831c32e4452dba1cfc6cd296e532 (127.21.64.193:39917)
I20260810 01:55:49.167811 22767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea63e0d471f84790a30e81a01d40d131" candidate_uuid: "65755ebc82864dc3a3193b1ba3870613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687f288b7e9d4650a758d5451483e49b" is_pre_election: true
I20260810 01:55:49.168113 22767 raft_consensus.cc:2468] T ea63e0d471f84790a30e81a01d40d131 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65755ebc82864dc3a3193b1ba3870613 in term 0.
I20260810 01:55:49.168154 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea63e0d471f84790a30e81a01d40d131" candidate_uuid: "65755ebc82864dc3a3193b1ba3870613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ca831c32e4452dba1cfc6cd296e532" is_pre_election: true
I20260810 01:55:49.168408 22024 raft_consensus.cc:2468] T ea63e0d471f84790a30e81a01d40d131 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65755ebc82864dc3a3193b1ba3870613 in term 0.
I20260810 01:55:49.168708 22294 leader_election.cc:304] T ea63e0d471f84790a30e81a01d40d131 P 65755ebc82864dc3a3193b1ba3870613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65755ebc82864dc3a3193b1ba3870613, 687f288b7e9d4650a758d5451483e49b; no voters:
I20260810 01:55:49.168987 23909 raft_consensus.cc:2804] T ea63e0d471f84790a30e81a01d40d131 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:55:49.169140 23909 raft_consensus.cc:493] T ea63e0d471f84790a30e81a01d40d131 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:55:49.169261 23909 raft_consensus.cc:3060] T ea63e0d471f84790a30e81a01d40d131 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:49.171262 23909 raft_consensus.cc:515] T ea63e0d471f84790a30e81a01d40d131 P 65755ebc82864dc3a3193b1ba3870613 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:49.172005 23909 leader_election.cc:290] T ea63e0d471f84790a30e81a01d40d131 P 65755ebc82864dc3a3193b1ba3870613 [CANDIDATE]: Term 1 election: Requested vote from peers 687f288b7e9d4650a758d5451483e49b (127.21.64.197:37655), c5ca831c32e4452dba1cfc6cd296e532 (127.21.64.193:39917)
I20260810 01:55:49.172379 22767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea63e0d471f84790a30e81a01d40d131" candidate_uuid: "65755ebc82864dc3a3193b1ba3870613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687f288b7e9d4650a758d5451483e49b"
I20260810 01:55:49.172546 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea63e0d471f84790a30e81a01d40d131" candidate_uuid: "65755ebc82864dc3a3193b1ba3870613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ca831c32e4452dba1cfc6cd296e532"
I20260810 01:55:49.172623 22767 raft_consensus.cc:3060] T ea63e0d471f84790a30e81a01d40d131 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:49.172751 22024 raft_consensus.cc:3060] T ea63e0d471f84790a30e81a01d40d131 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:49.175854 22024 raft_consensus.cc:2468] T ea63e0d471f84790a30e81a01d40d131 P c5ca831c32e4452dba1cfc6cd296e532 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65755ebc82864dc3a3193b1ba3870613 in term 1.
I20260810 01:55:49.175854 22767 raft_consensus.cc:2468] T ea63e0d471f84790a30e81a01d40d131 P 687f288b7e9d4650a758d5451483e49b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65755ebc82864dc3a3193b1ba3870613 in term 1.
I20260810 01:55:49.176488 22297 leader_election.cc:304] T ea63e0d471f84790a30e81a01d40d131 P 65755ebc82864dc3a3193b1ba3870613 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 65755ebc82864dc3a3193b1ba3870613, 687f288b7e9d4650a758d5451483e49b, c5ca831c32e4452dba1cfc6cd296e532; no voters:
I20260810 01:55:49.176810 23909 raft_consensus.cc:2804] T ea63e0d471f84790a30e81a01d40d131 P 65755ebc82864dc3a3193b1ba3870613 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:55:49.177410 23909 raft_consensus.cc:697] T ea63e0d471f84790a30e81a01d40d131 P 65755ebc82864dc3a3193b1ba3870613 [term 1 LEADER]: Becoming Leader. State: Replica: 65755ebc82864dc3a3193b1ba3870613, State: Running, Role: LEADER
I20260810 01:55:49.177781 23909 consensus_queue.cc:237] T ea63e0d471f84790a30e81a01d40d131 P 65755ebc82864dc3a3193b1ba3870613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:49.181485 21825 catalog_manager.cc:5719] T ea63e0d471f84790a30e81a01d40d131 P 65755ebc82864dc3a3193b1ba3870613 reported cstate change: term changed from 0 to 1, leader changed from <none> to 65755ebc82864dc3a3193b1ba3870613 (127.21.64.195). New cstate: current_term: 1 leader_uuid: "65755ebc82864dc3a3193b1ba3870613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } health_report { overall_health: UNKNOWN } } }
I20260810 01:55:49.232728 23909 raft_consensus.cc:493] T 35d4c74a46c44d1c9e98530d00061bdc P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:55:49.232939 23909 raft_consensus.cc:515] T 35d4c74a46c44d1c9e98530d00061bdc P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:49.233660 23909 leader_election.cc:290] T 35d4c74a46c44d1c9e98530d00061bdc P 65755ebc82864dc3a3193b1ba3870613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687f288b7e9d4650a758d5451483e49b (127.21.64.197:37655), c5ca831c32e4452dba1cfc6cd296e532 (127.21.64.193:39917)
I20260810 01:55:49.234187 22767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d4c74a46c44d1c9e98530d00061bdc" candidate_uuid: "65755ebc82864dc3a3193b1ba3870613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687f288b7e9d4650a758d5451483e49b" is_pre_election: true
I20260810 01:55:49.234194 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d4c74a46c44d1c9e98530d00061bdc" candidate_uuid: "65755ebc82864dc3a3193b1ba3870613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ca831c32e4452dba1cfc6cd296e532" is_pre_election: true
I20260810 01:55:49.234414 22767 raft_consensus.cc:2468] T 35d4c74a46c44d1c9e98530d00061bdc P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65755ebc82864dc3a3193b1ba3870613 in term 0.
I20260810 01:55:49.234515 22024 raft_consensus.cc:2468] T 35d4c74a46c44d1c9e98530d00061bdc P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65755ebc82864dc3a3193b1ba3870613 in term 0.
I20260810 01:55:49.234949 22294 leader_election.cc:304] T 35d4c74a46c44d1c9e98530d00061bdc P 65755ebc82864dc3a3193b1ba3870613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65755ebc82864dc3a3193b1ba3870613, 687f288b7e9d4650a758d5451483e49b; no voters:
I20260810 01:55:49.235286 23909 raft_consensus.cc:2804] T 35d4c74a46c44d1c9e98530d00061bdc P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:55:49.235391 23909 raft_consensus.cc:493] T 35d4c74a46c44d1c9e98530d00061bdc P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:55:49.235512 23909 raft_consensus.cc:3060] T 35d4c74a46c44d1c9e98530d00061bdc P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:49.238502 23909 raft_consensus.cc:515] T 35d4c74a46c44d1c9e98530d00061bdc P 65755ebc82864dc3a3193b1ba3870613 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:49.239125 23909 leader_election.cc:290] T 35d4c74a46c44d1c9e98530d00061bdc P 65755ebc82864dc3a3193b1ba3870613 [CANDIDATE]: Term 1 election: Requested vote from peers 687f288b7e9d4650a758d5451483e49b (127.21.64.197:37655), c5ca831c32e4452dba1cfc6cd296e532 (127.21.64.193:39917)
I20260810 01:55:49.239547 22767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d4c74a46c44d1c9e98530d00061bdc" candidate_uuid: "65755ebc82864dc3a3193b1ba3870613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687f288b7e9d4650a758d5451483e49b"
I20260810 01:55:49.239568 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d4c74a46c44d1c9e98530d00061bdc" candidate_uuid: "65755ebc82864dc3a3193b1ba3870613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ca831c32e4452dba1cfc6cd296e532"
I20260810 01:55:49.239723 22767 raft_consensus.cc:3060] T 35d4c74a46c44d1c9e98530d00061bdc P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:49.239748 22024 raft_consensus.cc:3060] T 35d4c74a46c44d1c9e98530d00061bdc P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:49.241796 22024 raft_consensus.cc:2468] T 35d4c74a46c44d1c9e98530d00061bdc P c5ca831c32e4452dba1cfc6cd296e532 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65755ebc82864dc3a3193b1ba3870613 in term 1.
I20260810 01:55:49.242230 22297 leader_election.cc:304] T 35d4c74a46c44d1c9e98530d00061bdc P 65755ebc82864dc3a3193b1ba3870613 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65755ebc82864dc3a3193b1ba3870613, c5ca831c32e4452dba1cfc6cd296e532; no voters:
I20260810 01:55:49.242535 23909 raft_consensus.cc:2804] T 35d4c74a46c44d1c9e98530d00061bdc P 65755ebc82864dc3a3193b1ba3870613 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:55:49.242722 22767 raft_consensus.cc:2468] T 35d4c74a46c44d1c9e98530d00061bdc P 687f288b7e9d4650a758d5451483e49b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65755ebc82864dc3a3193b1ba3870613 in term 1.
I20260810 01:55:49.242749 23909 raft_consensus.cc:697] T 35d4c74a46c44d1c9e98530d00061bdc P 65755ebc82864dc3a3193b1ba3870613 [term 1 LEADER]: Becoming Leader. State: Replica: 65755ebc82864dc3a3193b1ba3870613, State: Running, Role: LEADER
I20260810 01:55:49.243222 23909 consensus_queue.cc:237] T 35d4c74a46c44d1c9e98530d00061bdc P 65755ebc82864dc3a3193b1ba3870613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:49.246608 21825 catalog_manager.cc:5719] T 35d4c74a46c44d1c9e98530d00061bdc P 65755ebc82864dc3a3193b1ba3870613 reported cstate change: term changed from 0 to 1, leader changed from <none> to 65755ebc82864dc3a3193b1ba3870613 (127.21.64.195). New cstate: current_term: 1 leader_uuid: "65755ebc82864dc3a3193b1ba3870613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } health_report { overall_health: UNKNOWN } } }
I20260810 01:55:49.600571 23973 consensus_queue.cc:1048] T adc7dc90da474e878d33fb70f40448f0 P 5c71783cbed64297b17353312fcd4bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:49.607184 24082 consensus_queue.cc:1048] T adc7dc90da474e878d33fb70f40448f0 P 5c71783cbed64297b17353312fcd4bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:49.612977 24085 consensus_queue.cc:1048] T ea63e0d471f84790a30e81a01d40d131 P 65755ebc82864dc3a3193b1ba3870613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:49.624776 23909 consensus_queue.cc:1048] T ea63e0d471f84790a30e81a01d40d131 P 65755ebc82864dc3a3193b1ba3870613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 01:55:49.689663 24093 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:55:49.690196 24093 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260810 01:55:49.711411 23909 consensus_queue.cc:1048] T 35d4c74a46c44d1c9e98530d00061bdc P 65755ebc82864dc3a3193b1ba3870613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:49.721645 23909 consensus_queue.cc:1048] T 35d4c74a46c44d1c9e98530d00061bdc P 65755ebc82864dc3a3193b1ba3870613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
Using table 'rebalance_test_table_8'
INSERT report
rows total: 2000
time total: 284.54 ms
time per row: 0.14227 ms
I20260810 01:55:50.201743 21824 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60594:
name: "rebalance_test_table_9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260810 01:55:50.212127 22178 tablet_service.cc:1511] Processing CreateTablet for tablet 63866006eb03493e84bcb3661d1e2c04 (DEFAULT_TABLE table=rebalance_test_table_9 [id=4a28c66c369c453085dd64452c1ebee4]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:50.212394 22921 tablet_service.cc:1511] Processing CreateTablet for tablet 63866006eb03493e84bcb3661d1e2c04 (DEFAULT_TABLE table=rebalance_test_table_9 [id=4a28c66c369c453085dd64452c1ebee4]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:50.212647 22178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63866006eb03493e84bcb3661d1e2c04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:50.212672 22558 tablet_service.cc:1511] Processing CreateTablet for tablet 63866006eb03493e84bcb3661d1e2c04 (DEFAULT_TABLE table=rebalance_test_table_9 [id=4a28c66c369c453085dd64452c1ebee4]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:50.212847 22921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63866006eb03493e84bcb3661d1e2c04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:50.213078 22558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63866006eb03493e84bcb3661d1e2c04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:50.214332 22181 tablet_service.cc:1511] Processing CreateTablet for tablet 359ad38fcf6846fe82f7874ef454fe4b (DEFAULT_TABLE table=rebalance_test_table_9 [id=4a28c66c369c453085dd64452c1ebee4]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:50.214721 22181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 359ad38fcf6846fe82f7874ef454fe4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:50.218559 22922 tablet_service.cc:1511] Processing CreateTablet for tablet 359ad38fcf6846fe82f7874ef454fe4b (DEFAULT_TABLE table=rebalance_test_table_9 [id=4a28c66c369c453085dd64452c1ebee4]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:50.218931 22922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 359ad38fcf6846fe82f7874ef454fe4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:50.223405 21995 tablet_service.cc:1511] Processing CreateTablet for tablet 2f36b502299044ec842394062481252c (DEFAULT_TABLE table=rebalance_test_table_9 [id=4a28c66c369c453085dd64452c1ebee4]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:50.223881 21995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f36b502299044ec842394062481252c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:50.224424 22559 tablet_service.cc:1511] Processing CreateTablet for tablet 359ad38fcf6846fe82f7874ef454fe4b (DEFAULT_TABLE table=rebalance_test_table_9 [id=4a28c66c369c453085dd64452c1ebee4]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:50.224706 22740 tablet_service.cc:1511] Processing CreateTablet for tablet 2f36b502299044ec842394062481252c (DEFAULT_TABLE table=rebalance_test_table_9 [id=4a28c66c369c453085dd64452c1ebee4]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:50.224967 22559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 359ad38fcf6846fe82f7874ef454fe4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:50.225122 22740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f36b502299044ec842394062481252c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:50.226919 22363 tablet_service.cc:1511] Processing CreateTablet for tablet 2f36b502299044ec842394062481252c (DEFAULT_TABLE table=rebalance_test_table_9 [id=4a28c66c369c453085dd64452c1ebee4]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:50.227459 22363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f36b502299044ec842394062481252c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:50.238870 24194 tablet_bootstrap.cc:492] T 2f36b502299044ec842394062481252c P 687f288b7e9d4650a758d5451483e49b: Bootstrap starting.
I20260810 01:55:50.239886 24191 tablet_bootstrap.cc:492] T 63866006eb03493e84bcb3661d1e2c04 P 78c107f9dfbc4d3483895dda0f791bb2: Bootstrap starting.
I20260810 01:55:50.240907 24194 tablet_bootstrap.cc:654] T 2f36b502299044ec842394062481252c P 687f288b7e9d4650a758d5451483e49b: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:50.241927 24193 tablet_bootstrap.cc:492] T 2f36b502299044ec842394062481252c P c5ca831c32e4452dba1cfc6cd296e532: Bootstrap starting.
I20260810 01:55:50.242024 24191 tablet_bootstrap.cc:654] T 63866006eb03493e84bcb3661d1e2c04 P 78c107f9dfbc4d3483895dda0f791bb2: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:50.244002 24193 tablet_bootstrap.cc:654] T 2f36b502299044ec842394062481252c P c5ca831c32e4452dba1cfc6cd296e532: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:50.245622 24192 tablet_bootstrap.cc:492] T 63866006eb03493e84bcb3661d1e2c04 P 5c71783cbed64297b17353312fcd4bb0: Bootstrap starting.
I20260810 01:55:50.247536 24192 tablet_bootstrap.cc:654] T 63866006eb03493e84bcb3661d1e2c04 P 5c71783cbed64297b17353312fcd4bb0: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:50.248363 24194 tablet_bootstrap.cc:492] T 2f36b502299044ec842394062481252c P 687f288b7e9d4650a758d5451483e49b: No bootstrap required, opened a new log
I20260810 01:55:50.248615 24194 ts_tablet_manager.cc:1403] T 2f36b502299044ec842394062481252c P 687f288b7e9d4650a758d5451483e49b: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.000s
I20260810 01:55:50.249655 24194 raft_consensus.cc:359] T 2f36b502299044ec842394062481252c P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } }
I20260810 01:55:50.250057 24194 raft_consensus.cc:385] T 2f36b502299044ec842394062481252c P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:50.250234 24194 raft_consensus.cc:740] T 2f36b502299044ec842394062481252c P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687f288b7e9d4650a758d5451483e49b, State: Initialized, Role: FOLLOWER
I20260810 01:55:50.250651 24194 consensus_queue.cc:260] T 2f36b502299044ec842394062481252c P 687f288b7e9d4650a758d5451483e49b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } }
I20260810 01:55:50.251668 24193 tablet_bootstrap.cc:492] T 2f36b502299044ec842394062481252c P c5ca831c32e4452dba1cfc6cd296e532: No bootstrap required, opened a new log
I20260810 01:55:50.251879 24193 ts_tablet_manager.cc:1403] T 2f36b502299044ec842394062481252c P c5ca831c32e4452dba1cfc6cd296e532: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.000s
I20260810 01:55:50.252863 24193 raft_consensus.cc:359] T 2f36b502299044ec842394062481252c P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } }
I20260810 01:55:50.253161 24193 raft_consensus.cc:385] T 2f36b502299044ec842394062481252c P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:50.253330 24193 raft_consensus.cc:740] T 2f36b502299044ec842394062481252c P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ca831c32e4452dba1cfc6cd296e532, State: Initialized, Role: FOLLOWER
I20260810 01:55:50.253736 24193 consensus_queue.cc:260] T 2f36b502299044ec842394062481252c P c5ca831c32e4452dba1cfc6cd296e532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } }
I20260810 01:55:50.254767 24194 ts_tablet_manager.cc:1434] T 2f36b502299044ec842394062481252c P 687f288b7e9d4650a758d5451483e49b: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260810 01:55:50.255491 24193 ts_tablet_manager.cc:1434] T 2f36b502299044ec842394062481252c P c5ca831c32e4452dba1cfc6cd296e532: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 01:55:50.260669 24191 tablet_bootstrap.cc:492] T 63866006eb03493e84bcb3661d1e2c04 P 78c107f9dfbc4d3483895dda0f791bb2: No bootstrap required, opened a new log
I20260810 01:55:50.260939 24191 ts_tablet_manager.cc:1403] T 63866006eb03493e84bcb3661d1e2c04 P 78c107f9dfbc4d3483895dda0f791bb2: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.009s
I20260810 01:55:50.262198 24191 raft_consensus.cc:359] T 63866006eb03493e84bcb3661d1e2c04 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:50.262400 24191 raft_consensus.cc:385] T 63866006eb03493e84bcb3661d1e2c04 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:50.262506 24191 raft_consensus.cc:740] T 63866006eb03493e84bcb3661d1e2c04 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78c107f9dfbc4d3483895dda0f791bb2, State: Initialized, Role: FOLLOWER
I20260810 01:55:50.262801 24191 consensus_queue.cc:260] T 63866006eb03493e84bcb3661d1e2c04 P 78c107f9dfbc4d3483895dda0f791bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:50.263432 24191 ts_tablet_manager.cc:1434] T 63866006eb03493e84bcb3661d1e2c04 P 78c107f9dfbc4d3483895dda0f791bb2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:55:50.263831 24191 tablet_bootstrap.cc:492] T 359ad38fcf6846fe82f7874ef454fe4b P 78c107f9dfbc4d3483895dda0f791bb2: Bootstrap starting.
I20260810 01:55:50.265751 24191 tablet_bootstrap.cc:654] T 359ad38fcf6846fe82f7874ef454fe4b P 78c107f9dfbc4d3483895dda0f791bb2: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:50.269387 24191 tablet_bootstrap.cc:492] T 359ad38fcf6846fe82f7874ef454fe4b P 78c107f9dfbc4d3483895dda0f791bb2: No bootstrap required, opened a new log
I20260810 01:55:50.269574 24191 ts_tablet_manager.cc:1403] T 359ad38fcf6846fe82f7874ef454fe4b P 78c107f9dfbc4d3483895dda0f791bb2: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 01:55:50.270200 24191 raft_consensus.cc:359] T 359ad38fcf6846fe82f7874ef454fe4b P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:50.270411 24191 raft_consensus.cc:385] T 359ad38fcf6846fe82f7874ef454fe4b P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:50.270495 24191 raft_consensus.cc:740] T 359ad38fcf6846fe82f7874ef454fe4b P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78c107f9dfbc4d3483895dda0f791bb2, State: Initialized, Role: FOLLOWER
I20260810 01:55:50.270788 24191 consensus_queue.cc:260] T 359ad38fcf6846fe82f7874ef454fe4b P 78c107f9dfbc4d3483895dda0f791bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:50.271521 24191 ts_tablet_manager.cc:1434] T 359ad38fcf6846fe82f7874ef454fe4b P 78c107f9dfbc4d3483895dda0f791bb2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:55:50.276342 24205 tablet_bootstrap.cc:492] T 2f36b502299044ec842394062481252c P 65755ebc82864dc3a3193b1ba3870613: Bootstrap starting.
I20260810 01:55:50.278121 24205 tablet_bootstrap.cc:654] T 2f36b502299044ec842394062481252c P 65755ebc82864dc3a3193b1ba3870613: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:50.281066 24203 tablet_bootstrap.cc:492] T 359ad38fcf6846fe82f7874ef454fe4b P fabe62238d32404097129ae02ed3b0b3: Bootstrap starting.
I20260810 01:55:50.281693 24205 tablet_bootstrap.cc:492] T 2f36b502299044ec842394062481252c P 65755ebc82864dc3a3193b1ba3870613: No bootstrap required, opened a new log
I20260810 01:55:50.281857 24205 ts_tablet_manager.cc:1403] T 2f36b502299044ec842394062481252c P 65755ebc82864dc3a3193b1ba3870613: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.003s
I20260810 01:55:50.282510 24205 raft_consensus.cc:359] T 2f36b502299044ec842394062481252c P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } }
I20260810 01:55:50.282702 24205 raft_consensus.cc:385] T 2f36b502299044ec842394062481252c P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:50.282800 24205 raft_consensus.cc:740] T 2f36b502299044ec842394062481252c P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65755ebc82864dc3a3193b1ba3870613, State: Initialized, Role: FOLLOWER
I20260810 01:55:50.283057 24205 consensus_queue.cc:260] T 2f36b502299044ec842394062481252c P 65755ebc82864dc3a3193b1ba3870613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } }
I20260810 01:55:50.283589 24203 tablet_bootstrap.cc:654] T 359ad38fcf6846fe82f7874ef454fe4b P fabe62238d32404097129ae02ed3b0b3: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:50.283613 24205 ts_tablet_manager.cc:1434] T 2f36b502299044ec842394062481252c P 65755ebc82864dc3a3193b1ba3870613: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:55:50.288187 23532 raft_consensus.cc:493] T 359ad38fcf6846fe82f7874ef454fe4b P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:55:50.288374 23532 raft_consensus.cc:515] T 359ad38fcf6846fe82f7874ef454fe4b P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:50.289077 23532 leader_election.cc:290] T 359ad38fcf6846fe82f7874ef454fe4b P 78c107f9dfbc4d3483895dda0f791bb2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c71783cbed64297b17353312fcd4bb0 (127.21.64.198:33973), fabe62238d32404097129ae02ed3b0b3 (127.21.64.196:32931)
I20260810 01:55:50.289553 22951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359ad38fcf6846fe82f7874ef454fe4b" candidate_uuid: "78c107f9dfbc4d3483895dda0f791bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c71783cbed64297b17353312fcd4bb0" is_pre_election: true
I20260810 01:55:50.289765 22588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359ad38fcf6846fe82f7874ef454fe4b" candidate_uuid: "78c107f9dfbc4d3483895dda0f791bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabe62238d32404097129ae02ed3b0b3" is_pre_election: true
W20260810 01:55:50.290913 22111 leader_election.cc:343] T 359ad38fcf6846fe82f7874ef454fe4b P 78c107f9dfbc4d3483895dda0f791bb2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabe62238d32404097129ae02ed3b0b3 (127.21.64.196:32931): Illegal state: must be running to vote when last-logged opid is not known
W20260810 01:55:50.291226 22116 leader_election.cc:343] T 359ad38fcf6846fe82f7874ef454fe4b P 78c107f9dfbc4d3483895dda0f791bb2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c71783cbed64297b17353312fcd4bb0 (127.21.64.198:33973): Illegal state: must be running to vote when last-logged opid is not known
I20260810 01:55:50.291380 22116 leader_election.cc:304] T 359ad38fcf6846fe82f7874ef454fe4b P 78c107f9dfbc4d3483895dda0f791bb2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 78c107f9dfbc4d3483895dda0f791bb2; no voters: 5c71783cbed64297b17353312fcd4bb0, fabe62238d32404097129ae02ed3b0b3
I20260810 01:55:50.292474 23532 raft_consensus.cc:2749] T 359ad38fcf6846fe82f7874ef454fe4b P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 01:55:50.295540 24203 tablet_bootstrap.cc:492] T 359ad38fcf6846fe82f7874ef454fe4b P fabe62238d32404097129ae02ed3b0b3: No bootstrap required, opened a new log
I20260810 01:55:50.295769 24203 ts_tablet_manager.cc:1403] T 359ad38fcf6846fe82f7874ef454fe4b P fabe62238d32404097129ae02ed3b0b3: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.000s
I20260810 01:55:50.296868 24203 raft_consensus.cc:359] T 359ad38fcf6846fe82f7874ef454fe4b P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:50.297158 24203 raft_consensus.cc:385] T 359ad38fcf6846fe82f7874ef454fe4b P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:50.297286 24203 raft_consensus.cc:740] T 359ad38fcf6846fe82f7874ef454fe4b P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabe62238d32404097129ae02ed3b0b3, State: Initialized, Role: FOLLOWER
I20260810 01:55:50.298071 24203 consensus_queue.cc:260] T 359ad38fcf6846fe82f7874ef454fe4b P fabe62238d32404097129ae02ed3b0b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:50.299548 24203 ts_tablet_manager.cc:1434] T 359ad38fcf6846fe82f7874ef454fe4b P fabe62238d32404097129ae02ed3b0b3: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260810 01:55:50.299868 24203 tablet_bootstrap.cc:492] T 63866006eb03493e84bcb3661d1e2c04 P fabe62238d32404097129ae02ed3b0b3: Bootstrap starting.
I20260810 01:55:50.301534 24192 tablet_bootstrap.cc:492] T 63866006eb03493e84bcb3661d1e2c04 P 5c71783cbed64297b17353312fcd4bb0: No bootstrap required, opened a new log
I20260810 01:55:50.301702 24192 ts_tablet_manager.cc:1403] T 63866006eb03493e84bcb3661d1e2c04 P 5c71783cbed64297b17353312fcd4bb0: Time spent bootstrapping tablet: real 0.056s user 0.021s sys 0.028s
I20260810 01:55:50.302510 24192 raft_consensus.cc:359] T 63866006eb03493e84bcb3661d1e2c04 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:50.302683 24203 tablet_bootstrap.cc:654] T 63866006eb03493e84bcb3661d1e2c04 P fabe62238d32404097129ae02ed3b0b3: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:50.302734 24192 raft_consensus.cc:385] T 63866006eb03493e84bcb3661d1e2c04 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:50.302822 24192 raft_consensus.cc:740] T 63866006eb03493e84bcb3661d1e2c04 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c71783cbed64297b17353312fcd4bb0, State: Initialized, Role: FOLLOWER
I20260810 01:55:50.303064 24192 consensus_queue.cc:260] T 63866006eb03493e84bcb3661d1e2c04 P 5c71783cbed64297b17353312fcd4bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:50.303726 24192 ts_tablet_manager.cc:1434] T 63866006eb03493e84bcb3661d1e2c04 P 5c71783cbed64297b17353312fcd4bb0: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 01:55:50.304071 24192 tablet_bootstrap.cc:492] T 359ad38fcf6846fe82f7874ef454fe4b P 5c71783cbed64297b17353312fcd4bb0: Bootstrap starting.
I20260810 01:55:50.306382 24192 tablet_bootstrap.cc:654] T 359ad38fcf6846fe82f7874ef454fe4b P 5c71783cbed64297b17353312fcd4bb0: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:50.311853 24192 tablet_bootstrap.cc:492] T 359ad38fcf6846fe82f7874ef454fe4b P 5c71783cbed64297b17353312fcd4bb0: No bootstrap required, opened a new log
I20260810 01:55:50.311870 24203 tablet_bootstrap.cc:492] T 63866006eb03493e84bcb3661d1e2c04 P fabe62238d32404097129ae02ed3b0b3: No bootstrap required, opened a new log
I20260810 01:55:50.312034 24192 ts_tablet_manager.cc:1403] T 359ad38fcf6846fe82f7874ef454fe4b P 5c71783cbed64297b17353312fcd4bb0: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260810 01:55:50.312034 24203 ts_tablet_manager.cc:1403] T 63866006eb03493e84bcb3661d1e2c04 P fabe62238d32404097129ae02ed3b0b3: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.007s
I20260810 01:55:50.312825 24203 raft_consensus.cc:359] T 63866006eb03493e84bcb3661d1e2c04 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:50.312812 24192 raft_consensus.cc:359] T 359ad38fcf6846fe82f7874ef454fe4b P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:50.313040 24192 raft_consensus.cc:385] T 359ad38fcf6846fe82f7874ef454fe4b P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:50.313040 24203 raft_consensus.cc:385] T 63866006eb03493e84bcb3661d1e2c04 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:50.313126 24192 raft_consensus.cc:740] T 359ad38fcf6846fe82f7874ef454fe4b P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c71783cbed64297b17353312fcd4bb0, State: Initialized, Role: FOLLOWER
I20260810 01:55:50.313133 24203 raft_consensus.cc:740] T 63866006eb03493e84bcb3661d1e2c04 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabe62238d32404097129ae02ed3b0b3, State: Initialized, Role: FOLLOWER
I20260810 01:55:50.313405 24192 consensus_queue.cc:260] T 359ad38fcf6846fe82f7874ef454fe4b P 5c71783cbed64297b17353312fcd4bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:50.313421 24203 consensus_queue.cc:260] T 63866006eb03493e84bcb3661d1e2c04 P fabe62238d32404097129ae02ed3b0b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:50.313922 24203 ts_tablet_manager.cc:1434] T 63866006eb03493e84bcb3661d1e2c04 P fabe62238d32404097129ae02ed3b0b3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:55:50.314091 24192 ts_tablet_manager.cc:1434] T 359ad38fcf6846fe82f7874ef454fe4b P 5c71783cbed64297b17353312fcd4bb0: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 01:55:50.377547 23153 raft_consensus.cc:493] T 2f36b502299044ec842394062481252c P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:55:50.377714 23153 raft_consensus.cc:515] T 2f36b502299044ec842394062481252c P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } }
I20260810 01:55:50.378484 23153 leader_election.cc:290] T 2f36b502299044ec842394062481252c P 687f288b7e9d4650a758d5451483e49b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ca831c32e4452dba1cfc6cd296e532 (127.21.64.193:39917), 65755ebc82864dc3a3193b1ba3870613 (127.21.64.195:46103)
I20260810 01:55:50.378862 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f36b502299044ec842394062481252c" candidate_uuid: "687f288b7e9d4650a758d5451483e49b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ca831c32e4452dba1cfc6cd296e532" is_pre_election: true
I20260810 01:55:50.379106 22392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f36b502299044ec842394062481252c" candidate_uuid: "687f288b7e9d4650a758d5451483e49b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65755ebc82864dc3a3193b1ba3870613" is_pre_election: true
I20260810 01:55:50.379257 22024 raft_consensus.cc:2468] T 2f36b502299044ec842394062481252c P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687f288b7e9d4650a758d5451483e49b in term 0.
I20260810 01:55:50.379335 22392 raft_consensus.cc:2468] T 2f36b502299044ec842394062481252c P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687f288b7e9d4650a758d5451483e49b in term 0.
I20260810 01:55:50.379814 22691 leader_election.cc:304] T 2f36b502299044ec842394062481252c P 687f288b7e9d4650a758d5451483e49b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687f288b7e9d4650a758d5451483e49b, c5ca831c32e4452dba1cfc6cd296e532; no voters:
I20260810 01:55:50.380124 23153 raft_consensus.cc:2804] T 2f36b502299044ec842394062481252c P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:55:50.380230 23153 raft_consensus.cc:493] T 2f36b502299044ec842394062481252c P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:55:50.380338 23153 raft_consensus.cc:3060] T 2f36b502299044ec842394062481252c P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:50.383016 23153 raft_consensus.cc:515] T 2f36b502299044ec842394062481252c P 687f288b7e9d4650a758d5451483e49b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } }
I20260810 01:55:50.383684 23153 leader_election.cc:290] T 2f36b502299044ec842394062481252c P 687f288b7e9d4650a758d5451483e49b [CANDIDATE]: Term 1 election: Requested vote from peers c5ca831c32e4452dba1cfc6cd296e532 (127.21.64.193:39917), 65755ebc82864dc3a3193b1ba3870613 (127.21.64.195:46103)
I20260810 01:55:50.384063 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f36b502299044ec842394062481252c" candidate_uuid: "687f288b7e9d4650a758d5451483e49b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ca831c32e4452dba1cfc6cd296e532"
I20260810 01:55:50.384270 22024 raft_consensus.cc:3060] T 2f36b502299044ec842394062481252c P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:50.384346 22392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f36b502299044ec842394062481252c" candidate_uuid: "687f288b7e9d4650a758d5451483e49b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65755ebc82864dc3a3193b1ba3870613"
I20260810 01:55:50.384539 22392 raft_consensus.cc:3060] T 2f36b502299044ec842394062481252c P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:50.386446 22024 raft_consensus.cc:2468] T 2f36b502299044ec842394062481252c P c5ca831c32e4452dba1cfc6cd296e532 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687f288b7e9d4650a758d5451483e49b in term 1.
I20260810 01:55:50.386623 22392 raft_consensus.cc:2468] T 2f36b502299044ec842394062481252c P 65755ebc82864dc3a3193b1ba3870613 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687f288b7e9d4650a758d5451483e49b in term 1.
I20260810 01:55:50.386834 22691 leader_election.cc:304] T 2f36b502299044ec842394062481252c P 687f288b7e9d4650a758d5451483e49b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687f288b7e9d4650a758d5451483e49b, c5ca831c32e4452dba1cfc6cd296e532; no voters:
I20260810 01:55:50.387205 23153 raft_consensus.cc:2804] T 2f36b502299044ec842394062481252c P 687f288b7e9d4650a758d5451483e49b [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:55:50.387596 23153 raft_consensus.cc:697] T 2f36b502299044ec842394062481252c P 687f288b7e9d4650a758d5451483e49b [term 1 LEADER]: Becoming Leader. State: Replica: 687f288b7e9d4650a758d5451483e49b, State: Running, Role: LEADER
I20260810 01:55:50.387933 23153 consensus_queue.cc:237] T 2f36b502299044ec842394062481252c P 687f288b7e9d4650a758d5451483e49b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } }
I20260810 01:55:50.390882 21825 catalog_manager.cc:5719] T 2f36b502299044ec842394062481252c P 687f288b7e9d4650a758d5451483e49b reported cstate change: term changed from 0 to 1, leader changed from <none> to 687f288b7e9d4650a758d5451483e49b (127.21.64.197). New cstate: current_term: 1 leader_uuid: "687f288b7e9d4650a758d5451483e49b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } health_report { overall_health: HEALTHY } } }
I20260810 01:55:50.391743 24082 raft_consensus.cc:493] T 359ad38fcf6846fe82f7874ef454fe4b P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:55:50.392017 24082 raft_consensus.cc:515] T 359ad38fcf6846fe82f7874ef454fe4b P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:50.392697 24082 leader_election.cc:290] T 359ad38fcf6846fe82f7874ef454fe4b P 5c71783cbed64297b17353312fcd4bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194:33547), fabe62238d32404097129ae02ed3b0b3 (127.21.64.196:32931)
I20260810 01:55:50.393340 22209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359ad38fcf6846fe82f7874ef454fe4b" candidate_uuid: "5c71783cbed64297b17353312fcd4bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78c107f9dfbc4d3483895dda0f791bb2" is_pre_election: true
I20260810 01:55:50.393465 22588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359ad38fcf6846fe82f7874ef454fe4b" candidate_uuid: "5c71783cbed64297b17353312fcd4bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabe62238d32404097129ae02ed3b0b3" is_pre_election: true
I20260810 01:55:50.393596 22209 raft_consensus.cc:2468] T 359ad38fcf6846fe82f7874ef454fe4b P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c71783cbed64297b17353312fcd4bb0 in term 0.
I20260810 01:55:50.393710 22588 raft_consensus.cc:2468] T 359ad38fcf6846fe82f7874ef454fe4b P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c71783cbed64297b17353312fcd4bb0 in term 0.
I20260810 01:55:50.394240 22857 leader_election.cc:304] T 359ad38fcf6846fe82f7874ef454fe4b P 5c71783cbed64297b17353312fcd4bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c71783cbed64297b17353312fcd4bb0, fabe62238d32404097129ae02ed3b0b3; no voters:
I20260810 01:55:50.394727 24082 raft_consensus.cc:2804] T 359ad38fcf6846fe82f7874ef454fe4b P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:55:50.394815 24082 raft_consensus.cc:493] T 359ad38fcf6846fe82f7874ef454fe4b P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:55:50.394894 24082 raft_consensus.cc:3060] T 359ad38fcf6846fe82f7874ef454fe4b P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:50.397701 24082 raft_consensus.cc:515] T 359ad38fcf6846fe82f7874ef454fe4b P 5c71783cbed64297b17353312fcd4bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:50.398263 24082 leader_election.cc:290] T 359ad38fcf6846fe82f7874ef454fe4b P 5c71783cbed64297b17353312fcd4bb0 [CANDIDATE]: Term 1 election: Requested vote from peers 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194:33547), fabe62238d32404097129ae02ed3b0b3 (127.21.64.196:32931)
I20260810 01:55:50.398746 22209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359ad38fcf6846fe82f7874ef454fe4b" candidate_uuid: "5c71783cbed64297b17353312fcd4bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78c107f9dfbc4d3483895dda0f791bb2"
I20260810 01:55:50.398769 22588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359ad38fcf6846fe82f7874ef454fe4b" candidate_uuid: "5c71783cbed64297b17353312fcd4bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabe62238d32404097129ae02ed3b0b3"
I20260810 01:55:50.398898 22209 raft_consensus.cc:3060] T 359ad38fcf6846fe82f7874ef454fe4b P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:50.398967 22588 raft_consensus.cc:3060] T 359ad38fcf6846fe82f7874ef454fe4b P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:50.401201 22209 raft_consensus.cc:2468] T 359ad38fcf6846fe82f7874ef454fe4b P 78c107f9dfbc4d3483895dda0f791bb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c71783cbed64297b17353312fcd4bb0 in term 1.
I20260810 01:55:50.401276 22588 raft_consensus.cc:2468] T 359ad38fcf6846fe82f7874ef454fe4b P fabe62238d32404097129ae02ed3b0b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c71783cbed64297b17353312fcd4bb0 in term 1.
I20260810 01:55:50.401706 22861 leader_election.cc:304] T 359ad38fcf6846fe82f7874ef454fe4b P 5c71783cbed64297b17353312fcd4bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c71783cbed64297b17353312fcd4bb0, 78c107f9dfbc4d3483895dda0f791bb2; no voters:
I20260810 01:55:50.401991 24082 raft_consensus.cc:2804] T 359ad38fcf6846fe82f7874ef454fe4b P 5c71783cbed64297b17353312fcd4bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:55:50.402196 24082 raft_consensus.cc:697] T 359ad38fcf6846fe82f7874ef454fe4b P 5c71783cbed64297b17353312fcd4bb0 [term 1 LEADER]: Becoming Leader. State: Replica: 5c71783cbed64297b17353312fcd4bb0, State: Running, Role: LEADER
I20260810 01:55:50.402520 24082 consensus_queue.cc:237] T 359ad38fcf6846fe82f7874ef454fe4b P 5c71783cbed64297b17353312fcd4bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:50.405689 21825 catalog_manager.cc:5719] T 359ad38fcf6846fe82f7874ef454fe4b P 5c71783cbed64297b17353312fcd4bb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c71783cbed64297b17353312fcd4bb0 (127.21.64.198). New cstate: current_term: 1 leader_uuid: "5c71783cbed64297b17353312fcd4bb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } health_report { overall_health: UNKNOWN } } }
I20260810 01:55:50.432071 24082 raft_consensus.cc:493] T 63866006eb03493e84bcb3661d1e2c04 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:55:50.432247 24082 raft_consensus.cc:515] T 63866006eb03493e84bcb3661d1e2c04 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:50.433046 24082 leader_election.cc:290] T 63866006eb03493e84bcb3661d1e2c04 P 5c71783cbed64297b17353312fcd4bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194:33547), fabe62238d32404097129ae02ed3b0b3 (127.21.64.196:32931)
I20260810 01:55:50.433563 22209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63866006eb03493e84bcb3661d1e2c04" candidate_uuid: "5c71783cbed64297b17353312fcd4bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78c107f9dfbc4d3483895dda0f791bb2" is_pre_election: true
I20260810 01:55:50.433660 22588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63866006eb03493e84bcb3661d1e2c04" candidate_uuid: "5c71783cbed64297b17353312fcd4bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabe62238d32404097129ae02ed3b0b3" is_pre_election: true
I20260810 01:55:50.433863 22209 raft_consensus.cc:2468] T 63866006eb03493e84bcb3661d1e2c04 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c71783cbed64297b17353312fcd4bb0 in term 0.
I20260810 01:55:50.433944 22588 raft_consensus.cc:2468] T 63866006eb03493e84bcb3661d1e2c04 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c71783cbed64297b17353312fcd4bb0 in term 0.
I20260810 01:55:50.434407 22861 leader_election.cc:304] T 63866006eb03493e84bcb3661d1e2c04 P 5c71783cbed64297b17353312fcd4bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c71783cbed64297b17353312fcd4bb0, 78c107f9dfbc4d3483895dda0f791bb2; no voters:
I20260810 01:55:50.434727 24082 raft_consensus.cc:2804] T 63866006eb03493e84bcb3661d1e2c04 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:55:50.434826 24082 raft_consensus.cc:493] T 63866006eb03493e84bcb3661d1e2c04 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:55:50.434892 24082 raft_consensus.cc:3060] T 63866006eb03493e84bcb3661d1e2c04 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:50.436810 24082 raft_consensus.cc:515] T 63866006eb03493e84bcb3661d1e2c04 P 5c71783cbed64297b17353312fcd4bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:50.437883 22209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63866006eb03493e84bcb3661d1e2c04" candidate_uuid: "5c71783cbed64297b17353312fcd4bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78c107f9dfbc4d3483895dda0f791bb2"
I20260810 01:55:50.438019 24082 leader_election.cc:290] T 63866006eb03493e84bcb3661d1e2c04 P 5c71783cbed64297b17353312fcd4bb0 [CANDIDATE]: Term 1 election: Requested vote from peers 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194:33547), fabe62238d32404097129ae02ed3b0b3 (127.21.64.196:32931)
I20260810 01:55:50.438657 22209 raft_consensus.cc:3060] T 63866006eb03493e84bcb3661d1e2c04 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:50.438674 22588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63866006eb03493e84bcb3661d1e2c04" candidate_uuid: "5c71783cbed64297b17353312fcd4bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabe62238d32404097129ae02ed3b0b3"
I20260810 01:55:50.438894 22588 raft_consensus.cc:3060] T 63866006eb03493e84bcb3661d1e2c04 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:50.442339 22209 raft_consensus.cc:2468] T 63866006eb03493e84bcb3661d1e2c04 P 78c107f9dfbc4d3483895dda0f791bb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c71783cbed64297b17353312fcd4bb0 in term 1.
I20260810 01:55:50.442509 22588 raft_consensus.cc:2468] T 63866006eb03493e84bcb3661d1e2c04 P fabe62238d32404097129ae02ed3b0b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c71783cbed64297b17353312fcd4bb0 in term 1.
I20260810 01:55:50.442860 22861 leader_election.cc:304] T 63866006eb03493e84bcb3661d1e2c04 P 5c71783cbed64297b17353312fcd4bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c71783cbed64297b17353312fcd4bb0, 78c107f9dfbc4d3483895dda0f791bb2; no voters:
I20260810 01:55:50.443320 24082 raft_consensus.cc:2804] T 63866006eb03493e84bcb3661d1e2c04 P 5c71783cbed64297b17353312fcd4bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:55:50.443486 24082 raft_consensus.cc:697] T 63866006eb03493e84bcb3661d1e2c04 P 5c71783cbed64297b17353312fcd4bb0 [term 1 LEADER]: Becoming Leader. State: Replica: 5c71783cbed64297b17353312fcd4bb0, State: Running, Role: LEADER
I20260810 01:55:50.443822 24082 consensus_queue.cc:237] T 63866006eb03493e84bcb3661d1e2c04 P 5c71783cbed64297b17353312fcd4bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:50.447162 21825 catalog_manager.cc:5719] T 63866006eb03493e84bcb3661d1e2c04 P 5c71783cbed64297b17353312fcd4bb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c71783cbed64297b17353312fcd4bb0 (127.21.64.198). New cstate: current_term: 1 leader_uuid: "5c71783cbed64297b17353312fcd4bb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } health_report { overall_health: UNKNOWN } } }
I20260810 01:55:50.840629 24082 consensus_queue.cc:1048] T 359ad38fcf6846fe82f7874ef454fe4b P 5c71783cbed64297b17353312fcd4bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:50.848132 24082 consensus_queue.cc:1048] T 359ad38fcf6846fe82f7874ef454fe4b P 5c71783cbed64297b17353312fcd4bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:50.898337 23153 consensus_queue.cc:1048] T 2f36b502299044ec842394062481252c P 687f288b7e9d4650a758d5451483e49b [LEADER]: Connected to new peer: Peer: permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:50.905617 24237 consensus_queue.cc:1048] T 2f36b502299044ec842394062481252c P 687f288b7e9d4650a758d5451483e49b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 01:55:50.913316 24216 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:55:50.913818 24216 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260810 01:55:50.926223 24082 consensus_queue.cc:1048] T 63866006eb03493e84bcb3661d1e2c04 P 5c71783cbed64297b17353312fcd4bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:50.932636 24082 consensus_queue.cc:1048] T 63866006eb03493e84bcb3661d1e2c04 P 5c71783cbed64297b17353312fcd4bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
Using table 'rebalance_test_table_9'
INSERT report
rows total: 2000
time total: 321.843 ms
time per row: 0.160922 ms
I20260810 01:55:51.440802 21819 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60594:
name: "rebalance_test_table_10"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260810 01:55:51.451253 22363 tablet_service.cc:1511] Processing CreateTablet for tablet 2dbf8a1de7674d8b88b046c757664d57 (DEFAULT_TABLE table=rebalance_test_table_10 [id=7014d4907d564a27ad6929f69de252bc]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:51.451520 21995 tablet_service.cc:1511] Processing CreateTablet for tablet 2dbf8a1de7674d8b88b046c757664d57 (DEFAULT_TABLE table=rebalance_test_table_10 [id=7014d4907d564a27ad6929f69de252bc]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:51.451767 22363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dbf8a1de7674d8b88b046c757664d57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:51.451743 22740 tablet_service.cc:1511] Processing CreateTablet for tablet 2dbf8a1de7674d8b88b046c757664d57 (DEFAULT_TABLE table=rebalance_test_table_10 [id=7014d4907d564a27ad6929f69de252bc]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:51.452013 21995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dbf8a1de7674d8b88b046c757664d57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:51.452160 22740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dbf8a1de7674d8b88b046c757664d57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:51.455339 22364 tablet_service.cc:1511] Processing CreateTablet for tablet fb7d801916db4a8c99e18e9ca9606f11 (DEFAULT_TABLE table=rebalance_test_table_10 [id=7014d4907d564a27ad6929f69de252bc]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:51.455739 22364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb7d801916db4a8c99e18e9ca9606f11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:51.456478 22178 tablet_service.cc:1511] Processing CreateTablet for tablet 28b80aa4fa264ceb88af4864206f1e10 (DEFAULT_TABLE table=rebalance_test_table_10 [id=7014d4907d564a27ad6929f69de252bc]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:51.456960 22178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28b80aa4fa264ceb88af4864206f1e10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:51.457892 21994 tablet_service.cc:1511] Processing CreateTablet for tablet fb7d801916db4a8c99e18e9ca9606f11 (DEFAULT_TABLE table=rebalance_test_table_10 [id=7014d4907d564a27ad6929f69de252bc]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:51.458369 21994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb7d801916db4a8c99e18e9ca9606f11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:51.460449 22739 tablet_service.cc:1511] Processing CreateTablet for tablet fb7d801916db4a8c99e18e9ca9606f11 (DEFAULT_TABLE table=rebalance_test_table_10 [id=7014d4907d564a27ad6929f69de252bc]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:51.460911 22739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb7d801916db4a8c99e18e9ca9606f11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:51.462006 22559 tablet_service.cc:1511] Processing CreateTablet for tablet 28b80aa4fa264ceb88af4864206f1e10 (DEFAULT_TABLE table=rebalance_test_table_10 [id=7014d4907d564a27ad6929f69de252bc]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:51.462479 22559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28b80aa4fa264ceb88af4864206f1e10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:51.464395 24316 tablet_bootstrap.cc:492] T 2dbf8a1de7674d8b88b046c757664d57 P 687f288b7e9d4650a758d5451483e49b: Bootstrap starting.
I20260810 01:55:51.465900 22922 tablet_service.cc:1511] Processing CreateTablet for tablet 28b80aa4fa264ceb88af4864206f1e10 (DEFAULT_TABLE table=rebalance_test_table_10 [id=7014d4907d564a27ad6929f69de252bc]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:51.466454 22922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28b80aa4fa264ceb88af4864206f1e10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:51.470474 24316 tablet_bootstrap.cc:654] T 2dbf8a1de7674d8b88b046c757664d57 P 687f288b7e9d4650a758d5451483e49b: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:51.475013 24318 tablet_bootstrap.cc:492] T 2dbf8a1de7674d8b88b046c757664d57 P c5ca831c32e4452dba1cfc6cd296e532: Bootstrap starting.
I20260810 01:55:51.477764 24318 tablet_bootstrap.cc:654] T 2dbf8a1de7674d8b88b046c757664d57 P c5ca831c32e4452dba1cfc6cd296e532: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:51.483196 24322 tablet_bootstrap.cc:492] T 28b80aa4fa264ceb88af4864206f1e10 P fabe62238d32404097129ae02ed3b0b3: Bootstrap starting.
I20260810 01:55:51.485693 24318 tablet_bootstrap.cc:492] T 2dbf8a1de7674d8b88b046c757664d57 P c5ca831c32e4452dba1cfc6cd296e532: No bootstrap required, opened a new log
I20260810 01:55:51.485888 24318 ts_tablet_manager.cc:1403] T 2dbf8a1de7674d8b88b046c757664d57 P c5ca831c32e4452dba1cfc6cd296e532: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260810 01:55:51.486743 24318 raft_consensus.cc:359] T 2dbf8a1de7674d8b88b046c757664d57 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } }
I20260810 01:55:51.486987 24318 raft_consensus.cc:385] T 2dbf8a1de7674d8b88b046c757664d57 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:51.487104 24318 raft_consensus.cc:740] T 2dbf8a1de7674d8b88b046c757664d57 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ca831c32e4452dba1cfc6cd296e532, State: Initialized, Role: FOLLOWER
I20260810 01:55:51.487416 24318 consensus_queue.cc:260] T 2dbf8a1de7674d8b88b046c757664d57 P c5ca831c32e4452dba1cfc6cd296e532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } }
I20260810 01:55:51.487919 24330 tablet_bootstrap.cc:492] T fb7d801916db4a8c99e18e9ca9606f11 P 65755ebc82864dc3a3193b1ba3870613: Bootstrap starting.
I20260810 01:55:51.489218 24322 tablet_bootstrap.cc:654] T 28b80aa4fa264ceb88af4864206f1e10 P fabe62238d32404097129ae02ed3b0b3: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:51.490005 24318 ts_tablet_manager.cc:1434] T 2dbf8a1de7674d8b88b046c757664d57 P c5ca831c32e4452dba1cfc6cd296e532: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260810 01:55:51.490375 24330 tablet_bootstrap.cc:654] T fb7d801916db4a8c99e18e9ca9606f11 P 65755ebc82864dc3a3193b1ba3870613: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:51.495179 24318 tablet_bootstrap.cc:492] T fb7d801916db4a8c99e18e9ca9606f11 P c5ca831c32e4452dba1cfc6cd296e532: Bootstrap starting.
I20260810 01:55:51.496791 24317 tablet_bootstrap.cc:492] T 28b80aa4fa264ceb88af4864206f1e10 P 78c107f9dfbc4d3483895dda0f791bb2: Bootstrap starting.
I20260810 01:55:51.497130 24318 tablet_bootstrap.cc:654] T fb7d801916db4a8c99e18e9ca9606f11 P c5ca831c32e4452dba1cfc6cd296e532: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:51.499501 24317 tablet_bootstrap.cc:654] T 28b80aa4fa264ceb88af4864206f1e10 P 78c107f9dfbc4d3483895dda0f791bb2: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:51.500128 24332 tablet_bootstrap.cc:492] T 28b80aa4fa264ceb88af4864206f1e10 P 5c71783cbed64297b17353312fcd4bb0: Bootstrap starting.
I20260810 01:55:51.500471 24330 tablet_bootstrap.cc:492] T fb7d801916db4a8c99e18e9ca9606f11 P 65755ebc82864dc3a3193b1ba3870613: No bootstrap required, opened a new log
I20260810 01:55:51.501180 24316 tablet_bootstrap.cc:492] T 2dbf8a1de7674d8b88b046c757664d57 P 687f288b7e9d4650a758d5451483e49b: No bootstrap required, opened a new log
I20260810 01:55:51.501327 24330 ts_tablet_manager.cc:1403] T fb7d801916db4a8c99e18e9ca9606f11 P 65755ebc82864dc3a3193b1ba3870613: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.000s
I20260810 01:55:51.501437 24316 ts_tablet_manager.cc:1403] T 2dbf8a1de7674d8b88b046c757664d57 P 687f288b7e9d4650a758d5451483e49b: Time spent bootstrapping tablet: real 0.037s user 0.005s sys 0.015s
I20260810 01:55:51.502431 24330 raft_consensus.cc:359] T fb7d801916db4a8c99e18e9ca9606f11 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } }
I20260810 01:55:51.502539 24316 raft_consensus.cc:359] T 2dbf8a1de7674d8b88b046c757664d57 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } }
I20260810 01:55:51.502816 24316 raft_consensus.cc:385] T 2dbf8a1de7674d8b88b046c757664d57 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:51.502838 24330 raft_consensus.cc:385] T fb7d801916db4a8c99e18e9ca9606f11 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:51.502943 24316 raft_consensus.cc:740] T 2dbf8a1de7674d8b88b046c757664d57 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687f288b7e9d4650a758d5451483e49b, State: Initialized, Role: FOLLOWER
I20260810 01:55:51.503094 24330 raft_consensus.cc:740] T fb7d801916db4a8c99e18e9ca9606f11 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65755ebc82864dc3a3193b1ba3870613, State: Initialized, Role: FOLLOWER
I20260810 01:55:51.503239 24316 consensus_queue.cc:260] T 2dbf8a1de7674d8b88b046c757664d57 P 687f288b7e9d4650a758d5451483e49b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } }
I20260810 01:55:51.503417 24330 consensus_queue.cc:260] T fb7d801916db4a8c99e18e9ca9606f11 P 65755ebc82864dc3a3193b1ba3870613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } }
I20260810 01:55:51.504424 24322 tablet_bootstrap.cc:492] T 28b80aa4fa264ceb88af4864206f1e10 P fabe62238d32404097129ae02ed3b0b3: No bootstrap required, opened a new log
I20260810 01:55:51.504643 24322 ts_tablet_manager.cc:1403] T 28b80aa4fa264ceb88af4864206f1e10 P fabe62238d32404097129ae02ed3b0b3: Time spent bootstrapping tablet: real 0.022s user 0.004s sys 0.000s
I20260810 01:55:51.505204 24330 ts_tablet_manager.cc:1434] T fb7d801916db4a8c99e18e9ca9606f11 P 65755ebc82864dc3a3193b1ba3870613: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260810 01:55:51.505270 24316 ts_tablet_manager.cc:1434] T 2dbf8a1de7674d8b88b046c757664d57 P 687f288b7e9d4650a758d5451483e49b: Time spent starting tablet: real 0.004s user 0.001s sys 0.002s
I20260810 01:55:51.505645 24316 tablet_bootstrap.cc:492] T fb7d801916db4a8c99e18e9ca9606f11 P 687f288b7e9d4650a758d5451483e49b: Bootstrap starting.
I20260810 01:55:51.505721 24330 tablet_bootstrap.cc:492] T 2dbf8a1de7674d8b88b046c757664d57 P 65755ebc82864dc3a3193b1ba3870613: Bootstrap starting.
I20260810 01:55:51.507587 24330 tablet_bootstrap.cc:654] T 2dbf8a1de7674d8b88b046c757664d57 P 65755ebc82864dc3a3193b1ba3870613: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:51.507995 24316 tablet_bootstrap.cc:654] T fb7d801916db4a8c99e18e9ca9606f11 P 687f288b7e9d4650a758d5451483e49b: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:51.509637 24322 raft_consensus.cc:359] T 28b80aa4fa264ceb88af4864206f1e10 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:51.517457 24322 raft_consensus.cc:385] T 28b80aa4fa264ceb88af4864206f1e10 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:51.517814 24322 raft_consensus.cc:740] T 28b80aa4fa264ceb88af4864206f1e10 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabe62238d32404097129ae02ed3b0b3, State: Initialized, Role: FOLLOWER
I20260810 01:55:51.518227 24322 consensus_queue.cc:260] T 28b80aa4fa264ceb88af4864206f1e10 P fabe62238d32404097129ae02ed3b0b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:51.520304 24322 ts_tablet_manager.cc:1434] T 28b80aa4fa264ceb88af4864206f1e10 P fabe62238d32404097129ae02ed3b0b3: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260810 01:55:51.521855 24332 tablet_bootstrap.cc:654] T 28b80aa4fa264ceb88af4864206f1e10 P 5c71783cbed64297b17353312fcd4bb0: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:51.529273 24316 tablet_bootstrap.cc:492] T fb7d801916db4a8c99e18e9ca9606f11 P 687f288b7e9d4650a758d5451483e49b: No bootstrap required, opened a new log
I20260810 01:55:51.529557 24316 ts_tablet_manager.cc:1403] T fb7d801916db4a8c99e18e9ca9606f11 P 687f288b7e9d4650a758d5451483e49b: Time spent bootstrapping tablet: real 0.024s user 0.005s sys 0.004s
I20260810 01:55:51.529629 24330 tablet_bootstrap.cc:492] T 2dbf8a1de7674d8b88b046c757664d57 P 65755ebc82864dc3a3193b1ba3870613: No bootstrap required, opened a new log
I20260810 01:55:51.529819 24330 ts_tablet_manager.cc:1403] T 2dbf8a1de7674d8b88b046c757664d57 P 65755ebc82864dc3a3193b1ba3870613: Time spent bootstrapping tablet: real 0.024s user 0.007s sys 0.010s
I20260810 01:55:51.530625 24330 raft_consensus.cc:359] T 2dbf8a1de7674d8b88b046c757664d57 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } }
I20260810 01:55:51.530612 24316 raft_consensus.cc:359] T fb7d801916db4a8c99e18e9ca9606f11 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } }
I20260810 01:55:51.530833 24330 raft_consensus.cc:385] T 2dbf8a1de7674d8b88b046c757664d57 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:51.530956 24316 raft_consensus.cc:385] T fb7d801916db4a8c99e18e9ca9606f11 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:51.530956 24330 raft_consensus.cc:740] T 2dbf8a1de7674d8b88b046c757664d57 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65755ebc82864dc3a3193b1ba3870613, State: Initialized, Role: FOLLOWER
I20260810 01:55:51.531102 24316 raft_consensus.cc:740] T fb7d801916db4a8c99e18e9ca9606f11 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687f288b7e9d4650a758d5451483e49b, State: Initialized, Role: FOLLOWER
I20260810 01:55:51.531304 24330 consensus_queue.cc:260] T 2dbf8a1de7674d8b88b046c757664d57 P 65755ebc82864dc3a3193b1ba3870613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } }
I20260810 01:55:51.531613 24332 tablet_bootstrap.cc:492] T 28b80aa4fa264ceb88af4864206f1e10 P 5c71783cbed64297b17353312fcd4bb0: No bootstrap required, opened a new log
I20260810 01:55:51.531840 24330 ts_tablet_manager.cc:1434] T 2dbf8a1de7674d8b88b046c757664d57 P 65755ebc82864dc3a3193b1ba3870613: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 01:55:51.532444 24332 ts_tablet_manager.cc:1403] T 28b80aa4fa264ceb88af4864206f1e10 P 5c71783cbed64297b17353312fcd4bb0: Time spent bootstrapping tablet: real 0.032s user 0.006s sys 0.000s
I20260810 01:55:51.531467 24316 consensus_queue.cc:260] T fb7d801916db4a8c99e18e9ca9606f11 P 687f288b7e9d4650a758d5451483e49b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } }
I20260810 01:55:51.533200 24316 ts_tablet_manager.cc:1434] T fb7d801916db4a8c99e18e9ca9606f11 P 687f288b7e9d4650a758d5451483e49b: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260810 01:55:51.533520 24332 raft_consensus.cc:359] T 28b80aa4fa264ceb88af4864206f1e10 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:51.533743 24332 raft_consensus.cc:385] T 28b80aa4fa264ceb88af4864206f1e10 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:51.533917 24317 tablet_bootstrap.cc:492] T 28b80aa4fa264ceb88af4864206f1e10 P 78c107f9dfbc4d3483895dda0f791bb2: No bootstrap required, opened a new log
I20260810 01:55:51.533893 24332 raft_consensus.cc:740] T 28b80aa4fa264ceb88af4864206f1e10 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c71783cbed64297b17353312fcd4bb0, State: Initialized, Role: FOLLOWER
I20260810 01:55:51.534092 24317 ts_tablet_manager.cc:1403] T 28b80aa4fa264ceb88af4864206f1e10 P 78c107f9dfbc4d3483895dda0f791bb2: Time spent bootstrapping tablet: real 0.037s user 0.019s sys 0.015s
I20260810 01:55:51.534179 24332 consensus_queue.cc:260] T 28b80aa4fa264ceb88af4864206f1e10 P 5c71783cbed64297b17353312fcd4bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:51.534865 24332 ts_tablet_manager.cc:1434] T 28b80aa4fa264ceb88af4864206f1e10 P 5c71783cbed64297b17353312fcd4bb0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 01:55:51.535121 24317 raft_consensus.cc:359] T 28b80aa4fa264ceb88af4864206f1e10 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:51.535342 24317 raft_consensus.cc:385] T 28b80aa4fa264ceb88af4864206f1e10 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:51.535462 24317 raft_consensus.cc:740] T 28b80aa4fa264ceb88af4864206f1e10 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78c107f9dfbc4d3483895dda0f791bb2, State: Initialized, Role: FOLLOWER
I20260810 01:55:51.535799 24317 consensus_queue.cc:260] T 28b80aa4fa264ceb88af4864206f1e10 P 78c107f9dfbc4d3483895dda0f791bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:51.536398 24317 ts_tablet_manager.cc:1434] T 28b80aa4fa264ceb88af4864206f1e10 P 78c107f9dfbc4d3483895dda0f791bb2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:55:51.537055 24318 tablet_bootstrap.cc:492] T fb7d801916db4a8c99e18e9ca9606f11 P c5ca831c32e4452dba1cfc6cd296e532: No bootstrap required, opened a new log
I20260810 01:55:51.537281 24318 ts_tablet_manager.cc:1403] T fb7d801916db4a8c99e18e9ca9606f11 P c5ca831c32e4452dba1cfc6cd296e532: Time spent bootstrapping tablet: real 0.043s user 0.005s sys 0.006s
I20260810 01:55:51.538221 24318 raft_consensus.cc:359] T fb7d801916db4a8c99e18e9ca9606f11 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } }
I20260810 01:55:51.538547 24318 raft_consensus.cc:385] T fb7d801916db4a8c99e18e9ca9606f11 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:51.538687 24318 raft_consensus.cc:740] T fb7d801916db4a8c99e18e9ca9606f11 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ca831c32e4452dba1cfc6cd296e532, State: Initialized, Role: FOLLOWER
I20260810 01:55:51.539677 24318 consensus_queue.cc:260] T fb7d801916db4a8c99e18e9ca9606f11 P c5ca831c32e4452dba1cfc6cd296e532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } }
I20260810 01:55:51.540424 24318 ts_tablet_manager.cc:1434] T fb7d801916db4a8c99e18e9ca9606f11 P c5ca831c32e4452dba1cfc6cd296e532: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260810 01:55:51.558597 24237 raft_consensus.cc:493] T fb7d801916db4a8c99e18e9ca9606f11 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:55:51.558844 24237 raft_consensus.cc:515] T fb7d801916db4a8c99e18e9ca9606f11 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } }
I20260810 01:55:51.559667 24237 leader_election.cc:290] T fb7d801916db4a8c99e18e9ca9606f11 P 687f288b7e9d4650a758d5451483e49b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ca831c32e4452dba1cfc6cd296e532 (127.21.64.193:39917), 65755ebc82864dc3a3193b1ba3870613 (127.21.64.195:46103)
I20260810 01:55:51.560164 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7d801916db4a8c99e18e9ca9606f11" candidate_uuid: "687f288b7e9d4650a758d5451483e49b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ca831c32e4452dba1cfc6cd296e532" is_pre_election: true
I20260810 01:55:51.560318 22392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7d801916db4a8c99e18e9ca9606f11" candidate_uuid: "687f288b7e9d4650a758d5451483e49b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65755ebc82864dc3a3193b1ba3870613" is_pre_election: true
I20260810 01:55:51.560418 22024 raft_consensus.cc:2468] T fb7d801916db4a8c99e18e9ca9606f11 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687f288b7e9d4650a758d5451483e49b in term 0.
I20260810 01:55:51.560577 22392 raft_consensus.cc:2468] T fb7d801916db4a8c99e18e9ca9606f11 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687f288b7e9d4650a758d5451483e49b in term 0.
I20260810 01:55:51.561081 22687 leader_election.cc:304] T fb7d801916db4a8c99e18e9ca9606f11 P 687f288b7e9d4650a758d5451483e49b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 65755ebc82864dc3a3193b1ba3870613, 687f288b7e9d4650a758d5451483e49b, c5ca831c32e4452dba1cfc6cd296e532; no voters:
I20260810 01:55:51.561471 24237 raft_consensus.cc:2804] T fb7d801916db4a8c99e18e9ca9606f11 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:55:51.561558 24237 raft_consensus.cc:493] T fb7d801916db4a8c99e18e9ca9606f11 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:55:51.561710 24237 raft_consensus.cc:3060] T fb7d801916db4a8c99e18e9ca9606f11 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:51.564085 24237 raft_consensus.cc:515] T fb7d801916db4a8c99e18e9ca9606f11 P 687f288b7e9d4650a758d5451483e49b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } }
I20260810 01:55:51.565055 24237 leader_election.cc:290] T fb7d801916db4a8c99e18e9ca9606f11 P 687f288b7e9d4650a758d5451483e49b [CANDIDATE]: Term 1 election: Requested vote from peers c5ca831c32e4452dba1cfc6cd296e532 (127.21.64.193:39917), 65755ebc82864dc3a3193b1ba3870613 (127.21.64.195:46103)
I20260810 01:55:51.565622 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7d801916db4a8c99e18e9ca9606f11" candidate_uuid: "687f288b7e9d4650a758d5451483e49b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ca831c32e4452dba1cfc6cd296e532"
I20260810 01:55:51.565719 22392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7d801916db4a8c99e18e9ca9606f11" candidate_uuid: "687f288b7e9d4650a758d5451483e49b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65755ebc82864dc3a3193b1ba3870613"
I20260810 01:55:51.565833 22024 raft_consensus.cc:3060] T fb7d801916db4a8c99e18e9ca9606f11 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:51.565922 22392 raft_consensus.cc:3060] T fb7d801916db4a8c99e18e9ca9606f11 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:51.568969 22392 raft_consensus.cc:2468] T fb7d801916db4a8c99e18e9ca9606f11 P 65755ebc82864dc3a3193b1ba3870613 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687f288b7e9d4650a758d5451483e49b in term 1.
I20260810 01:55:51.569403 22687 leader_election.cc:304] T fb7d801916db4a8c99e18e9ca9606f11 P 687f288b7e9d4650a758d5451483e49b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65755ebc82864dc3a3193b1ba3870613, 687f288b7e9d4650a758d5451483e49b; no voters:
I20260810 01:55:51.569581 22024 raft_consensus.cc:2468] T fb7d801916db4a8c99e18e9ca9606f11 P c5ca831c32e4452dba1cfc6cd296e532 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687f288b7e9d4650a758d5451483e49b in term 1.
I20260810 01:55:51.569725 24237 raft_consensus.cc:2804] T fb7d801916db4a8c99e18e9ca9606f11 P 687f288b7e9d4650a758d5451483e49b [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:55:51.569938 24237 raft_consensus.cc:697] T fb7d801916db4a8c99e18e9ca9606f11 P 687f288b7e9d4650a758d5451483e49b [term 1 LEADER]: Becoming Leader. State: Replica: 687f288b7e9d4650a758d5451483e49b, State: Running, Role: LEADER
I20260810 01:55:51.570288 24237 consensus_queue.cc:237] T fb7d801916db4a8c99e18e9ca9606f11 P 687f288b7e9d4650a758d5451483e49b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } }
I20260810 01:55:51.573936 21824 catalog_manager.cc:5719] T fb7d801916db4a8c99e18e9ca9606f11 P 687f288b7e9d4650a758d5451483e49b reported cstate change: term changed from 0 to 1, leader changed from <none> to 687f288b7e9d4650a758d5451483e49b (127.21.64.197). New cstate: current_term: 1 leader_uuid: "687f288b7e9d4650a758d5451483e49b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } health_report { overall_health: HEALTHY } } }
I20260810 01:55:51.602721 24280 raft_consensus.cc:493] T 2dbf8a1de7674d8b88b046c757664d57 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:55:51.602938 24280 raft_consensus.cc:515] T 2dbf8a1de7674d8b88b046c757664d57 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } }
I20260810 01:55:51.603760 24280 leader_election.cc:290] T 2dbf8a1de7674d8b88b046c757664d57 P 65755ebc82864dc3a3193b1ba3870613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ca831c32e4452dba1cfc6cd296e532 (127.21.64.193:39917), 687f288b7e9d4650a758d5451483e49b (127.21.64.197:37655)
I20260810 01:55:51.604281 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbf8a1de7674d8b88b046c757664d57" candidate_uuid: "65755ebc82864dc3a3193b1ba3870613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ca831c32e4452dba1cfc6cd296e532" is_pre_election: true
I20260810 01:55:51.604383 22767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbf8a1de7674d8b88b046c757664d57" candidate_uuid: "65755ebc82864dc3a3193b1ba3870613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687f288b7e9d4650a758d5451483e49b" is_pre_election: true
I20260810 01:55:51.604565 22024 raft_consensus.cc:2468] T 2dbf8a1de7674d8b88b046c757664d57 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65755ebc82864dc3a3193b1ba3870613 in term 0.
I20260810 01:55:51.604712 22767 raft_consensus.cc:2468] T 2dbf8a1de7674d8b88b046c757664d57 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65755ebc82864dc3a3193b1ba3870613 in term 0.
I20260810 01:55:51.605144 22297 leader_election.cc:304] T 2dbf8a1de7674d8b88b046c757664d57 P 65755ebc82864dc3a3193b1ba3870613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65755ebc82864dc3a3193b1ba3870613, c5ca831c32e4452dba1cfc6cd296e532; no voters:
I20260810 01:55:51.605453 24280 raft_consensus.cc:2804] T 2dbf8a1de7674d8b88b046c757664d57 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:55:51.605576 24280 raft_consensus.cc:493] T 2dbf8a1de7674d8b88b046c757664d57 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:55:51.605706 24280 raft_consensus.cc:3060] T 2dbf8a1de7674d8b88b046c757664d57 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:51.607653 24280 raft_consensus.cc:515] T 2dbf8a1de7674d8b88b046c757664d57 P 65755ebc82864dc3a3193b1ba3870613 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } }
I20260810 01:55:51.608312 24280 leader_election.cc:290] T 2dbf8a1de7674d8b88b046c757664d57 P 65755ebc82864dc3a3193b1ba3870613 [CANDIDATE]: Term 1 election: Requested vote from peers c5ca831c32e4452dba1cfc6cd296e532 (127.21.64.193:39917), 687f288b7e9d4650a758d5451483e49b (127.21.64.197:37655)
I20260810 01:55:51.608748 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbf8a1de7674d8b88b046c757664d57" candidate_uuid: "65755ebc82864dc3a3193b1ba3870613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ca831c32e4452dba1cfc6cd296e532"
I20260810 01:55:51.608860 22767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbf8a1de7674d8b88b046c757664d57" candidate_uuid: "65755ebc82864dc3a3193b1ba3870613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687f288b7e9d4650a758d5451483e49b"
I20260810 01:55:51.608983 22024 raft_consensus.cc:3060] T 2dbf8a1de7674d8b88b046c757664d57 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:51.609103 22767 raft_consensus.cc:3060] T 2dbf8a1de7674d8b88b046c757664d57 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:51.612104 22024 raft_consensus.cc:2468] T 2dbf8a1de7674d8b88b046c757664d57 P c5ca831c32e4452dba1cfc6cd296e532 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65755ebc82864dc3a3193b1ba3870613 in term 1.
I20260810 01:55:51.612106 22767 raft_consensus.cc:2468] T 2dbf8a1de7674d8b88b046c757664d57 P 687f288b7e9d4650a758d5451483e49b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65755ebc82864dc3a3193b1ba3870613 in term 1.
I20260810 01:55:51.612568 22294 leader_election.cc:304] T 2dbf8a1de7674d8b88b046c757664d57 P 65755ebc82864dc3a3193b1ba3870613 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 65755ebc82864dc3a3193b1ba3870613, 687f288b7e9d4650a758d5451483e49b, c5ca831c32e4452dba1cfc6cd296e532; no voters:
I20260810 01:55:51.612924 24280 raft_consensus.cc:2804] T 2dbf8a1de7674d8b88b046c757664d57 P 65755ebc82864dc3a3193b1ba3870613 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:55:51.613106 24280 raft_consensus.cc:697] T 2dbf8a1de7674d8b88b046c757664d57 P 65755ebc82864dc3a3193b1ba3870613 [term 1 LEADER]: Becoming Leader. State: Replica: 65755ebc82864dc3a3193b1ba3870613, State: Running, Role: LEADER
I20260810 01:55:51.613483 24280 consensus_queue.cc:237] T 2dbf8a1de7674d8b88b046c757664d57 P 65755ebc82864dc3a3193b1ba3870613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } }
I20260810 01:55:51.616598 21824 catalog_manager.cc:5719] T 2dbf8a1de7674d8b88b046c757664d57 P 65755ebc82864dc3a3193b1ba3870613 reported cstate change: term changed from 0 to 1, leader changed from <none> to 65755ebc82864dc3a3193b1ba3870613 (127.21.64.195). New cstate: current_term: 1 leader_uuid: "65755ebc82864dc3a3193b1ba3870613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } health_report { overall_health: UNKNOWN } } }
I20260810 01:55:51.708580 23532 raft_consensus.cc:493] T 28b80aa4fa264ceb88af4864206f1e10 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:55:51.708837 23532 raft_consensus.cc:515] T 28b80aa4fa264ceb88af4864206f1e10 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:51.709765 23532 leader_election.cc:290] T 28b80aa4fa264ceb88af4864206f1e10 P 78c107f9dfbc4d3483895dda0f791bb2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fabe62238d32404097129ae02ed3b0b3 (127.21.64.196:32931), 5c71783cbed64297b17353312fcd4bb0 (127.21.64.198:33973)
I20260810 01:55:51.710359 22587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b80aa4fa264ceb88af4864206f1e10" candidate_uuid: "78c107f9dfbc4d3483895dda0f791bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabe62238d32404097129ae02ed3b0b3" is_pre_election: true
I20260810 01:55:51.710358 22952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b80aa4fa264ceb88af4864206f1e10" candidate_uuid: "78c107f9dfbc4d3483895dda0f791bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c71783cbed64297b17353312fcd4bb0" is_pre_election: true
I20260810 01:55:51.710651 22587 raft_consensus.cc:2468] T 28b80aa4fa264ceb88af4864206f1e10 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78c107f9dfbc4d3483895dda0f791bb2 in term 0.
I20260810 01:55:51.710657 22952 raft_consensus.cc:2468] T 28b80aa4fa264ceb88af4864206f1e10 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78c107f9dfbc4d3483895dda0f791bb2 in term 0.
I20260810 01:55:51.711212 22111 leader_election.cc:304] T 28b80aa4fa264ceb88af4864206f1e10 P 78c107f9dfbc4d3483895dda0f791bb2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78c107f9dfbc4d3483895dda0f791bb2, fabe62238d32404097129ae02ed3b0b3; no voters:
I20260810 01:55:51.711591 23532 raft_consensus.cc:2804] T 28b80aa4fa264ceb88af4864206f1e10 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:55:51.711737 23532 raft_consensus.cc:493] T 28b80aa4fa264ceb88af4864206f1e10 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:55:51.711859 23532 raft_consensus.cc:3060] T 28b80aa4fa264ceb88af4864206f1e10 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:51.714520 23532 raft_consensus.cc:515] T 28b80aa4fa264ceb88af4864206f1e10 P 78c107f9dfbc4d3483895dda0f791bb2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:51.715055 23532 leader_election.cc:290] T 28b80aa4fa264ceb88af4864206f1e10 P 78c107f9dfbc4d3483895dda0f791bb2 [CANDIDATE]: Term 1 election: Requested vote from peers fabe62238d32404097129ae02ed3b0b3 (127.21.64.196:32931), 5c71783cbed64297b17353312fcd4bb0 (127.21.64.198:33973)
I20260810 01:55:51.715579 22952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b80aa4fa264ceb88af4864206f1e10" candidate_uuid: "78c107f9dfbc4d3483895dda0f791bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c71783cbed64297b17353312fcd4bb0"
I20260810 01:55:51.715602 22587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b80aa4fa264ceb88af4864206f1e10" candidate_uuid: "78c107f9dfbc4d3483895dda0f791bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabe62238d32404097129ae02ed3b0b3"
I20260810 01:55:51.715778 22587 raft_consensus.cc:3060] T 28b80aa4fa264ceb88af4864206f1e10 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:51.715799 22952 raft_consensus.cc:3060] T 28b80aa4fa264ceb88af4864206f1e10 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:51.718874 22952 raft_consensus.cc:2468] T 28b80aa4fa264ceb88af4864206f1e10 P 5c71783cbed64297b17353312fcd4bb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78c107f9dfbc4d3483895dda0f791bb2 in term 1.
I20260810 01:55:51.718890 22587 raft_consensus.cc:2468] T 28b80aa4fa264ceb88af4864206f1e10 P fabe62238d32404097129ae02ed3b0b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78c107f9dfbc4d3483895dda0f791bb2 in term 1.
I20260810 01:55:51.719429 22111 leader_election.cc:304] T 28b80aa4fa264ceb88af4864206f1e10 P 78c107f9dfbc4d3483895dda0f791bb2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78c107f9dfbc4d3483895dda0f791bb2, fabe62238d32404097129ae02ed3b0b3; no voters:
I20260810 01:55:51.719796 23532 raft_consensus.cc:2804] T 28b80aa4fa264ceb88af4864206f1e10 P 78c107f9dfbc4d3483895dda0f791bb2 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:55:51.720223 23532 raft_consensus.cc:697] T 28b80aa4fa264ceb88af4864206f1e10 P 78c107f9dfbc4d3483895dda0f791bb2 [term 1 LEADER]: Becoming Leader. State: Replica: 78c107f9dfbc4d3483895dda0f791bb2, State: Running, Role: LEADER
I20260810 01:55:51.720599 23532 consensus_queue.cc:237] T 28b80aa4fa264ceb88af4864206f1e10 P 78c107f9dfbc4d3483895dda0f791bb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:55:51.723893 21824 catalog_manager.cc:5719] T 28b80aa4fa264ceb88af4864206f1e10 P 78c107f9dfbc4d3483895dda0f791bb2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194). New cstate: current_term: 1 leader_uuid: "78c107f9dfbc4d3483895dda0f791bb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } health_report { overall_health: UNKNOWN } } }
I20260810 01:55:51.954284 24237 consensus_queue.cc:1048] T fb7d801916db4a8c99e18e9ca9606f11 P 687f288b7e9d4650a758d5451483e49b [LEADER]: Connected to new peer: Peer: permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:51.966934 24349 consensus_queue.cc:1048] T fb7d801916db4a8c99e18e9ca9606f11 P 687f288b7e9d4650a758d5451483e49b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:52.067014 24280 consensus_queue.cc:1048] T 2dbf8a1de7674d8b88b046c757664d57 P 65755ebc82864dc3a3193b1ba3870613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:52.078394 24172 consensus_queue.cc:1048] T 2dbf8a1de7674d8b88b046c757664d57 P 65755ebc82864dc3a3193b1ba3870613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:52.191402 23532 consensus_queue.cc:1048] T 28b80aa4fa264ceb88af4864206f1e10 P 78c107f9dfbc4d3483895dda0f791bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 01:55:52.192138 24346 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:55:52.192624 24346 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260810 01:55:52.205024 24344 consensus_queue.cc:1048] T 28b80aa4fa264ceb88af4864206f1e10 P 78c107f9dfbc4d3483895dda0f791bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
Using table 'rebalance_test_table_10'
W20260810 01:55:52.480011 24382 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.GetTableLocations -> {remote=127.21.64.254:44083, user_credentials={real_user=slave}} blocked reactor thread for 45352.9us
INSERT report
rows total: 2000
time total: 387.774 ms
time per row: 0.193887 ms
I20260810 01:55:52.809056 21815 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60594:
name: "rebalance_test_table_11"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260810 01:55:52.820951 22922 tablet_service.cc:1511] Processing CreateTablet for tablet 4bc432ae575f4b828fa1bc6a5d7e9bd8 (DEFAULT_TABLE table=rebalance_test_table_11 [id=e6c39724e1014e3ca34a9ec8205c067e]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:52.821672 22922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bc432ae575f4b828fa1bc6a5d7e9bd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:52.822083 22178 tablet_service.cc:1511] Processing CreateTablet for tablet 4bc432ae575f4b828fa1bc6a5d7e9bd8 (DEFAULT_TABLE table=rebalance_test_table_11 [id=e6c39724e1014e3ca34a9ec8205c067e]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:52.822312 22181 tablet_service.cc:1511] Processing CreateTablet for tablet 814423836b9a49daa8e09ab9934e01c1 (DEFAULT_TABLE table=rebalance_test_table_11 [id=e6c39724e1014e3ca34a9ec8205c067e]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:52.822571 22178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bc432ae575f4b828fa1bc6a5d7e9bd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:52.823531 22739 tablet_service.cc:1511] Processing CreateTablet for tablet 45a0083d86fa4eb789834db7e76b4161 (DEFAULT_TABLE table=rebalance_test_table_11 [id=e6c39724e1014e3ca34a9ec8205c067e]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:52.823963 22739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45a0083d86fa4eb789834db7e76b4161. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:52.825008 22921 tablet_service.cc:1511] Processing CreateTablet for tablet 814423836b9a49daa8e09ab9934e01c1 (DEFAULT_TABLE table=rebalance_test_table_11 [id=e6c39724e1014e3ca34a9ec8205c067e]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:52.825423 22921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 814423836b9a49daa8e09ab9934e01c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:52.825314 22558 tablet_service.cc:1511] Processing CreateTablet for tablet 814423836b9a49daa8e09ab9934e01c1 (DEFAULT_TABLE table=rebalance_test_table_11 [id=e6c39724e1014e3ca34a9ec8205c067e]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:52.825749 22558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 814423836b9a49daa8e09ab9934e01c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:52.830111 22364 tablet_service.cc:1511] Processing CreateTablet for tablet 45a0083d86fa4eb789834db7e76b4161 (DEFAULT_TABLE table=rebalance_test_table_11 [id=e6c39724e1014e3ca34a9ec8205c067e]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:52.830519 22364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45a0083d86fa4eb789834db7e76b4161. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:52.834208 21994 tablet_service.cc:1511] Processing CreateTablet for tablet 45a0083d86fa4eb789834db7e76b4161 (DEFAULT_TABLE table=rebalance_test_table_11 [id=e6c39724e1014e3ca34a9ec8205c067e]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:52.834671 21994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45a0083d86fa4eb789834db7e76b4161. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:52.837080 24451 tablet_bootstrap.cc:492] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P 78c107f9dfbc4d3483895dda0f791bb2: Bootstrap starting.
I20260810 01:55:52.821244 22559 tablet_service.cc:1511] Processing CreateTablet for tablet 4bc432ae575f4b828fa1bc6a5d7e9bd8 (DEFAULT_TABLE table=rebalance_test_table_11 [id=e6c39724e1014e3ca34a9ec8205c067e]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:55:52.838634 22559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bc432ae575f4b828fa1bc6a5d7e9bd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:52.840193 24454 tablet_bootstrap.cc:492] T 45a0083d86fa4eb789834db7e76b4161 P 687f288b7e9d4650a758d5451483e49b: Bootstrap starting.
I20260810 01:55:52.840557 24451 tablet_bootstrap.cc:654] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P 78c107f9dfbc4d3483895dda0f791bb2: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:52.841087 24455 tablet_bootstrap.cc:492] T 814423836b9a49daa8e09ab9934e01c1 P 5c71783cbed64297b17353312fcd4bb0: Bootstrap starting.
I20260810 01:55:52.841605 22181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 814423836b9a49daa8e09ab9934e01c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:55:52.842399 24454 tablet_bootstrap.cc:654] T 45a0083d86fa4eb789834db7e76b4161 P 687f288b7e9d4650a758d5451483e49b: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:52.843079 24455 tablet_bootstrap.cc:654] T 814423836b9a49daa8e09ab9934e01c1 P 5c71783cbed64297b17353312fcd4bb0: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:52.845916 24455 tablet_bootstrap.cc:492] T 814423836b9a49daa8e09ab9934e01c1 P 5c71783cbed64297b17353312fcd4bb0: No bootstrap required, opened a new log
I20260810 01:55:52.846091 24455 ts_tablet_manager.cc:1403] T 814423836b9a49daa8e09ab9934e01c1 P 5c71783cbed64297b17353312fcd4bb0: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260810 01:55:52.846901 24455 raft_consensus.cc:359] T 814423836b9a49daa8e09ab9934e01c1 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:52.847126 24455 raft_consensus.cc:385] T 814423836b9a49daa8e09ab9934e01c1 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:52.847249 24455 raft_consensus.cc:740] T 814423836b9a49daa8e09ab9934e01c1 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c71783cbed64297b17353312fcd4bb0, State: Initialized, Role: FOLLOWER
I20260810 01:55:52.847487 24455 consensus_queue.cc:260] T 814423836b9a49daa8e09ab9934e01c1 P 5c71783cbed64297b17353312fcd4bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:52.848038 24455 ts_tablet_manager.cc:1434] T 814423836b9a49daa8e09ab9934e01c1 P 5c71783cbed64297b17353312fcd4bb0: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 01:55:52.853912 24451 tablet_bootstrap.cc:492] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P 78c107f9dfbc4d3483895dda0f791bb2: No bootstrap required, opened a new log
I20260810 01:55:52.854200 24451 ts_tablet_manager.cc:1403] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P 78c107f9dfbc4d3483895dda0f791bb2: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.003s
I20260810 01:55:52.855324 24451 raft_consensus.cc:359] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } }
I20260810 01:55:52.856789 24451 raft_consensus.cc:385] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:52.856984 24451 raft_consensus.cc:740] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78c107f9dfbc4d3483895dda0f791bb2, State: Initialized, Role: FOLLOWER
I20260810 01:55:52.857766 24455 tablet_bootstrap.cc:492] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P 5c71783cbed64297b17353312fcd4bb0: Bootstrap starting.
I20260810 01:55:52.857460 24451 consensus_queue.cc:260] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P 78c107f9dfbc4d3483895dda0f791bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } }
I20260810 01:55:52.865643 24451 ts_tablet_manager.cc:1434] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P 78c107f9dfbc4d3483895dda0f791bb2: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260810 01:55:52.866653 24451 tablet_bootstrap.cc:492] T 814423836b9a49daa8e09ab9934e01c1 P 78c107f9dfbc4d3483895dda0f791bb2: Bootstrap starting.
I20260810 01:55:52.867372 24455 tablet_bootstrap.cc:654] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P 5c71783cbed64297b17353312fcd4bb0: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:52.871631 24462 tablet_bootstrap.cc:492] T 814423836b9a49daa8e09ab9934e01c1 P fabe62238d32404097129ae02ed3b0b3: Bootstrap starting.
I20260810 01:55:52.873008 24459 tablet_bootstrap.cc:492] T 45a0083d86fa4eb789834db7e76b4161 P 65755ebc82864dc3a3193b1ba3870613: Bootstrap starting.
I20260810 01:55:52.874847 24451 tablet_bootstrap.cc:654] T 814423836b9a49daa8e09ab9934e01c1 P 78c107f9dfbc4d3483895dda0f791bb2: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:52.875626 24460 tablet_bootstrap.cc:492] T 45a0083d86fa4eb789834db7e76b4161 P c5ca831c32e4452dba1cfc6cd296e532: Bootstrap starting.
I20260810 01:55:52.875878 24462 tablet_bootstrap.cc:654] T 814423836b9a49daa8e09ab9934e01c1 P fabe62238d32404097129ae02ed3b0b3: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:52.876868 24459 tablet_bootstrap.cc:654] T 45a0083d86fa4eb789834db7e76b4161 P 65755ebc82864dc3a3193b1ba3870613: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:52.877874 24460 tablet_bootstrap.cc:654] T 45a0083d86fa4eb789834db7e76b4161 P c5ca831c32e4452dba1cfc6cd296e532: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:52.878598 24455 tablet_bootstrap.cc:492] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P 5c71783cbed64297b17353312fcd4bb0: No bootstrap required, opened a new log
I20260810 01:55:52.880649 24455 ts_tablet_manager.cc:1403] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P 5c71783cbed64297b17353312fcd4bb0: Time spent bootstrapping tablet: real 0.023s user 0.000s sys 0.006s
I20260810 01:55:52.882254 24455 raft_consensus.cc:359] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } }
I20260810 01:55:52.882638 24455 raft_consensus.cc:385] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:52.882791 24455 raft_consensus.cc:740] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c71783cbed64297b17353312fcd4bb0, State: Initialized, Role: FOLLOWER
I20260810 01:55:52.883213 24455 consensus_queue.cc:260] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P 5c71783cbed64297b17353312fcd4bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } }
I20260810 01:55:52.885080 24462 tablet_bootstrap.cc:492] T 814423836b9a49daa8e09ab9934e01c1 P fabe62238d32404097129ae02ed3b0b3: No bootstrap required, opened a new log
I20260810 01:55:52.885145 24455 ts_tablet_manager.cc:1434] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P 5c71783cbed64297b17353312fcd4bb0: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260810 01:55:52.887600 24454 tablet_bootstrap.cc:492] T 45a0083d86fa4eb789834db7e76b4161 P 687f288b7e9d4650a758d5451483e49b: No bootstrap required, opened a new log
I20260810 01:55:52.887755 24459 tablet_bootstrap.cc:492] T 45a0083d86fa4eb789834db7e76b4161 P 65755ebc82864dc3a3193b1ba3870613: No bootstrap required, opened a new log
I20260810 01:55:52.887854 24454 ts_tablet_manager.cc:1403] T 45a0083d86fa4eb789834db7e76b4161 P 687f288b7e9d4650a758d5451483e49b: Time spent bootstrapping tablet: real 0.048s user 0.022s sys 0.011s
I20260810 01:55:52.888019 24459 ts_tablet_manager.cc:1403] T 45a0083d86fa4eb789834db7e76b4161 P 65755ebc82864dc3a3193b1ba3870613: Time spent bootstrapping tablet: real 0.015s user 0.010s sys 0.000s
I20260810 01:55:52.888818 24454 raft_consensus.cc:359] T 45a0083d86fa4eb789834db7e76b4161 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:52.889128 24454 raft_consensus.cc:385] T 45a0083d86fa4eb789834db7e76b4161 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:52.889171 24459 raft_consensus.cc:359] T 45a0083d86fa4eb789834db7e76b4161 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:52.889389 24454 raft_consensus.cc:740] T 45a0083d86fa4eb789834db7e76b4161 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687f288b7e9d4650a758d5451483e49b, State: Initialized, Role: FOLLOWER
I20260810 01:55:52.889580 24459 raft_consensus.cc:385] T 45a0083d86fa4eb789834db7e76b4161 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:52.889734 24459 raft_consensus.cc:740] T 45a0083d86fa4eb789834db7e76b4161 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65755ebc82864dc3a3193b1ba3870613, State: Initialized, Role: FOLLOWER
I20260810 01:55:52.889743 24454 consensus_queue.cc:260] T 45a0083d86fa4eb789834db7e76b4161 P 687f288b7e9d4650a758d5451483e49b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:52.890030 24459 consensus_queue.cc:260] T 45a0083d86fa4eb789834db7e76b4161 P 65755ebc82864dc3a3193b1ba3870613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:52.890616 24454 ts_tablet_manager.cc:1434] T 45a0083d86fa4eb789834db7e76b4161 P 687f288b7e9d4650a758d5451483e49b: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260810 01:55:52.890897 24459 ts_tablet_manager.cc:1434] T 45a0083d86fa4eb789834db7e76b4161 P 65755ebc82864dc3a3193b1ba3870613: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 01:55:52.890889 24462 ts_tablet_manager.cc:1403] T 814423836b9a49daa8e09ab9934e01c1 P fabe62238d32404097129ae02ed3b0b3: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.003s
I20260810 01:55:52.891889 24462 raft_consensus.cc:359] T 814423836b9a49daa8e09ab9934e01c1 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:52.892360 24462 raft_consensus.cc:385] T 814423836b9a49daa8e09ab9934e01c1 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:52.892537 24462 raft_consensus.cc:740] T 814423836b9a49daa8e09ab9934e01c1 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabe62238d32404097129ae02ed3b0b3, State: Initialized, Role: FOLLOWER
I20260810 01:55:52.892978 24462 consensus_queue.cc:260] T 814423836b9a49daa8e09ab9934e01c1 P fabe62238d32404097129ae02ed3b0b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:52.893603 24462 ts_tablet_manager.cc:1434] T 814423836b9a49daa8e09ab9934e01c1 P fabe62238d32404097129ae02ed3b0b3: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260810 01:55:52.893937 24462 tablet_bootstrap.cc:492] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P fabe62238d32404097129ae02ed3b0b3: Bootstrap starting.
I20260810 01:55:52.895722 24462 tablet_bootstrap.cc:654] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P fabe62238d32404097129ae02ed3b0b3: Neither blocks nor log segments found. Creating new log.
I20260810 01:55:52.898063 24462 tablet_bootstrap.cc:492] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P fabe62238d32404097129ae02ed3b0b3: No bootstrap required, opened a new log
I20260810 01:55:52.898242 24462 ts_tablet_manager.cc:1403] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P fabe62238d32404097129ae02ed3b0b3: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260810 01:55:52.898311 24451 tablet_bootstrap.cc:492] T 814423836b9a49daa8e09ab9934e01c1 P 78c107f9dfbc4d3483895dda0f791bb2: No bootstrap required, opened a new log
I20260810 01:55:52.898509 24451 ts_tablet_manager.cc:1403] T 814423836b9a49daa8e09ab9934e01c1 P 78c107f9dfbc4d3483895dda0f791bb2: Time spent bootstrapping tablet: real 0.032s user 0.010s sys 0.004s
I20260810 01:55:52.899073 24462 raft_consensus.cc:359] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } }
I20260810 01:55:52.899274 24462 raft_consensus.cc:385] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:52.899398 24451 raft_consensus.cc:359] T 814423836b9a49daa8e09ab9934e01c1 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:52.899533 24462 raft_consensus.cc:740] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabe62238d32404097129ae02ed3b0b3, State: Initialized, Role: FOLLOWER
I20260810 01:55:52.899613 24451 raft_consensus.cc:385] T 814423836b9a49daa8e09ab9934e01c1 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:52.899686 24451 raft_consensus.cc:740] T 814423836b9a49daa8e09ab9934e01c1 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78c107f9dfbc4d3483895dda0f791bb2, State: Initialized, Role: FOLLOWER
I20260810 01:55:52.899806 24462 consensus_queue.cc:260] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P fabe62238d32404097129ae02ed3b0b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } }
I20260810 01:55:52.899909 24451 consensus_queue.cc:260] T 814423836b9a49daa8e09ab9934e01c1 P 78c107f9dfbc4d3483895dda0f791bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:52.900272 24462 ts_tablet_manager.cc:1434] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P fabe62238d32404097129ae02ed3b0b3: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 01:55:52.900290 24460 tablet_bootstrap.cc:492] T 45a0083d86fa4eb789834db7e76b4161 P c5ca831c32e4452dba1cfc6cd296e532: No bootstrap required, opened a new log
I20260810 01:55:52.900372 24451 ts_tablet_manager.cc:1434] T 814423836b9a49daa8e09ab9934e01c1 P 78c107f9dfbc4d3483895dda0f791bb2: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260810 01:55:52.900432 24460 ts_tablet_manager.cc:1403] T 45a0083d86fa4eb789834db7e76b4161 P c5ca831c32e4452dba1cfc6cd296e532: Time spent bootstrapping tablet: real 0.025s user 0.007s sys 0.000s
I20260810 01:55:52.901605 24460 raft_consensus.cc:359] T 45a0083d86fa4eb789834db7e76b4161 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:52.901806 24460 raft_consensus.cc:385] T 45a0083d86fa4eb789834db7e76b4161 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:55:52.901902 24460 raft_consensus.cc:740] T 45a0083d86fa4eb789834db7e76b4161 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ca831c32e4452dba1cfc6cd296e532, State: Initialized, Role: FOLLOWER
I20260810 01:55:52.903460 24460 consensus_queue.cc:260] T 45a0083d86fa4eb789834db7e76b4161 P c5ca831c32e4452dba1cfc6cd296e532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:52.904021 24460 ts_tablet_manager.cc:1434] T 45a0083d86fa4eb789834db7e76b4161 P c5ca831c32e4452dba1cfc6cd296e532: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 01:55:52.913334 24396 raft_consensus.cc:493] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:55:52.913583 24396 raft_consensus.cc:515] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } }
I20260810 01:55:52.914328 24396 leader_election.cc:290] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P 5c71783cbed64297b17353312fcd4bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fabe62238d32404097129ae02ed3b0b3 (127.21.64.196:32931), 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194:33547)
I20260810 01:55:52.914819 22207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc432ae575f4b828fa1bc6a5d7e9bd8" candidate_uuid: "5c71783cbed64297b17353312fcd4bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78c107f9dfbc4d3483895dda0f791bb2" is_pre_election: true
I20260810 01:55:52.914930 22588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc432ae575f4b828fa1bc6a5d7e9bd8" candidate_uuid: "5c71783cbed64297b17353312fcd4bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabe62238d32404097129ae02ed3b0b3" is_pre_election: true
I20260810 01:55:52.915149 22207 raft_consensus.cc:2468] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c71783cbed64297b17353312fcd4bb0 in term 0.
I20260810 01:55:52.915200 22588 raft_consensus.cc:2468] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c71783cbed64297b17353312fcd4bb0 in term 0.
I20260810 01:55:52.915747 22857 leader_election.cc:304] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P 5c71783cbed64297b17353312fcd4bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c71783cbed64297b17353312fcd4bb0, fabe62238d32404097129ae02ed3b0b3; no voters:
I20260810 01:55:52.916152 24396 raft_consensus.cc:2804] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:55:52.916420 24396 raft_consensus.cc:493] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:55:52.916635 24396 raft_consensus.cc:3060] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:52.919757 24396 raft_consensus.cc:515] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P 5c71783cbed64297b17353312fcd4bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } }
I20260810 01:55:52.920552 24396 leader_election.cc:290] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P 5c71783cbed64297b17353312fcd4bb0 [CANDIDATE]: Term 1 election: Requested vote from peers fabe62238d32404097129ae02ed3b0b3 (127.21.64.196:32931), 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194:33547)
I20260810 01:55:52.920830 22588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc432ae575f4b828fa1bc6a5d7e9bd8" candidate_uuid: "5c71783cbed64297b17353312fcd4bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabe62238d32404097129ae02ed3b0b3"
I20260810 01:55:52.921037 22588 raft_consensus.cc:3060] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:52.921258 22207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc432ae575f4b828fa1bc6a5d7e9bd8" candidate_uuid: "5c71783cbed64297b17353312fcd4bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78c107f9dfbc4d3483895dda0f791bb2"
I20260810 01:55:52.921622 22207 raft_consensus.cc:3060] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:52.923717 22588 raft_consensus.cc:2468] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P fabe62238d32404097129ae02ed3b0b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c71783cbed64297b17353312fcd4bb0 in term 1.
I20260810 01:55:52.924252 22857 leader_election.cc:304] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P 5c71783cbed64297b17353312fcd4bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c71783cbed64297b17353312fcd4bb0, fabe62238d32404097129ae02ed3b0b3; no voters:
I20260810 01:55:52.924552 24396 raft_consensus.cc:2804] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P 5c71783cbed64297b17353312fcd4bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:55:52.924786 24396 raft_consensus.cc:697] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P 5c71783cbed64297b17353312fcd4bb0 [term 1 LEADER]: Becoming Leader. State: Replica: 5c71783cbed64297b17353312fcd4bb0, State: Running, Role: LEADER
I20260810 01:55:52.924916 22207 raft_consensus.cc:2468] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P 78c107f9dfbc4d3483895dda0f791bb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c71783cbed64297b17353312fcd4bb0 in term 1.
I20260810 01:55:52.925321 24396 consensus_queue.cc:237] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P 5c71783cbed64297b17353312fcd4bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } }
I20260810 01:55:52.929834 21816 catalog_manager.cc:5719] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P 5c71783cbed64297b17353312fcd4bb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c71783cbed64297b17353312fcd4bb0 (127.21.64.198). New cstate: current_term: 1 leader_uuid: "5c71783cbed64297b17353312fcd4bb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } health_report { overall_health: UNKNOWN } } }
I20260810 01:55:52.955394 24422 raft_consensus.cc:493] T 45a0083d86fa4eb789834db7e76b4161 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:55:52.955631 24422 raft_consensus.cc:515] T 45a0083d86fa4eb789834db7e76b4161 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:52.956810 24422 leader_election.cc:290] T 45a0083d86fa4eb789834db7e76b4161 P 687f288b7e9d4650a758d5451483e49b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65755ebc82864dc3a3193b1ba3870613 (127.21.64.195:46103), c5ca831c32e4452dba1cfc6cd296e532 (127.21.64.193:39917)
I20260810 01:55:52.957445 22026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a0083d86fa4eb789834db7e76b4161" candidate_uuid: "687f288b7e9d4650a758d5451483e49b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ca831c32e4452dba1cfc6cd296e532" is_pre_election: true
I20260810 01:55:52.957486 22391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a0083d86fa4eb789834db7e76b4161" candidate_uuid: "687f288b7e9d4650a758d5451483e49b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65755ebc82864dc3a3193b1ba3870613" is_pre_election: true
I20260810 01:55:52.957810 22391 raft_consensus.cc:2468] T 45a0083d86fa4eb789834db7e76b4161 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687f288b7e9d4650a758d5451483e49b in term 0.
I20260810 01:55:52.957800 22026 raft_consensus.cc:2468] T 45a0083d86fa4eb789834db7e76b4161 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687f288b7e9d4650a758d5451483e49b in term 0.
I20260810 01:55:52.958451 22687 leader_election.cc:304] T 45a0083d86fa4eb789834db7e76b4161 P 687f288b7e9d4650a758d5451483e49b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65755ebc82864dc3a3193b1ba3870613, 687f288b7e9d4650a758d5451483e49b; no voters:
I20260810 01:55:52.958899 24422 raft_consensus.cc:2804] T 45a0083d86fa4eb789834db7e76b4161 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:55:52.959120 24422 raft_consensus.cc:493] T 45a0083d86fa4eb789834db7e76b4161 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:55:52.959257 24422 raft_consensus.cc:3060] T 45a0083d86fa4eb789834db7e76b4161 P 687f288b7e9d4650a758d5451483e49b [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:52.962538 24422 raft_consensus.cc:515] T 45a0083d86fa4eb789834db7e76b4161 P 687f288b7e9d4650a758d5451483e49b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:52.963367 24422 leader_election.cc:290] T 45a0083d86fa4eb789834db7e76b4161 P 687f288b7e9d4650a758d5451483e49b [CANDIDATE]: Term 1 election: Requested vote from peers 65755ebc82864dc3a3193b1ba3870613 (127.21.64.195:46103), c5ca831c32e4452dba1cfc6cd296e532 (127.21.64.193:39917)
I20260810 01:55:52.964005 22026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a0083d86fa4eb789834db7e76b4161" candidate_uuid: "687f288b7e9d4650a758d5451483e49b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ca831c32e4452dba1cfc6cd296e532"
I20260810 01:55:52.964032 22391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a0083d86fa4eb789834db7e76b4161" candidate_uuid: "687f288b7e9d4650a758d5451483e49b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65755ebc82864dc3a3193b1ba3870613"
I20260810 01:55:52.964313 22391 raft_consensus.cc:3060] T 45a0083d86fa4eb789834db7e76b4161 P 65755ebc82864dc3a3193b1ba3870613 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:52.964290 22026 raft_consensus.cc:3060] T 45a0083d86fa4eb789834db7e76b4161 P c5ca831c32e4452dba1cfc6cd296e532 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:52.967823 22026 raft_consensus.cc:2468] T 45a0083d86fa4eb789834db7e76b4161 P c5ca831c32e4452dba1cfc6cd296e532 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687f288b7e9d4650a758d5451483e49b in term 1.
I20260810 01:55:52.968403 22691 leader_election.cc:304] T 45a0083d86fa4eb789834db7e76b4161 P 687f288b7e9d4650a758d5451483e49b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687f288b7e9d4650a758d5451483e49b, c5ca831c32e4452dba1cfc6cd296e532; no voters:
I20260810 01:55:52.968668 22391 raft_consensus.cc:2468] T 45a0083d86fa4eb789834db7e76b4161 P 65755ebc82864dc3a3193b1ba3870613 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687f288b7e9d4650a758d5451483e49b in term 1.
I20260810 01:55:52.968871 24422 raft_consensus.cc:2804] T 45a0083d86fa4eb789834db7e76b4161 P 687f288b7e9d4650a758d5451483e49b [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:55:52.969097 24422 raft_consensus.cc:697] T 45a0083d86fa4eb789834db7e76b4161 P 687f288b7e9d4650a758d5451483e49b [term 1 LEADER]: Becoming Leader. State: Replica: 687f288b7e9d4650a758d5451483e49b, State: Running, Role: LEADER
I20260810 01:55:52.969992 24422 consensus_queue.cc:237] T 45a0083d86fa4eb789834db7e76b4161 P 687f288b7e9d4650a758d5451483e49b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } }
I20260810 01:55:52.973527 24396 raft_consensus.cc:493] T 814423836b9a49daa8e09ab9934e01c1 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:55:52.973987 24396 raft_consensus.cc:515] T 814423836b9a49daa8e09ab9934e01c1 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:52.975015 24396 leader_election.cc:290] T 814423836b9a49daa8e09ab9934e01c1 P 5c71783cbed64297b17353312fcd4bb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194:33547), fabe62238d32404097129ae02ed3b0b3 (127.21.64.196:32931)
I20260810 01:55:52.974776 21816 catalog_manager.cc:5719] T 45a0083d86fa4eb789834db7e76b4161 P 687f288b7e9d4650a758d5451483e49b reported cstate change: term changed from 0 to 1, leader changed from <none> to 687f288b7e9d4650a758d5451483e49b (127.21.64.197). New cstate: current_term: 1 leader_uuid: "687f288b7e9d4650a758d5451483e49b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687f288b7e9d4650a758d5451483e49b" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 37655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 } health_report { overall_health: UNKNOWN } } }
I20260810 01:55:52.975777 22207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814423836b9a49daa8e09ab9934e01c1" candidate_uuid: "5c71783cbed64297b17353312fcd4bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78c107f9dfbc4d3483895dda0f791bb2" is_pre_election: true
I20260810 01:55:52.976168 22207 raft_consensus.cc:2468] T 814423836b9a49daa8e09ab9934e01c1 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c71783cbed64297b17353312fcd4bb0 in term 0.
I20260810 01:55:52.976316 22588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814423836b9a49daa8e09ab9934e01c1" candidate_uuid: "5c71783cbed64297b17353312fcd4bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabe62238d32404097129ae02ed3b0b3" is_pre_election: true
I20260810 01:55:52.976707 22588 raft_consensus.cc:2468] T 814423836b9a49daa8e09ab9934e01c1 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c71783cbed64297b17353312fcd4bb0 in term 0.
I20260810 01:55:52.976912 22861 leader_election.cc:304] T 814423836b9a49daa8e09ab9934e01c1 P 5c71783cbed64297b17353312fcd4bb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c71783cbed64297b17353312fcd4bb0, 78c107f9dfbc4d3483895dda0f791bb2; no voters:
I20260810 01:55:52.977555 24396 raft_consensus.cc:2804] T 814423836b9a49daa8e09ab9934e01c1 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:55:52.977756 24396 raft_consensus.cc:493] T 814423836b9a49daa8e09ab9934e01c1 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:55:52.978062 24396 raft_consensus.cc:3060] T 814423836b9a49daa8e09ab9934e01c1 P 5c71783cbed64297b17353312fcd4bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:52.981981 24396 raft_consensus.cc:515] T 814423836b9a49daa8e09ab9934e01c1 P 5c71783cbed64297b17353312fcd4bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:52.982892 24396 leader_election.cc:290] T 814423836b9a49daa8e09ab9934e01c1 P 5c71783cbed64297b17353312fcd4bb0 [CANDIDATE]: Term 1 election: Requested vote from peers 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194:33547), fabe62238d32404097129ae02ed3b0b3 (127.21.64.196:32931)
I20260810 01:55:52.983404 22207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814423836b9a49daa8e09ab9934e01c1" candidate_uuid: "5c71783cbed64297b17353312fcd4bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78c107f9dfbc4d3483895dda0f791bb2"
I20260810 01:55:52.983678 22207 raft_consensus.cc:3060] T 814423836b9a49daa8e09ab9934e01c1 P 78c107f9dfbc4d3483895dda0f791bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:52.984412 22588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814423836b9a49daa8e09ab9934e01c1" candidate_uuid: "5c71783cbed64297b17353312fcd4bb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabe62238d32404097129ae02ed3b0b3"
I20260810 01:55:52.984905 22588 raft_consensus.cc:3060] T 814423836b9a49daa8e09ab9934e01c1 P fabe62238d32404097129ae02ed3b0b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:55:52.990913 22588 raft_consensus.cc:2468] T 814423836b9a49daa8e09ab9934e01c1 P fabe62238d32404097129ae02ed3b0b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c71783cbed64297b17353312fcd4bb0 in term 1.
I20260810 01:55:52.990978 22207 raft_consensus.cc:2468] T 814423836b9a49daa8e09ab9934e01c1 P 78c107f9dfbc4d3483895dda0f791bb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c71783cbed64297b17353312fcd4bb0 in term 1.
I20260810 01:55:52.991465 22857 leader_election.cc:304] T 814423836b9a49daa8e09ab9934e01c1 P 5c71783cbed64297b17353312fcd4bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c71783cbed64297b17353312fcd4bb0, fabe62238d32404097129ae02ed3b0b3; no voters:
I20260810 01:55:52.991875 24396 raft_consensus.cc:2804] T 814423836b9a49daa8e09ab9934e01c1 P 5c71783cbed64297b17353312fcd4bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:55:52.992146 24396 raft_consensus.cc:697] T 814423836b9a49daa8e09ab9934e01c1 P 5c71783cbed64297b17353312fcd4bb0 [term 1 LEADER]: Becoming Leader. State: Replica: 5c71783cbed64297b17353312fcd4bb0, State: Running, Role: LEADER
I20260810 01:55:52.992587 24396 consensus_queue.cc:237] T 814423836b9a49daa8e09ab9934e01c1 P 5c71783cbed64297b17353312fcd4bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:55:52.997157 21816 catalog_manager.cc:5719] T 814423836b9a49daa8e09ab9934e01c1 P 5c71783cbed64297b17353312fcd4bb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c71783cbed64297b17353312fcd4bb0 (127.21.64.198). New cstate: current_term: 1 leader_uuid: "5c71783cbed64297b17353312fcd4bb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } health_report { overall_health: UNKNOWN } } }
I20260810 01:55:53.360555 24349 consensus_queue.cc:1048] T 45a0083d86fa4eb789834db7e76b4161 P 687f288b7e9d4650a758d5451483e49b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ca831c32e4452dba1cfc6cd296e532" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 39917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:53.370940 24349 consensus_queue.cc:1048] T 45a0083d86fa4eb789834db7e76b4161 P 687f288b7e9d4650a758d5451483e49b [LEADER]: Connected to new peer: Peer: permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:53.387778 24396 consensus_queue.cc:1048] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P 5c71783cbed64297b17353312fcd4bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:53.396790 24396 consensus_queue.cc:1048] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P 5c71783cbed64297b17353312fcd4bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 01:55:53.507494 24473 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:55:53.507870 24473 flags.cc:432] Enabled unsafe flag: --never_fsync=true
Using table 'rebalance_test_table_11'
I20260810 01:55:53.568311 24396 consensus_queue.cc:1048] T 814423836b9a49daa8e09ab9934e01c1 P 5c71783cbed64297b17353312fcd4bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:55:53.578303 24396 consensus_queue.cc:1048] T 814423836b9a49daa8e09ab9934e01c1 P 5c71783cbed64297b17353312fcd4bb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 301.544 ms
time per row: 0.150772 ms
I20260810 01:55:54.987121 22921 tablet_service.cc:1467] Tablet server has 10 leaders and 0 scanners
I20260810 01:55:55.035478 22739 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:55:55.035681 22364 tablet_service.cc:1467] Tablet server has 10 leaders and 0 scanners
I20260810 01:55:55.105782 21994 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:55:55.136334 22181 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 01:55:55.167474 22558 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:55:55.450453 22364 tablet_service.cc:1467] Tablet server has 10 leaders and 0 scanners
I20260810 01:55:55.465015 22921 tablet_service.cc:1467] Tablet server has 10 leaders and 0 scanners
I20260810 01:55:55.466020 22739 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:55:55.467131 22558 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:55:55.471505 22181 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 01:55:55.486806 21994 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:55:55.811213 22921 tablet_service.cc:1467] Tablet server has 10 leaders and 0 scanners
I20260810 01:55:55.822710 22364 tablet_service.cc:1467] Tablet server has 10 leaders and 0 scanners
I20260810 01:55:55.825667 22558 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:55:55.830613 22181 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 01:55:55.839116 22739 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:55:55.850592 21994 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:55:56.178467 22364 tablet_service.cc:1467] Tablet server has 10 leaders and 0 scanners
I20260810 01:55:56.186200 22739 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:55:56.204352 22558 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:55:56.206063 22921 tablet_service.cc:1467] Tablet server has 10 leaders and 0 scanners
I20260810 01:55:56.229420 22181 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 01:55:56.250018 21994 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:55:56.672842 22739 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:55:56.673251 22921 tablet_service.cc:1467] Tablet server has 10 leaders and 0 scanners
I20260810 01:55:56.676934 22364 tablet_service.cc:1467] Tablet server has 10 leaders and 0 scanners
I20260810 01:55:56.727139 22181 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 01:55:56.788910 22558 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:55:56.795323 21994 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:55:57.274748 22739 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:55:57.275377 22921 tablet_service.cc:1467] Tablet server has 10 leaders and 0 scanners
I20260810 01:55:57.283378 22364 tablet_service.cc:1467] Tablet server has 10 leaders and 0 scanners
I20260810 01:55:57.306061 22181 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 01:55:57.321625 22558 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:55:57.326781 21994 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+---------------------+---------
bf0370fa21854d2c844561ee38dfbd53 | 127.21.64.254:44083 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------+-------------------------
ipki_ca_key_size | 768 | experimental | all 1 server(s) checked
ipki_server_key_size | 768 | experimental | all 1 server(s) checked
never_fsync | true | unsafe,advanced | all 1 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 1 server(s) checked
raft_prepare_replacement_before_eviction | true | experimental,advanced | all 1 server(s) checked
rpc_reuseport | true | experimental | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
server_dump_info_format | pb | hidden | all 1 server(s) checked
server_dump_info_path | /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/data/info.pb | hidden | all 1 server(s) checked
tsk_num_rsa_bits | 512 | experimental | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+---------------------+-------------------------
builtin_ntp_servers | 127.21.64.212:41935 | all 1 server(s) checked
time_source | builtin | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+---------------------+---------+----------+----------------+-----------------
5c71783cbed64297b17353312fcd4bb0 | 127.21.64.198:33973 | HEALTHY | /C | 10 | 0
65755ebc82864dc3a3193b1ba3870613 | 127.21.64.195:46103 | HEALTHY | /B | 10 | 0
687f288b7e9d4650a758d5451483e49b | 127.21.64.197:37655 | HEALTHY | /C | 4 | 0
78c107f9dfbc4d3483895dda0f791bb2 | 127.21.64.194:33547 | HEALTHY | /A | 3 | 0
c5ca831c32e4452dba1cfc6cd296e532 | 127.21.64.193:39917 | HEALTHY | /A | 4 | 0
fabe62238d32404097129ae02ed3b0b3 | 127.21.64.196:32931 | HEALTHY | /B | 5 | 0
Tablet Server Location Summary
Location | Count
----------+---------
/A | 2
/C | 2
/B | 2
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------+-------------------------
ipki_server_key_size | 768 | experimental | all 6 server(s) checked
local_ip_for_outbound_sockets | 127.21.64.193 | experimental | 127.21.64.193:39917
local_ip_for_outbound_sockets | 127.21.64.194 | experimental | 127.21.64.194:33547
local_ip_for_outbound_sockets | 127.21.64.195 | experimental | 127.21.64.195:46103
local_ip_for_outbound_sockets | 127.21.64.196 | experimental | 127.21.64.196:32931
local_ip_for_outbound_sockets | 127.21.64.197 | experimental | 127.21.64.197:37655
local_ip_for_outbound_sockets | 127.21.64.198 | experimental | 127.21.64.198:33973
never_fsync | true | unsafe,advanced | all 6 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 6 server(s) checked
raft_prepare_replacement_before_eviction | true | experimental,advanced | all 6 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 6 server(s) checked
server_dump_info_format | pb | hidden | all 6 server(s) checked
server_dump_info_path | /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/data/info.pb | hidden | 127.21.64.193:39917
server_dump_info_path | /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/data/info.pb | hidden | 127.21.64.194:33547
server_dump_info_path | /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/data/info.pb | hidden | 127.21.64.195:46103
server_dump_info_path | /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/data/info.pb | hidden | 127.21.64.196:32931
server_dump_info_path | /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data/info.pb | hidden | 127.21.64.197:37655
server_dump_info_path | /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/data/info.pb | hidden | 127.21.64.198:33973
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+---------------------+-------------------------
builtin_ntp_servers | 127.21.64.212:41935 | all 6 server(s) checked
time_source | builtin | all 6 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 7 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
-------------------------+----+---------+---------------+---------+------------+------------------+-------------
rebalance_test_table_0 | 3 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_1 | 3 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_10 | 3 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_11 | 3 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_2 | 3 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_3 | 3 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_4 | 3 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_5 | 3 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_6 | 3 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_7 | 3 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_8 | 3 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_9 | 3 | HEALTHY | 3 | 3 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 18
First Quartile | 18
Median | 18
Third Quartile | 18
Maximum | 18
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 6
Tables | 12
Tablets | 36
Replicas | 108
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20260810 01:55:57.416162 21763 log_verifier.cc:126] Checking tablet 028bbde650444c5ba3e54c4cdab941db
I20260810 01:55:57.461229 21763 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 028bbde650444c5ba3e54c4cdab941db
I20260810 01:55:57.461452 21763 log_verifier.cc:126] Checking tablet 0d8ea0eb9e1440fbb6a729f093d9fc18
I20260810 01:55:57.499517 21763 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 0d8ea0eb9e1440fbb6a729f093d9fc18
I20260810 01:55:57.499614 21763 log_verifier.cc:126] Checking tablet 1f62ef81920c40b1899c6bbf347e3b2e
I20260810 01:55:57.570362 21763 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 1f62ef81920c40b1899c6bbf347e3b2e
I20260810 01:55:57.570479 21763 log_verifier.cc:126] Checking tablet 20c224643c524dd4b94febd93fd28584
I20260810 01:55:57.715507 21763 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 20c224643c524dd4b94febd93fd28584
I20260810 01:55:57.715689 21763 log_verifier.cc:126] Checking tablet 28b80aa4fa264ceb88af4864206f1e10
I20260810 01:55:57.841856 21763 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 28b80aa4fa264ceb88af4864206f1e10
I20260810 01:55:57.841995 21763 log_verifier.cc:126] Checking tablet 29268e7314114f5c87a36479ed0dd60e
I20260810 01:55:57.900408 21763 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 29268e7314114f5c87a36479ed0dd60e
I20260810 01:55:57.900507 21763 log_verifier.cc:126] Checking tablet 2dbf8a1de7674d8b88b046c757664d57
I20260810 01:55:58.013083 21763 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 2dbf8a1de7674d8b88b046c757664d57
I20260810 01:55:58.013216 21763 log_verifier.cc:126] Checking tablet 2f36b502299044ec842394062481252c
I20260810 01:55:58.112594 21763 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 2f36b502299044ec842394062481252c
I20260810 01:55:58.112701 21763 log_verifier.cc:126] Checking tablet 359ad38fcf6846fe82f7874ef454fe4b
I20260810 01:55:58.235590 21763 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 359ad38fcf6846fe82f7874ef454fe4b
I20260810 01:55:58.235826 21763 log_verifier.cc:126] Checking tablet 35d4c74a46c44d1c9e98530d00061bdc
I20260810 01:55:58.364578 21763 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 35d4c74a46c44d1c9e98530d00061bdc
I20260810 01:55:58.364796 21763 log_verifier.cc:126] Checking tablet 36b269b1f6694a1c9c741dd5dab037b9
I20260810 01:55:58.473536 21763 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 36b269b1f6694a1c9c741dd5dab037b9
I20260810 01:55:58.473800 21763 log_verifier.cc:126] Checking tablet 427e0356411c46059107c49238ddedfa
I20260810 01:55:58.591413 21763 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 427e0356411c46059107c49238ddedfa
I20260810 01:55:58.591529 21763 log_verifier.cc:126] Checking tablet 45a0083d86fa4eb789834db7e76b4161
I20260810 01:55:58.731261 21763 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 45a0083d86fa4eb789834db7e76b4161
I20260810 01:55:58.731416 21763 log_verifier.cc:126] Checking tablet 46544528d07a4f4683baee8a22eca388
I20260810 01:55:58.845624 21763 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 46544528d07a4f4683baee8a22eca388
I20260810 01:55:58.845782 21763 log_verifier.cc:126] Checking tablet 4bc432ae575f4b828fa1bc6a5d7e9bd8
I20260810 01:55:58.966133 21763 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 4bc432ae575f4b828fa1bc6a5d7e9bd8
I20260810 01:55:58.966291 21763 log_verifier.cc:126] Checking tablet 50e87df99e0947a294ea41b1fd5f71c1
I20260810 01:55:59.102959 21763 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 50e87df99e0947a294ea41b1fd5f71c1
I20260810 01:55:59.103158 21763 log_verifier.cc:126] Checking tablet 63866006eb03493e84bcb3661d1e2c04
I20260810 01:55:59.236574 21763 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 63866006eb03493e84bcb3661d1e2c04
I20260810 01:55:59.236752 21763 log_verifier.cc:126] Checking tablet 68dd7bad9556499581be22797800a04d
I20260810 01:55:59.342445 21763 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 68dd7bad9556499581be22797800a04d
I20260810 01:55:59.342646 21763 log_verifier.cc:126] Checking tablet 70ababa88c614a8487937414d3d01c09
I20260810 01:55:59.448025 21763 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 70ababa88c614a8487937414d3d01c09
I20260810 01:55:59.448179 21763 log_verifier.cc:126] Checking tablet 722c63fbaec0458f919e69376eb06f68
I20260810 01:55:59.561283 21763 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 722c63fbaec0458f919e69376eb06f68
I20260810 01:55:59.561509 21763 log_verifier.cc:126] Checking tablet 7436e2843ee4428887e108699ed25663
I20260810 01:55:59.695574 21763 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 7436e2843ee4428887e108699ed25663
I20260810 01:55:59.695734 21763 log_verifier.cc:126] Checking tablet 7d1f61329cf44dfbb36cbf585bc56493
I20260810 01:55:59.821722 21763 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 7d1f61329cf44dfbb36cbf585bc56493
I20260810 01:55:59.821933 21763 log_verifier.cc:126] Checking tablet 7e1b884fb1e24b90a854a6a0d582d16e
I20260810 01:55:59.978308 21763 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 7e1b884fb1e24b90a854a6a0d582d16e
I20260810 01:55:59.978513 21763 log_verifier.cc:126] Checking tablet 814423836b9a49daa8e09ab9934e01c1
I20260810 01:56:00.128201 21763 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 814423836b9a49daa8e09ab9934e01c1
I20260810 01:56:00.128404 21763 log_verifier.cc:126] Checking tablet 8a439c266a594bce8c0b5f22c571dbc2
I20260810 01:56:00.280273 21763 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 8a439c266a594bce8c0b5f22c571dbc2
I20260810 01:56:00.280447 21763 log_verifier.cc:126] Checking tablet a875835a0e7c4109a9035551e5d3104f
I20260810 01:56:00.434095 21763 log_verifier.cc:177] Verified matching terms for 3 ops in tablet a875835a0e7c4109a9035551e5d3104f
I20260810 01:56:00.434244 21763 log_verifier.cc:126] Checking tablet adc7dc90da474e878d33fb70f40448f0
I20260810 01:56:00.576262 21763 log_verifier.cc:177] Verified matching terms for 3 ops in tablet adc7dc90da474e878d33fb70f40448f0
I20260810 01:56:00.576462 21763 log_verifier.cc:126] Checking tablet b2ee0c4723ab4043947371e655488eae
I20260810 01:56:00.712199 21763 log_verifier.cc:177] Verified matching terms for 3 ops in tablet b2ee0c4723ab4043947371e655488eae
I20260810 01:56:00.712455 21763 log_verifier.cc:126] Checking tablet d6a98598516f48c2a4e52595dca944a6
I20260810 01:56:00.822846 21763 log_verifier.cc:177] Verified matching terms for 3 ops in tablet d6a98598516f48c2a4e52595dca944a6
I20260810 01:56:00.822988 21763 log_verifier.cc:126] Checking tablet dfa2ad0ddcec4fb19c574b24af26a9c8
I20260810 01:56:00.933496 21763 log_verifier.cc:177] Verified matching terms for 3 ops in tablet dfa2ad0ddcec4fb19c574b24af26a9c8
I20260810 01:56:00.933694 21763 log_verifier.cc:126] Checking tablet ea63e0d471f84790a30e81a01d40d131
I20260810 01:56:01.043896 21763 log_verifier.cc:177] Verified matching terms for 3 ops in tablet ea63e0d471f84790a30e81a01d40d131
I20260810 01:56:01.044062 21763 log_verifier.cc:126] Checking tablet eff94403f0e847568a8be1b329da4969
I20260810 01:56:01.163460 21763 log_verifier.cc:177] Verified matching terms for 3 ops in tablet eff94403f0e847568a8be1b329da4969
I20260810 01:56:01.163785 21763 log_verifier.cc:126] Checking tablet f52f608800a643c7acf05e348742c26c
I20260810 01:56:01.282047 21763 log_verifier.cc:177] Verified matching terms for 3 ops in tablet f52f608800a643c7acf05e348742c26c
I20260810 01:56:01.282203 21763 log_verifier.cc:126] Checking tablet f6642e361e1e4813b740fe13644c511f
I20260810 01:56:01.399812 21763 log_verifier.cc:177] Verified matching terms for 3 ops in tablet f6642e361e1e4813b740fe13644c511f
I20260810 01:56:01.399923 21763 log_verifier.cc:126] Checking tablet fb7d801916db4a8c99e18e9ca9606f11
I20260810 01:56:01.518471 21763 log_verifier.cc:177] Verified matching terms for 3 ops in tablet fb7d801916db4a8c99e18e9ca9606f11
I20260810 01:56:01.518581 21763 log_verifier.cc:126] Checking tablet fe76acfea4c64d9985e2fe554c0414b8
I20260810 01:56:01.631871 21763 log_verifier.cc:177] Verified matching terms for 3 ops in tablet fe76acfea4c64d9985e2fe554c0414b8
I20260810 01:56:01.661994 21763 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskNubV1X/build/asan/bin/kudu pid 21907
I20260810 01:56:01.711941 22076 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 01:56:01.867076 21763 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskNubV1X/build/asan/bin/kudu with pid 21907
W20260810 01:56:01.908526 22502 connection.cc:573] server connection from 127.21.64.193:60915 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 01:56:01.908746 22687 connection.cc:573] server connection from 127.21.64.193:55025 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 01:56:01.908808 21763 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskNubV1X/build/asan/bin/kudu pid 22090
I20260810 01:56:01.916460 22256 generic_service.cc:196] Checking for leaks (request via RPC)
W20260810 01:56:01.938230 22297 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.64.193:39917: connect: Connection refused (error 111)
W20260810 01:56:01.940155 22297 consensus_peers.cc:597] T ea63e0d471f84790a30e81a01d40d131 P 65755ebc82864dc3a3193b1ba3870613 -> Peer c5ca831c32e4452dba1cfc6cd296e532 (127.21.64.193:39917): Couldn't send request to peer c5ca831c32e4452dba1cfc6cd296e532. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.193:39917: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260810 01:56:01.966794 22297 consensus_peers.cc:597] T 35d4c74a46c44d1c9e98530d00061bdc P 65755ebc82864dc3a3193b1ba3870613 -> Peer c5ca831c32e4452dba1cfc6cd296e532 (127.21.64.193:39917): Couldn't send request to peer c5ca831c32e4452dba1cfc6cd296e532. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.193:39917: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260810 01:56:01.968786 22297 consensus_peers.cc:597] T 29268e7314114f5c87a36479ed0dd60e P 65755ebc82864dc3a3193b1ba3870613 -> Peer c5ca831c32e4452dba1cfc6cd296e532 (127.21.64.193:39917): Couldn't send request to peer c5ca831c32e4452dba1cfc6cd296e532. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.193:39917: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260810 01:56:01.971930 22297 consensus_peers.cc:597] T a875835a0e7c4109a9035551e5d3104f P 65755ebc82864dc3a3193b1ba3870613 -> Peer c5ca831c32e4452dba1cfc6cd296e532 (127.21.64.193:39917): Couldn't send request to peer c5ca831c32e4452dba1cfc6cd296e532. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.193:39917: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260810 01:56:01.978181 22691 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.64.193:39917: connect: Connection refused (error 111)
W20260810 01:56:01.979892 22691 consensus_peers.cc:597] T 1f62ef81920c40b1899c6bbf347e3b2e P 687f288b7e9d4650a758d5451483e49b -> Peer c5ca831c32e4452dba1cfc6cd296e532 (127.21.64.193:39917): Couldn't send request to peer c5ca831c32e4452dba1cfc6cd296e532. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.193:39917: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260810 01:56:01.996781 22297 consensus_peers.cc:597] T 028bbde650444c5ba3e54c4cdab941db P 65755ebc82864dc3a3193b1ba3870613 -> Peer c5ca831c32e4452dba1cfc6cd296e532 (127.21.64.193:39917): Couldn't send request to peer c5ca831c32e4452dba1cfc6cd296e532. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.193:39917: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260810 01:56:02.066159 22297 consensus_peers.cc:597] T 8a439c266a594bce8c0b5f22c571dbc2 P 65755ebc82864dc3a3193b1ba3870613 -> Peer c5ca831c32e4452dba1cfc6cd296e532 (127.21.64.193:39917): Couldn't send request to peer c5ca831c32e4452dba1cfc6cd296e532. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.193:39917: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260810 01:56:02.085902 22691 consensus_peers.cc:597] T 2f36b502299044ec842394062481252c P 687f288b7e9d4650a758d5451483e49b -> Peer c5ca831c32e4452dba1cfc6cd296e532 (127.21.64.193:39917): Couldn't send request to peer c5ca831c32e4452dba1cfc6cd296e532. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.193:39917: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 01:56:02.088564 21763 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskNubV1X/build/asan/bin/kudu with pid 22090
W20260810 01:56:02.153837 22297 consensus_peers.cc:597] T b2ee0c4723ab4043947371e655488eae P 65755ebc82864dc3a3193b1ba3870613 -> Peer c5ca831c32e4452dba1cfc6cd296e532 (127.21.64.193:39917): Couldn't send request to peer c5ca831c32e4452dba1cfc6cd296e532. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.193:39917: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260810 01:56:02.156735 22861 connection.cc:573] client connection to 127.21.64.194:33547 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 01:56:02.157203 22861 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 01:56:02.157523 21763 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskNubV1X/build/asan/bin/kudu pid 22270
W20260810 01:56:02.158413 22295 connection.cc:573] server connection from 127.21.64.194:34355 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 01:56:02.162704 22861 consensus_peers.cc:597] T 63866006eb03493e84bcb3661d1e2c04 P 5c71783cbed64297b17353312fcd4bb0 -> Peer 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194:33547): Couldn't send request to peer 78c107f9dfbc4d3483895dda0f791bb2. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.194:33547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260810 01:56:02.163172 22861 consensus_peers.cc:597] T 722c63fbaec0458f919e69376eb06f68 P 5c71783cbed64297b17353312fcd4bb0 -> Peer 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194:33547): Couldn't send request to peer 78c107f9dfbc4d3483895dda0f791bb2. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.194:33547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260810 01:56:02.163370 22861 consensus_peers.cc:597] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P 5c71783cbed64297b17353312fcd4bb0 -> Peer 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194:33547): Couldn't send request to peer 78c107f9dfbc4d3483895dda0f791bb2. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.194:33547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260810 01:56:02.163619 22861 consensus_peers.cc:597] T adc7dc90da474e878d33fb70f40448f0 P 5c71783cbed64297b17353312fcd4bb0 -> Peer 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194:33547): Couldn't send request to peer 78c107f9dfbc4d3483895dda0f791bb2. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.194:33547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 01:56:02.173686 22459 generic_service.cc:196] Checking for leaks (request via RPC)
W20260810 01:56:02.189280 22502 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.64.194:33547: connect: Connection refused (error 111)
W20260810 01:56:02.192567 22502 consensus_peers.cc:597] T 70ababa88c614a8487937414d3d01c09 P fabe62238d32404097129ae02ed3b0b3 -> Peer 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194:33547): Couldn't send request to peer 78c107f9dfbc4d3483895dda0f791bb2. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.194:33547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260810 01:56:02.195137 22861 consensus_peers.cc:597] T 359ad38fcf6846fe82f7874ef454fe4b P 5c71783cbed64297b17353312fcd4bb0 -> Peer 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194:33547): Couldn't send request to peer 78c107f9dfbc4d3483895dda0f791bb2. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.194:33547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260810 01:56:02.195380 22861 consensus_peers.cc:597] T 7e1b884fb1e24b90a854a6a0d582d16e P 5c71783cbed64297b17353312fcd4bb0 -> Peer 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194:33547): Couldn't send request to peer 78c107f9dfbc4d3483895dda0f791bb2. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.194:33547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260810 01:56:02.232667 22691 consensus_peers.cc:597] T fb7d801916db4a8c99e18e9ca9606f11 P 687f288b7e9d4650a758d5451483e49b -> Peer c5ca831c32e4452dba1cfc6cd296e532 (127.21.64.193:39917): Couldn't send request to peer c5ca831c32e4452dba1cfc6cd296e532. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.193:39917: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260810 01:56:02.232682 22502 consensus_peers.cc:597] T 427e0356411c46059107c49238ddedfa P fabe62238d32404097129ae02ed3b0b3 -> Peer 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194:33547): Couldn't send request to peer 78c107f9dfbc4d3483895dda0f791bb2. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.194:33547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260810 01:56:02.254215 22502 consensus_peers.cc:597] T 7436e2843ee4428887e108699ed25663 P fabe62238d32404097129ae02ed3b0b3 -> Peer 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194:33547): Couldn't send request to peer 78c107f9dfbc4d3483895dda0f791bb2. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.194:33547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260810 01:56:02.255780 22502 consensus_peers.cc:597] T f6642e361e1e4813b740fe13644c511f P fabe62238d32404097129ae02ed3b0b3 -> Peer 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194:33547): Couldn't send request to peer 78c107f9dfbc4d3483895dda0f791bb2. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.194:33547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260810 01:56:02.266515 22861 consensus_peers.cc:597] T 814423836b9a49daa8e09ab9934e01c1 P 5c71783cbed64297b17353312fcd4bb0 -> Peer 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194:33547): Couldn't send request to peer 78c107f9dfbc4d3483895dda0f791bb2. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.194:33547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260810 01:56:02.275411 22861 consensus_peers.cc:597] T 20c224643c524dd4b94febd93fd28584 P 5c71783cbed64297b17353312fcd4bb0 -> Peer 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194:33547): Couldn't send request to peer 78c107f9dfbc4d3483895dda0f791bb2. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.194:33547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260810 01:56:02.280663 22861 consensus_peers.cc:597] T 68dd7bad9556499581be22797800a04d P 5c71783cbed64297b17353312fcd4bb0 -> Peer 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194:33547): Couldn't send request to peer 78c107f9dfbc4d3483895dda0f791bb2. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.194:33547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260810 01:56:02.308293 22691 consensus_peers.cc:597] T 45a0083d86fa4eb789834db7e76b4161 P 687f288b7e9d4650a758d5451483e49b -> Peer c5ca831c32e4452dba1cfc6cd296e532 (127.21.64.193:39917): Couldn't send request to peer c5ca831c32e4452dba1cfc6cd296e532. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.193:39917: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260810 01:56:02.372253 22861 consensus_peers.cc:597] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P 5c71783cbed64297b17353312fcd4bb0 -> Peer 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194:33547): Couldn't send request to peer 78c107f9dfbc4d3483895dda0f791bb2. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.194:33547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260810 01:56:02.398871 22502 consensus_peers.cc:597] T dfa2ad0ddcec4fb19c574b24af26a9c8 P fabe62238d32404097129ae02ed3b0b3 -> Peer 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194:33547): Couldn't send request to peer 78c107f9dfbc4d3483895dda0f791bb2. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.194:33547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 01:56:02.432773 21763 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskNubV1X/build/asan/bin/kudu with pid 22270
W20260810 01:56:02.496239 21804 connection.cc:573] server connection from 127.21.64.195:50449 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 01:56:02.496222 22687 connection.cc:573] client connection to 127.21.64.195:46103 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 01:56:02.496176 22690 connection.cc:573] server connection from 127.21.64.195:59935 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 01:56:02.497576 21763 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskNubV1X/build/asan/bin/kudu pid 22476
W20260810 01:56:02.498977 22687 consensus_peers.cc:597] T fb7d801916db4a8c99e18e9ca9606f11 P 687f288b7e9d4650a758d5451483e49b -> Peer 65755ebc82864dc3a3193b1ba3870613 (127.21.64.195:46103): Couldn't send request to peer 65755ebc82864dc3a3193b1ba3870613. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.195:46103: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 01:56:02.510265 22651 generic_service.cc:196] Checking for leaks (request via RPC)
W20260810 01:56:02.521683 22687 consensus_peers.cc:597] T 45a0083d86fa4eb789834db7e76b4161 P 687f288b7e9d4650a758d5451483e49b -> Peer 65755ebc82864dc3a3193b1ba3870613 (127.21.64.195:46103): Couldn't send request to peer 65755ebc82864dc3a3193b1ba3870613. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.195:46103: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260810 01:56:02.551004 22687 consensus_peers.cc:597] T 2f36b502299044ec842394062481252c P 687f288b7e9d4650a758d5451483e49b -> Peer 65755ebc82864dc3a3193b1ba3870613 (127.21.64.195:46103): Couldn't send request to peer 65755ebc82864dc3a3193b1ba3870613. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.195:46103: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 01:56:02.752938 21763 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskNubV1X/build/asan/bin/kudu with pid 22476
W20260810 01:56:02.813042 22857 connection.cc:573] client connection to 127.21.64.196:32931 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 01:56:02.814687 21763 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskNubV1X/build/asan/bin/kudu pid 22662
W20260810 01:56:02.815660 22857 consensus_peers.cc:597] T adc7dc90da474e878d33fb70f40448f0 P 5c71783cbed64297b17353312fcd4bb0 -> Peer fabe62238d32404097129ae02ed3b0b3 (127.21.64.196:32931): Couldn't send request to peer fabe62238d32404097129ae02ed3b0b3. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.196:32931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260810 01:56:02.816251 22857 consensus_peers.cc:597] T 359ad38fcf6846fe82f7874ef454fe4b P 5c71783cbed64297b17353312fcd4bb0 -> Peer fabe62238d32404097129ae02ed3b0b3 (127.21.64.196:32931): Couldn't send request to peer fabe62238d32404097129ae02ed3b0b3. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.196:32931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260810 01:56:02.816609 22857 consensus_peers.cc:597] T 63866006eb03493e84bcb3661d1e2c04 P 5c71783cbed64297b17353312fcd4bb0 -> Peer fabe62238d32404097129ae02ed3b0b3 (127.21.64.196:32931): Couldn't send request to peer fabe62238d32404097129ae02ed3b0b3. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.196:32931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260810 01:56:02.816883 22857 consensus_peers.cc:597] T 722c63fbaec0458f919e69376eb06f68 P 5c71783cbed64297b17353312fcd4bb0 -> Peer fabe62238d32404097129ae02ed3b0b3 (127.21.64.196:32931): Couldn't send request to peer fabe62238d32404097129ae02ed3b0b3. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.196:32931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260810 01:56:02.817108 22857 consensus_peers.cc:597] T 7e1b884fb1e24b90a854a6a0d582d16e P 5c71783cbed64297b17353312fcd4bb0 -> Peer fabe62238d32404097129ae02ed3b0b3 (127.21.64.196:32931): Couldn't send request to peer fabe62238d32404097129ae02ed3b0b3. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.196:32931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260810 01:56:02.817279 22857 consensus_peers.cc:597] T 68dd7bad9556499581be22797800a04d P 5c71783cbed64297b17353312fcd4bb0 -> Peer fabe62238d32404097129ae02ed3b0b3 (127.21.64.196:32931): Couldn't send request to peer fabe62238d32404097129ae02ed3b0b3. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.196:32931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260810 01:56:02.818825 22857 consensus_peers.cc:597] T 20c224643c524dd4b94febd93fd28584 P 5c71783cbed64297b17353312fcd4bb0 -> Peer fabe62238d32404097129ae02ed3b0b3 (127.21.64.196:32931): Couldn't send request to peer fabe62238d32404097129ae02ed3b0b3. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.196:32931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260810 01:56:02.821269 22857 consensus_peers.cc:597] T 814423836b9a49daa8e09ab9934e01c1 P 5c71783cbed64297b17353312fcd4bb0 -> Peer fabe62238d32404097129ae02ed3b0b3 (127.21.64.196:32931): Couldn't send request to peer fabe62238d32404097129ae02ed3b0b3. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.196:32931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 01:56:02.826635 22825 generic_service.cc:196] Checking for leaks (request via RPC)
W20260810 01:56:02.883505 22857 consensus_peers.cc:597] T 4bc432ae575f4b828fa1bc6a5d7e9bd8 P 5c71783cbed64297b17353312fcd4bb0 -> Peer fabe62238d32404097129ae02ed3b0b3 (127.21.64.196:32931): Couldn't send request to peer fabe62238d32404097129ae02ed3b0b3. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.196:32931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260810 01:56:02.950766 22857 consensus_peers.cc:597] T 0d8ea0eb9e1440fbb6a729f093d9fc18 P 5c71783cbed64297b17353312fcd4bb0 -> Peer fabe62238d32404097129ae02ed3b0b3 (127.21.64.196:32931): Couldn't send request to peer fabe62238d32404097129ae02ed3b0b3. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.196:32931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 01:56:03.061208 21763 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskNubV1X/build/asan/bin/kudu with pid 22662
I20260810 01:56:03.125588 21763 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskNubV1X/build/asan/bin/kudu pid 22834
I20260810 01:56:03.138226 23001 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 01:56:03.387926 25031 raft_consensus.cc:493] T 46544528d07a4f4683baee8a22eca388 P 5c71783cbed64297b17353312fcd4bb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 78c107f9dfbc4d3483895dda0f791bb2)
I20260810 01:56:03.389557 25031 raft_consensus.cc:515] T 46544528d07a4f4683baee8a22eca388 P 5c71783cbed64297b17353312fcd4bb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } }
I20260810 01:56:03.392293 25031 leader_election.cc:290] T 46544528d07a4f4683baee8a22eca388 P 5c71783cbed64297b17353312fcd4bb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194:33547), fabe62238d32404097129ae02ed3b0b3 (127.21.64.196:32931)
I20260810 01:56:03.395814 25038 raft_consensus.cc:493] T 28b80aa4fa264ceb88af4864206f1e10 P 5c71783cbed64297b17353312fcd4bb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 78c107f9dfbc4d3483895dda0f791bb2)
I20260810 01:56:03.396153 25038 raft_consensus.cc:515] T 28b80aa4fa264ceb88af4864206f1e10 P 5c71783cbed64297b17353312fcd4bb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fabe62238d32404097129ae02ed3b0b3" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 32931 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } }
I20260810 01:56:03.398257 25038 leader_election.cc:290] T 28b80aa4fa264ceb88af4864206f1e10 P 5c71783cbed64297b17353312fcd4bb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fabe62238d32404097129ae02ed3b0b3 (127.21.64.196:32931), 78c107f9dfbc4d3483895dda0f791bb2 (127.21.64.194:33547)
I20260810 01:56:03.398357 25035 raft_consensus.cc:493] T eff94403f0e847568a8be1b329da4969 P 5c71783cbed64297b17353312fcd4bb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 78c107f9dfbc4d3483895dda0f791bb2)
I20260810 01:56:03.398715 25035 raft_consensus.cc:515] T eff94403f0e847568a8be1b329da4969 P 5c71783cbed64297b17353312fcd4bb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65755ebc82864dc3a3193b1ba3870613" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 46103 } } peers { permanent_uuid: "5c71783cbed64297b17353312fcd4bb0" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 33973 } } peers { permanent_uuid: "78c107f9dfbc4d3483895dda0f791bb2" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 33547 } }
I20260810 01:56:03.399320 21763 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskNubV1X/build/asan/bin/kudu with pid 22834
W20260810 01:56:03.460304 21807 connection.cc:573] server connection from 127.21.64.198:59593 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 01:56:03.460732 21763 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskNubV1X/build/asan/bin/kudu pid 21780
I20260810 01:56:03.462694 21866 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 01:56:03.754336 21763 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskNubV1X/build/asan/bin/kudu with pid 21780
2026-08-10T01:56:03Z chronyd exiting
[ OK ] LocationAwareRebalancingBasicTest.Basic (34637 ms)
[----------] 1 test from LocationAwareRebalancingBasicTest (34638 ms total)
[----------] 1 test from RebalanceStartCriteriaTest
[ RUN ] RebalanceStartCriteriaTest.UnknownIgnoredTServer/0
I20260810 01:56:04.076575 21763 ts_itest-base.cc:115] Starting cluster with:
I20260810 01:56:04.076819 21763 ts_itest-base.cc:116] --------------
I20260810 01:56:04.076956 21763 ts_itest-base.cc:117] 5 tablet servers
I20260810 01:56:04.077088 21763 ts_itest-base.cc:118] 3 replicas per TS
I20260810 01:56:04.077188 21763 ts_itest-base.cc:119] --------------
2026-08-10T01:56:04Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:56:04Z Disabled control of system clock
I20260810 01:56:04.163851 21763 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNubV1X/build/asan/bin/kudu
/tmp/dist-test-taskNubV1X/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.64.254:38339
--webserver_interface=127.21.64.254
--webserver_port=0
--builtin_ntp_servers=127.21.64.212:35453
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.64.254:38339
--raft_prepare_replacement_before_eviction=false
--enable_range_replica_placement=false with env {}
W20260810 01:56:04.825111 25057 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:56:04.825915 25057 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:56:04.826138 25057 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 01:56:04.840837 25057 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260810 01:56:04.841024 25057 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:56:04.841243 25057 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:56:04.841413 25057 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:56:04.841598 25057 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:56:04.859596 25057 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.64.212:35453
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/wal
--enable_range_replica_placement=false
--ipki_ca_key_size=768
--master_addresses=127.21.64.254:38339
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.64.254:38339
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.21.64.254
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 01:44:04 UTC on e7f111948823
build id 13266
ASAN enabled
I20260810 01:56:04.862979 25057 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:56:04.866714 25057 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 01:56:04.882917 25064 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:56:04.882980 25065 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:56:04.884114 25070 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:56:04.886286 25057 server_base.cc:1061] running on GCE node
I20260810 01:56:04.887862 25057 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:56:04.891259 25057 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:56:04.892697 25057 hybrid_clock.cc:648] HybridClock initialized: now 1786326964892561 us; error 65 us; skew 500 ppm
I20260810 01:56:04.893491 25057 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 01:56:04.898345 25057 webserver.cc:533] Webserver started at http://127.21.64.254:33693/ using document root <none> and password file <none>
I20260810 01:56:04.900113 25057 fs_manager.cc:362] Metadata directory not provided
I20260810 01:56:04.900478 25057 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:56:04.901324 25057 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:56:04.907341 25057 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "385efa1954b449fb8bf28564be3dc8af"
format_stamp: "Formatted at 2026-08-10 01:56:04 on dist-test-slave-bw88"
I20260810 01:56:04.908952 25057 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "385efa1954b449fb8bf28564be3dc8af"
format_stamp: "Formatted at 2026-08-10 01:56:04 on dist-test-slave-bw88"
I20260810 01:56:04.919829 25057 fs_manager.cc:696] Time spent creating directory manager: real 0.010s user 0.002s sys 0.005s
I20260810 01:56:04.926510 25077 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:56:04.929433 25057 fs_manager.cc:730] Time spent opening block manager: real 0.006s user 0.006s sys 0.000s
I20260810 01:56:04.929822 25057 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/wal
uuid: "385efa1954b449fb8bf28564be3dc8af"
format_stamp: "Formatted at 2026-08-10 01:56:04 on dist-test-slave-bw88"
I20260810 01:56:04.930189 25057 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:56:04.959532 25057 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 01:56:04.961119 25057 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:56:04.961704 25057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:56:05.006040 25057 rpc_server.cc:307] RPC server started. Bound to: 127.21.64.254:38339
I20260810 01:56:05.006115 25140 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.64.254:38339 every 8 connection(s)
I20260810 01:56:05.009473 25057 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260810 01:56:05.010727 21763 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNubV1X/build/asan/bin/kudu as pid 25057
I20260810 01:56:05.011476 21763 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/wal/instance
I20260810 01:56:05.023850 25142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:56:05.042690 25142 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 385efa1954b449fb8bf28564be3dc8af: Bootstrap starting.
I20260810 01:56:05.051347 25142 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 385efa1954b449fb8bf28564be3dc8af: Neither blocks nor log segments found. Creating new log.
I20260810 01:56:05.053545 25142 log.cc:826] T 00000000000000000000000000000000 P 385efa1954b449fb8bf28564be3dc8af: Log is configured to *not* fsync() on all Append() calls
I20260810 01:56:05.059866 25142 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 385efa1954b449fb8bf28564be3dc8af: No bootstrap required, opened a new log
I20260810 01:56:05.072351 25142 raft_consensus.cc:359] T 00000000000000000000000000000000 P 385efa1954b449fb8bf28564be3dc8af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "385efa1954b449fb8bf28564be3dc8af" member_type: VOTER last_known_addr { host: "127.21.64.254" port: 38339 } }
I20260810 01:56:05.073172 25142 raft_consensus.cc:385] T 00000000000000000000000000000000 P 385efa1954b449fb8bf28564be3dc8af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:56:05.073470 25142 raft_consensus.cc:740] T 00000000000000000000000000000000 P 385efa1954b449fb8bf28564be3dc8af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 385efa1954b449fb8bf28564be3dc8af, State: Initialized, Role: FOLLOWER
I20260810 01:56:05.075474 25142 consensus_queue.cc:260] T 00000000000000000000000000000000 P 385efa1954b449fb8bf28564be3dc8af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "385efa1954b449fb8bf28564be3dc8af" member_type: VOTER last_known_addr { host: "127.21.64.254" port: 38339 } }
I20260810 01:56:05.076009 25142 raft_consensus.cc:399] T 00000000000000000000000000000000 P 385efa1954b449fb8bf28564be3dc8af [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:56:05.076376 25142 raft_consensus.cc:493] T 00000000000000000000000000000000 P 385efa1954b449fb8bf28564be3dc8af [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:56:05.076704 25142 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 385efa1954b449fb8bf28564be3dc8af [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:56:05.081928 25142 raft_consensus.cc:515] T 00000000000000000000000000000000 P 385efa1954b449fb8bf28564be3dc8af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "385efa1954b449fb8bf28564be3dc8af" member_type: VOTER last_known_addr { host: "127.21.64.254" port: 38339 } }
I20260810 01:56:05.082864 25142 leader_election.cc:304] T 00000000000000000000000000000000 P 385efa1954b449fb8bf28564be3dc8af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 385efa1954b449fb8bf28564be3dc8af; no voters:
I20260810 01:56:05.084131 25142 leader_election.cc:290] T 00000000000000000000000000000000 P 385efa1954b449fb8bf28564be3dc8af [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:56:05.084471 25154 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 385efa1954b449fb8bf28564be3dc8af [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:56:05.089222 25154 raft_consensus.cc:697] T 00000000000000000000000000000000 P 385efa1954b449fb8bf28564be3dc8af [term 1 LEADER]: Becoming Leader. State: Replica: 385efa1954b449fb8bf28564be3dc8af, State: Running, Role: LEADER
I20260810 01:56:05.089632 25142 sys_catalog.cc:565] T 00000000000000000000000000000000 P 385efa1954b449fb8bf28564be3dc8af [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:56:05.090880 25154 consensus_queue.cc:237] T 00000000000000000000000000000000 P 385efa1954b449fb8bf28564be3dc8af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "385efa1954b449fb8bf28564be3dc8af" member_type: VOTER last_known_addr { host: "127.21.64.254" port: 38339 } }
I20260810 01:56:05.098029 25156 sys_catalog.cc:455] T 00000000000000000000000000000000 P 385efa1954b449fb8bf28564be3dc8af [sys.catalog]: SysCatalogTable state changed. Reason: New leader 385efa1954b449fb8bf28564be3dc8af. Latest consensus state: current_term: 1 leader_uuid: "385efa1954b449fb8bf28564be3dc8af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "385efa1954b449fb8bf28564be3dc8af" member_type: VOTER last_known_addr { host: "127.21.64.254" port: 38339 } } }
I20260810 01:56:05.099226 25156 sys_catalog.cc:458] T 00000000000000000000000000000000 P 385efa1954b449fb8bf28564be3dc8af [sys.catalog]: This master's current role is: LEADER
I20260810 01:56:05.098392 25155 sys_catalog.cc:455] T 00000000000000000000000000000000 P 385efa1954b449fb8bf28564be3dc8af [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "385efa1954b449fb8bf28564be3dc8af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "385efa1954b449fb8bf28564be3dc8af" member_type: VOTER last_known_addr { host: "127.21.64.254" port: 38339 } } }
I20260810 01:56:05.104355 25155 sys_catalog.cc:458] T 00000000000000000000000000000000 P 385efa1954b449fb8bf28564be3dc8af [sys.catalog]: This master's current role is: LEADER
I20260810 01:56:05.105245 25163 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260810 01:56:05.119850 25163 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260810 01:56:05.141840 25163 catalog_manager.cc:1383] Generated new cluster ID: 907bb9a26dda4fdda51efbed611fc5ed
I20260810 01:56:05.142068 25163 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260810 01:56:05.159672 25163 catalog_manager.cc:1406] Generated new certificate authority record
I20260810 01:56:05.161782 25163 catalog_manager.cc:1540] Loading token signing keys...
I20260810 01:56:05.184039 25163 catalog_manager.cc:6092] T 00000000000000000000000000000000 P 385efa1954b449fb8bf28564be3dc8af: Generated new TSK 0
I20260810 01:56:05.186133 25163 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260810 01:56:05.212133 21763 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNubV1X/build/asan/bin/kudu
/tmp/dist-test-taskNubV1X/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.64.193:0
--local_ip_for_outbound_sockets=127.21.64.193
--webserver_interface=127.21.64.193
--webserver_port=0
--tserver_master_addrs=127.21.64.254:38339
--builtin_ntp_servers=127.21.64.212:35453
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
W20260810 01:56:06.542721 25179 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:56:06.543368 25179 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:56:06.543599 25179 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 01:56:06.560716 25179 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260810 01:56:06.561028 25179 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:56:06.561502 25179 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.64.193
I20260810 01:56:06.593844 25179 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.64.212:35453
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.64.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.21.64.193
--webserver_port=0
--tserver_master_addrs=127.21.64.254:38339
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.64.193
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 01:44:04 UTC on e7f111948823
build id 13266
ASAN enabled
I20260810 01:56:06.598641 25179 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:56:06.603986 25179 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 01:56:06.628621 25188 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:56:06.629626 25191 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:56:06.631997 25194 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:56:06.633625 25179 server_base.cc:1061] running on GCE node
I20260810 01:56:06.634652 25179 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:56:06.636509 25179 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:56:06.640033 25179 hybrid_clock.cc:648] HybridClock initialized: now 1786326966639854 us; error 120 us; skew 500 ppm
I20260810 01:56:06.640655 25179 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 01:56:06.644743 25179 webserver.cc:533] Webserver started at http://127.21.64.193:43159/ using document root <none> and password file <none>
I20260810 01:56:06.646202 25179 fs_manager.cc:362] Metadata directory not provided
I20260810 01:56:06.646463 25179 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:56:06.647192 25179 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:56:06.651692 25179 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "de734c8d3b824cc88e6c68542d58afd7"
format_stamp: "Formatted at 2026-08-10 01:56:06 on dist-test-slave-bw88"
I20260810 01:56:06.653198 25179 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "de734c8d3b824cc88e6c68542d58afd7"
format_stamp: "Formatted at 2026-08-10 01:56:06 on dist-test-slave-bw88"
I20260810 01:56:06.663975 25179 fs_manager.cc:696] Time spent creating directory manager: real 0.010s user 0.007s sys 0.000s
I20260810 01:56:06.670408 25201 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:56:06.673058 25179 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.003s sys 0.002s
I20260810 01:56:06.673413 25179 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "de734c8d3b824cc88e6c68542d58afd7"
format_stamp: "Formatted at 2026-08-10 01:56:06 on dist-test-slave-bw88"
I20260810 01:56:06.673786 25179 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:56:06.695346 25179 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 01:56:06.696966 25179 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:56:06.697487 25179 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:56:06.699262 25179 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260810 01:56:06.702339 25179 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:56:06.702476 25179 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:56:06.702749 25179 ts_tablet_manager.cc:616] Registered 0 tablets
I20260810 01:56:06.702831 25179 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:56:06.767795 25179 rpc_server.cc:307] RPC server started. Bound to: 127.21.64.193:46841
I20260810 01:56:06.767838 25358 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.64.193:46841 every 8 connection(s)
I20260810 01:56:06.770133 25179 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20260810 01:56:06.774449 21763 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNubV1X/build/asan/bin/kudu as pid 25179
I20260810 01:56:06.774847 21763 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20260810 01:56:06.781759 21763 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNubV1X/build/asan/bin/kudu
/tmp/dist-test-taskNubV1X/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.64.194:0
--local_ip_for_outbound_sockets=127.21.64.194
--webserver_interface=127.21.64.194
--webserver_port=0
--tserver_master_addrs=127.21.64.254:38339
--builtin_ntp_servers=127.21.64.212:35453
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
I20260810 01:56:06.799057 25359 heartbeater.cc:344] Connected to a master server at 127.21.64.254:38339
I20260810 01:56:06.799662 25359 heartbeater.cc:461] Registering TS with master...
I20260810 01:56:06.800985 25359 heartbeater.cc:507] Master 127.21.64.254:38339 requested a full tablet report, sending...
I20260810 01:56:06.804873 25098 ts_manager.cc:194] Registered new tserver with Master: de734c8d3b824cc88e6c68542d58afd7 (127.21.64.193:46841)
I20260810 01:56:06.807564 25098 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.21.64.193:58245
W20260810 01:56:07.208171 25363 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:56:07.208477 25363 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:56:07.208549 25363 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 01:56:07.216992 25363 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260810 01:56:07.217092 25363 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:56:07.217226 25363 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.64.194
I20260810 01:56:07.227339 25363 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.64.212:35453
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.64.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.21.64.194
--webserver_port=0
--tserver_master_addrs=127.21.64.254:38339
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.64.194
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 01:44:04 UTC on e7f111948823
build id 13266
ASAN enabled
I20260810 01:56:07.229125 25363 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:56:07.230952 25363 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 01:56:07.240775 25370 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:56:07.240854 25369 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:56:07.241606 25373 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:56:07.242662 25363 server_base.cc:1061] running on GCE node
I20260810 01:56:07.243306 25363 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:56:07.244139 25363 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:56:07.245481 25363 hybrid_clock.cc:648] HybridClock initialized: now 1786326967245372 us; error 44 us; skew 500 ppm
I20260810 01:56:07.245803 25363 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 01:56:07.247934 25363 webserver.cc:533] Webserver started at http://127.21.64.194:41471/ using document root <none> and password file <none>
I20260810 01:56:07.248682 25363 fs_manager.cc:362] Metadata directory not provided
I20260810 01:56:07.248837 25363 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:56:07.249188 25363 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:56:07.251749 25363 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "eef95f3260d34328a3c756a148d05308"
format_stamp: "Formatted at 2026-08-10 01:56:07 on dist-test-slave-bw88"
I20260810 01:56:07.252548 25363 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "eef95f3260d34328a3c756a148d05308"
format_stamp: "Formatted at 2026-08-10 01:56:07 on dist-test-slave-bw88"
I20260810 01:56:07.258513 25363 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260810 01:56:07.261912 25382 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:56:07.263250 25363 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260810 01:56:07.263473 25363 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "eef95f3260d34328a3c756a148d05308"
format_stamp: "Formatted at 2026-08-10 01:56:07 on dist-test-slave-bw88"
I20260810 01:56:07.263674 25363 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:56:07.297503 25363 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 01:56:07.298418 25363 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:56:07.298736 25363 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:56:07.299682 25363 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260810 01:56:07.301476 25363 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:56:07.301578 25363 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:56:07.301725 25363 ts_tablet_manager.cc:616] Registered 0 tablets
I20260810 01:56:07.301796 25363 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:56:07.337575 25363 rpc_server.cc:307] RPC server started. Bound to: 127.21.64.194:45581
I20260810 01:56:07.337679 25535 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.64.194:45581 every 8 connection(s)
I20260810 01:56:07.339143 25363 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20260810 01:56:07.344926 21763 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNubV1X/build/asan/bin/kudu as pid 25363
I20260810 01:56:07.345189 21763 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20260810 01:56:07.348534 21763 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNubV1X/build/asan/bin/kudu
/tmp/dist-test-taskNubV1X/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.64.195:0
--local_ip_for_outbound_sockets=127.21.64.195
--webserver_interface=127.21.64.195
--webserver_port=0
--tserver_master_addrs=127.21.64.254:38339
--builtin_ntp_servers=127.21.64.212:35453
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
I20260810 01:56:07.353461 25537 heartbeater.cc:344] Connected to a master server at 127.21.64.254:38339
I20260810 01:56:07.353838 25537 heartbeater.cc:461] Registering TS with master...
I20260810 01:56:07.354631 25537 heartbeater.cc:507] Master 127.21.64.254:38339 requested a full tablet report, sending...
I20260810 01:56:07.356279 25098 ts_manager.cc:194] Registered new tserver with Master: eef95f3260d34328a3c756a148d05308 (127.21.64.194:45581)
I20260810 01:56:07.357525 25098 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.21.64.194:50235
W20260810 01:56:07.721665 25545 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:56:07.722003 25545 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:56:07.722129 25545 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 01:56:07.730697 25545 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260810 01:56:07.730808 25545 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:56:07.731009 25545 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.64.195
I20260810 01:56:07.741243 25545 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.64.212:35453
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.64.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.21.64.195
--webserver_port=0
--tserver_master_addrs=127.21.64.254:38339
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.64.195
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 01:44:04 UTC on e7f111948823
build id 13266
ASAN enabled
I20260810 01:56:07.743078 25545 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:56:07.744956 25545 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 01:56:07.755146 25552 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:56:07.755285 25551 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:56:07.755858 25554 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:56:07.756348 25545 server_base.cc:1061] running on GCE node
I20260810 01:56:07.756893 25545 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:56:07.757887 25545 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:56:07.759114 25545 hybrid_clock.cc:648] HybridClock initialized: now 1786326967759049 us; error 32 us; skew 500 ppm
I20260810 01:56:07.759431 25545 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 01:56:07.761925 25545 webserver.cc:533] Webserver started at http://127.21.64.195:34343/ using document root <none> and password file <none>
I20260810 01:56:07.762893 25545 fs_manager.cc:362] Metadata directory not provided
I20260810 01:56:07.763010 25545 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:56:07.763512 25545 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:56:07.766024 25545 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "2ce556f373d742d9bfc164bee15cf16d"
format_stamp: "Formatted at 2026-08-10 01:56:07 on dist-test-slave-bw88"
I20260810 01:56:07.766867 25545 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "2ce556f373d742d9bfc164bee15cf16d"
format_stamp: "Formatted at 2026-08-10 01:56:07 on dist-test-slave-bw88"
I20260810 01:56:07.772644 25545 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260810 01:56:07.776204 25563 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:56:07.777582 25545 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260810 01:56:07.777769 25545 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "2ce556f373d742d9bfc164bee15cf16d"
format_stamp: "Formatted at 2026-08-10 01:56:07 on dist-test-slave-bw88"
I20260810 01:56:07.777947 25545 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:56:07.799006 25545 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 01:56:07.799844 25545 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:56:07.800145 25545 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:56:07.801117 25545 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260810 01:56:07.802837 25545 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:56:07.802911 25545 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:56:07.803066 25545 ts_tablet_manager.cc:616] Registered 0 tablets
I20260810 01:56:07.803120 25545 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:56:07.814069 25359 heartbeater.cc:499] Master 127.21.64.254:38339 was elected leader, sending a full tablet report...
I20260810 01:56:07.839567 25545 rpc_server.cc:307] RPC server started. Bound to: 127.21.64.195:42883
I20260810 01:56:07.839598 25723 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.64.195:42883 every 8 connection(s)
I20260810 01:56:07.841106 25545 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20260810 01:56:07.841802 21763 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNubV1X/build/asan/bin/kudu as pid 25545
I20260810 01:56:07.841996 21763 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20260810 01:56:07.845922 21763 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNubV1X/build/asan/bin/kudu
/tmp/dist-test-taskNubV1X/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.64.196:0
--local_ip_for_outbound_sockets=127.21.64.196
--webserver_interface=127.21.64.196
--webserver_port=0
--tserver_master_addrs=127.21.64.254:38339
--builtin_ntp_servers=127.21.64.212:35453
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
I20260810 01:56:07.856477 25724 heartbeater.cc:344] Connected to a master server at 127.21.64.254:38339
I20260810 01:56:07.856868 25724 heartbeater.cc:461] Registering TS with master...
I20260810 01:56:07.857839 25724 heartbeater.cc:507] Master 127.21.64.254:38339 requested a full tablet report, sending...
I20260810 01:56:07.859462 25098 ts_manager.cc:194] Registered new tserver with Master: 2ce556f373d742d9bfc164bee15cf16d (127.21.64.195:42883)
I20260810 01:56:07.860316 25098 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.21.64.195:38117
W20260810 01:56:08.217753 25727 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:56:08.218132 25727 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:56:08.218276 25727 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 01:56:08.226732 25727 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260810 01:56:08.226867 25727 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:56:08.227078 25727 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.64.196
I20260810 01:56:08.238127 25727 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.64.212:35453
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.64.196:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--webserver_interface=127.21.64.196
--webserver_port=0
--tserver_master_addrs=127.21.64.254:38339
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.64.196
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 01:44:04 UTC on e7f111948823
build id 13266
ASAN enabled
I20260810 01:56:08.239912 25727 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:56:08.242053 25727 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 01:56:08.252092 25733 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:56:08.252995 25734 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:56:08.253444 25736 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:56:08.253698 25727 server_base.cc:1061] running on GCE node
I20260810 01:56:08.254361 25727 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:56:08.255322 25727 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:56:08.256587 25727 hybrid_clock.cc:648] HybridClock initialized: now 1786326968256517 us; error 46 us; skew 500 ppm
I20260810 01:56:08.256913 25727 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 01:56:08.259613 25727 webserver.cc:533] Webserver started at http://127.21.64.196:37865/ using document root <none> and password file <none>
I20260810 01:56:08.260428 25727 fs_manager.cc:362] Metadata directory not provided
I20260810 01:56:08.260607 25727 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:56:08.260978 25727 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:56:08.263742 25727 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/data/instance:
uuid: "dded0036c1a34ea1b20a30a6f773bd68"
format_stamp: "Formatted at 2026-08-10 01:56:08 on dist-test-slave-bw88"
I20260810 01:56:08.264580 25727 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal/instance:
uuid: "dded0036c1a34ea1b20a30a6f773bd68"
format_stamp: "Formatted at 2026-08-10 01:56:08 on dist-test-slave-bw88"
I20260810 01:56:08.270486 25727 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.000s sys 0.007s
I20260810 01:56:08.274325 25744 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:56:08.275784 25727 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260810 01:56:08.276010 25727 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/data,/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal
uuid: "dded0036c1a34ea1b20a30a6f773bd68"
format_stamp: "Formatted at 2026-08-10 01:56:08 on dist-test-slave-bw88"
I20260810 01:56:08.276247 25727 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal
metadata directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal
1 data directories: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:56:08.293221 25727 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 01:56:08.294127 25727 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:56:08.294438 25727 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:56:08.295413 25727 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260810 01:56:08.297086 25727 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:56:08.297189 25727 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:56:08.297382 25727 ts_tablet_manager.cc:616] Registered 0 tablets
I20260810 01:56:08.297482 25727 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260810 01:56:08.333801 25727 rpc_server.cc:307] RPC server started. Bound to: 127.21.64.196:37337
I20260810 01:56:08.333847 25904 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.64.196:37337 every 8 connection(s)
I20260810 01:56:08.335461 25727 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/data/info.pb
I20260810 01:56:08.339843 21763 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNubV1X/build/asan/bin/kudu as pid 25727
I20260810 01:56:08.340063 21763 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal/instance
I20260810 01:56:08.343748 21763 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNubV1X/build/asan/bin/kudu
/tmp/dist-test-taskNubV1X/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/wal
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/logs
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.64.197:0
--local_ip_for_outbound_sockets=127.21.64.197
--webserver_interface=127.21.64.197
--webserver_port=0
--tserver_master_addrs=127.21.64.254:38339
--builtin_ntp_servers=127.21.64.212:35453
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
I20260810 01:56:08.351418 25905 heartbeater.cc:344] Connected to a master server at 127.21.64.254:38339
I20260810 01:56:08.351843 25905 heartbeater.cc:461] Registering TS with master...
I20260810 01:56:08.352816 25905 heartbeater.cc:507] Master 127.21.64.254:38339 requested a full tablet report, sending...
I20260810 01:56:08.354648 25098 ts_manager.cc:194] Registered new tserver with Master: dded0036c1a34ea1b20a30a6f773bd68 (127.21.64.196:37337)
I20260810 01:56:08.355520 25098 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.21.64.196:39721
I20260810 01:56:08.360234 25537 heartbeater.cc:499] Master 127.21.64.254:38339 was elected leader, sending a full tablet report...
W20260810 01:56:08.710402 25909 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:56:08.710722 25909 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:56:08.710811 25909 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 01:56:08.719134 25909 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260810 01:56:08.719244 25909 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:56:08.719384 25909 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.64.197
I20260810 01:56:08.729399 25909 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.64.212:35453
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.64.197:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--webserver_interface=127.21.64.197
--webserver_port=0
--tserver_master_addrs=127.21.64.254:38339
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.64.197
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 01:44:04 UTC on e7f111948823
build id 13266
ASAN enabled
I20260810 01:56:08.731091 25909 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:56:08.732939 25909 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 01:56:08.743122 25918 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:56:08.743093 25919 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:56:08.743644 25921 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:56:08.744678 25909 server_base.cc:1061] running on GCE node
I20260810 01:56:08.745304 25909 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:56:08.746321 25909 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:56:08.747572 25909 hybrid_clock.cc:648] HybridClock initialized: now 1786326968747508 us; error 42 us; skew 500 ppm
I20260810 01:56:08.747880 25909 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 01:56:08.750114 25909 webserver.cc:533] Webserver started at http://127.21.64.197:46305/ using document root <none> and password file <none>
I20260810 01:56:08.750872 25909 fs_manager.cc:362] Metadata directory not provided
I20260810 01:56:08.751034 25909 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:56:08.751398 25909 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:56:08.753912 25909 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data/instance:
uuid: "dcab2e9e53f44b54a01d0e834e5583fa"
format_stamp: "Formatted at 2026-08-10 01:56:08 on dist-test-slave-bw88"
I20260810 01:56:08.754730 25909 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/wal/instance:
uuid: "dcab2e9e53f44b54a01d0e834e5583fa"
format_stamp: "Formatted at 2026-08-10 01:56:08 on dist-test-slave-bw88"
I20260810 01:56:08.760290 25909 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260810 01:56:08.763775 25928 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:56:08.765162 25909 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260810 01:56:08.765404 25909 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data,/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/wal
uuid: "dcab2e9e53f44b54a01d0e834e5583fa"
format_stamp: "Formatted at 2026-08-10 01:56:08 on dist-test-slave-bw88"
I20260810 01:56:08.765604 25909 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/wal
metadata directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/wal
1 data directories: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:56:08.787379 25909 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 01:56:08.788249 25909 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:56:08.788558 25909 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:56:08.789573 25909 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260810 01:56:08.791292 25909 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:56:08.791399 25909 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:56:08.791546 25909 ts_tablet_manager.cc:616] Registered 0 tablets
I20260810 01:56:08.791625 25909 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:56:08.828617 25909 rpc_server.cc:307] RPC server started. Bound to: 127.21.64.197:33895
I20260810 01:56:08.828709 26080 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.64.197:33895 every 8 connection(s)
I20260810 01:56:08.830144 25909 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data/info.pb
I20260810 01:56:08.838424 21763 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNubV1X/build/asan/bin/kudu as pid 25909
I20260810 01:56:08.838615 21763 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/wal/instance
I20260810 01:56:08.844617 26081 heartbeater.cc:344] Connected to a master server at 127.21.64.254:38339
I20260810 01:56:08.845008 26081 heartbeater.cc:461] Registering TS with master...
I20260810 01:56:08.845810 26081 heartbeater.cc:507] Master 127.21.64.254:38339 requested a full tablet report, sending...
I20260810 01:56:08.847260 25098 ts_manager.cc:194] Registered new tserver with Master: dcab2e9e53f44b54a01d0e834e5583fa (127.21.64.197:33895)
I20260810 01:56:08.848086 25098 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.21.64.197:52665
I20260810 01:56:08.855844 21763 external_mini_cluster.cc:955] 5 TS(s) registered with all masters
I20260810 01:56:08.862969 25724 heartbeater.cc:499] Master 127.21.64.254:38339 was elected leader, sending a full tablet report...
I20260810 01:56:08.873328 25098 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34354:
name: "TestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
owner: "alice"
I20260810 01:56:08.917678 25452 tablet_service.cc:1511] Processing CreateTablet for tablet 32147a40a4314129b99cfadf7edf2a7d (DEFAULT_TABLE table=TestTable [id=286fc9c8bca14be0adf93a0bfb25a41d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:56:08.918356 25992 tablet_service.cc:1511] Processing CreateTablet for tablet 32147a40a4314129b99cfadf7edf2a7d (DEFAULT_TABLE table=TestTable [id=286fc9c8bca14be0adf93a0bfb25a41d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:56:08.918356 25625 tablet_service.cc:1511] Processing CreateTablet for tablet 32147a40a4314129b99cfadf7edf2a7d (DEFAULT_TABLE table=TestTable [id=286fc9c8bca14be0adf93a0bfb25a41d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:56:08.919124 25452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32147a40a4314129b99cfadf7edf2a7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:56:08.919878 25625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32147a40a4314129b99cfadf7edf2a7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:56:08.919874 25992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32147a40a4314129b99cfadf7edf2a7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:56:08.929913 26112 tablet_bootstrap.cc:492] T 32147a40a4314129b99cfadf7edf2a7d P eef95f3260d34328a3c756a148d05308: Bootstrap starting.
I20260810 01:56:08.933459 26113 tablet_bootstrap.cc:492] T 32147a40a4314129b99cfadf7edf2a7d P 2ce556f373d742d9bfc164bee15cf16d: Bootstrap starting.
I20260810 01:56:08.933609 26112 tablet_bootstrap.cc:654] T 32147a40a4314129b99cfadf7edf2a7d P eef95f3260d34328a3c756a148d05308: Neither blocks nor log segments found. Creating new log.
I20260810 01:56:08.934381 26114 tablet_bootstrap.cc:492] T 32147a40a4314129b99cfadf7edf2a7d P dcab2e9e53f44b54a01d0e834e5583fa: Bootstrap starting.
I20260810 01:56:08.935935 26112 log.cc:826] T 32147a40a4314129b99cfadf7edf2a7d P eef95f3260d34328a3c756a148d05308: Log is configured to *not* fsync() on all Append() calls
I20260810 01:56:08.938428 26114 tablet_bootstrap.cc:654] T 32147a40a4314129b99cfadf7edf2a7d P dcab2e9e53f44b54a01d0e834e5583fa: Neither blocks nor log segments found. Creating new log.
I20260810 01:56:08.938930 26112 tablet_bootstrap.cc:492] T 32147a40a4314129b99cfadf7edf2a7d P eef95f3260d34328a3c756a148d05308: No bootstrap required, opened a new log
I20260810 01:56:08.939347 26112 ts_tablet_manager.cc:1403] T 32147a40a4314129b99cfadf7edf2a7d P eef95f3260d34328a3c756a148d05308: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.003s
I20260810 01:56:08.939805 26114 log.cc:826] T 32147a40a4314129b99cfadf7edf2a7d P dcab2e9e53f44b54a01d0e834e5583fa: Log is configured to *not* fsync() on all Append() calls
I20260810 01:56:08.940623 26113 tablet_bootstrap.cc:654] T 32147a40a4314129b99cfadf7edf2a7d P 2ce556f373d742d9bfc164bee15cf16d: Neither blocks nor log segments found. Creating new log.
I20260810 01:56:08.942102 26113 log.cc:826] T 32147a40a4314129b99cfadf7edf2a7d P 2ce556f373d742d9bfc164bee15cf16d: Log is configured to *not* fsync() on all Append() calls
I20260810 01:56:08.944341 26114 tablet_bootstrap.cc:492] T 32147a40a4314129b99cfadf7edf2a7d P dcab2e9e53f44b54a01d0e834e5583fa: No bootstrap required, opened a new log
I20260810 01:56:08.944675 26114 ts_tablet_manager.cc:1403] T 32147a40a4314129b99cfadf7edf2a7d P dcab2e9e53f44b54a01d0e834e5583fa: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.005s
I20260810 01:56:08.945854 26113 tablet_bootstrap.cc:492] T 32147a40a4314129b99cfadf7edf2a7d P 2ce556f373d742d9bfc164bee15cf16d: No bootstrap required, opened a new log
I20260810 01:56:08.946179 26113 ts_tablet_manager.cc:1403] T 32147a40a4314129b99cfadf7edf2a7d P 2ce556f373d742d9bfc164bee15cf16d: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.002s
I20260810 01:56:08.947214 26112 raft_consensus.cc:359] T 32147a40a4314129b99cfadf7edf2a7d P eef95f3260d34328a3c756a148d05308 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef95f3260d34328a3c756a148d05308" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 45581 } } peers { permanent_uuid: "dcab2e9e53f44b54a01d0e834e5583fa" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 33895 } } peers { permanent_uuid: "2ce556f373d742d9bfc164bee15cf16d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 42883 } }
I20260810 01:56:08.947571 26112 raft_consensus.cc:385] T 32147a40a4314129b99cfadf7edf2a7d P eef95f3260d34328a3c756a148d05308 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:56:08.947683 26112 raft_consensus.cc:740] T 32147a40a4314129b99cfadf7edf2a7d P eef95f3260d34328a3c756a148d05308 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eef95f3260d34328a3c756a148d05308, State: Initialized, Role: FOLLOWER
I20260810 01:56:08.948395 26112 consensus_queue.cc:260] T 32147a40a4314129b99cfadf7edf2a7d P eef95f3260d34328a3c756a148d05308 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef95f3260d34328a3c756a148d05308" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 45581 } } peers { permanent_uuid: "dcab2e9e53f44b54a01d0e834e5583fa" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 33895 } } peers { permanent_uuid: "2ce556f373d742d9bfc164bee15cf16d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 42883 } }
I20260810 01:56:08.950043 26112 ts_tablet_manager.cc:1434] T 32147a40a4314129b99cfadf7edf2a7d P eef95f3260d34328a3c756a148d05308: Time spent starting tablet: real 0.011s user 0.010s sys 0.000s
I20260810 01:56:08.953622 26113 raft_consensus.cc:359] T 32147a40a4314129b99cfadf7edf2a7d P 2ce556f373d742d9bfc164bee15cf16d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef95f3260d34328a3c756a148d05308" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 45581 } } peers { permanent_uuid: "dcab2e9e53f44b54a01d0e834e5583fa" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 33895 } } peers { permanent_uuid: "2ce556f373d742d9bfc164bee15cf16d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 42883 } }
I20260810 01:56:08.954037 26113 raft_consensus.cc:385] T 32147a40a4314129b99cfadf7edf2a7d P 2ce556f373d742d9bfc164bee15cf16d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:56:08.954203 26113 raft_consensus.cc:740] T 32147a40a4314129b99cfadf7edf2a7d P 2ce556f373d742d9bfc164bee15cf16d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ce556f373d742d9bfc164bee15cf16d, State: Initialized, Role: FOLLOWER
I20260810 01:56:08.954566 26114 raft_consensus.cc:359] T 32147a40a4314129b99cfadf7edf2a7d P dcab2e9e53f44b54a01d0e834e5583fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef95f3260d34328a3c756a148d05308" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 45581 } } peers { permanent_uuid: "dcab2e9e53f44b54a01d0e834e5583fa" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 33895 } } peers { permanent_uuid: "2ce556f373d742d9bfc164bee15cf16d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 42883 } }
I20260810 01:56:08.955056 26114 raft_consensus.cc:385] T 32147a40a4314129b99cfadf7edf2a7d P dcab2e9e53f44b54a01d0e834e5583fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:56:08.955219 26114 raft_consensus.cc:740] T 32147a40a4314129b99cfadf7edf2a7d P dcab2e9e53f44b54a01d0e834e5583fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcab2e9e53f44b54a01d0e834e5583fa, State: Initialized, Role: FOLLOWER
I20260810 01:56:08.955209 26113 consensus_queue.cc:260] T 32147a40a4314129b99cfadf7edf2a7d P 2ce556f373d742d9bfc164bee15cf16d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef95f3260d34328a3c756a148d05308" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 45581 } } peers { permanent_uuid: "dcab2e9e53f44b54a01d0e834e5583fa" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 33895 } } peers { permanent_uuid: "2ce556f373d742d9bfc164bee15cf16d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 42883 } }
I20260810 01:56:08.956372 26114 consensus_queue.cc:260] T 32147a40a4314129b99cfadf7edf2a7d P dcab2e9e53f44b54a01d0e834e5583fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef95f3260d34328a3c756a148d05308" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 45581 } } peers { permanent_uuid: "dcab2e9e53f44b54a01d0e834e5583fa" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 33895 } } peers { permanent_uuid: "2ce556f373d742d9bfc164bee15cf16d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 42883 } }
I20260810 01:56:08.957211 26113 ts_tablet_manager.cc:1434] T 32147a40a4314129b99cfadf7edf2a7d P 2ce556f373d742d9bfc164bee15cf16d: Time spent starting tablet: real 0.011s user 0.009s sys 0.001s
I20260810 01:56:08.957731 26081 heartbeater.cc:499] Master 127.21.64.254:38339 was elected leader, sending a full tablet report...
I20260810 01:56:08.958355 26114 ts_tablet_manager.cc:1434] T 32147a40a4314129b99cfadf7edf2a7d P dcab2e9e53f44b54a01d0e834e5583fa: Time spent starting tablet: real 0.014s user 0.007s sys 0.003s
I20260810 01:56:09.067345 26120 raft_consensus.cc:493] T 32147a40a4314129b99cfadf7edf2a7d P 2ce556f373d742d9bfc164bee15cf16d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:56:09.067652 26120 raft_consensus.cc:515] T 32147a40a4314129b99cfadf7edf2a7d P 2ce556f373d742d9bfc164bee15cf16d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef95f3260d34328a3c756a148d05308" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 45581 } } peers { permanent_uuid: "dcab2e9e53f44b54a01d0e834e5583fa" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 33895 } } peers { permanent_uuid: "2ce556f373d742d9bfc164bee15cf16d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 42883 } }
I20260810 01:56:09.069634 26120 leader_election.cc:290] T 32147a40a4314129b99cfadf7edf2a7d P 2ce556f373d742d9bfc164bee15cf16d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eef95f3260d34328a3c756a148d05308 (127.21.64.194:45581), dcab2e9e53f44b54a01d0e834e5583fa (127.21.64.197:33895)
I20260810 01:56:09.078970 26118 raft_consensus.cc:493] T 32147a40a4314129b99cfadf7edf2a7d P eef95f3260d34328a3c756a148d05308 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:56:09.078830 26021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32147a40a4314129b99cfadf7edf2a7d" candidate_uuid: "2ce556f373d742d9bfc164bee15cf16d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcab2e9e53f44b54a01d0e834e5583fa" is_pre_election: true
I20260810 01:56:09.078845 25479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32147a40a4314129b99cfadf7edf2a7d" candidate_uuid: "2ce556f373d742d9bfc164bee15cf16d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eef95f3260d34328a3c756a148d05308" is_pre_election: true
I20260810 01:56:09.079406 26021 raft_consensus.cc:2468] T 32147a40a4314129b99cfadf7edf2a7d P dcab2e9e53f44b54a01d0e834e5583fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ce556f373d742d9bfc164bee15cf16d in term 0.
I20260810 01:56:09.079258 26118 raft_consensus.cc:515] T 32147a40a4314129b99cfadf7edf2a7d P eef95f3260d34328a3c756a148d05308 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef95f3260d34328a3c756a148d05308" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 45581 } } peers { permanent_uuid: "dcab2e9e53f44b54a01d0e834e5583fa" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 33895 } } peers { permanent_uuid: "2ce556f373d742d9bfc164bee15cf16d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 42883 } }
I20260810 01:56:09.080016 25479 raft_consensus.cc:2468] T 32147a40a4314129b99cfadf7edf2a7d P eef95f3260d34328a3c756a148d05308 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ce556f373d742d9bfc164bee15cf16d in term 0.
I20260810 01:56:09.080127 25564 leader_election.cc:304] T 32147a40a4314129b99cfadf7edf2a7d P 2ce556f373d742d9bfc164bee15cf16d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ce556f373d742d9bfc164bee15cf16d, dcab2e9e53f44b54a01d0e834e5583fa; no voters:
I20260810 01:56:09.080588 26120 raft_consensus.cc:2804] T 32147a40a4314129b99cfadf7edf2a7d P 2ce556f373d742d9bfc164bee15cf16d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:56:09.080770 26120 raft_consensus.cc:493] T 32147a40a4314129b99cfadf7edf2a7d P 2ce556f373d742d9bfc164bee15cf16d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:56:09.080904 26120 raft_consensus.cc:3060] T 32147a40a4314129b99cfadf7edf2a7d P 2ce556f373d742d9bfc164bee15cf16d [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:56:09.081573 26118 leader_election.cc:290] T 32147a40a4314129b99cfadf7edf2a7d P eef95f3260d34328a3c756a148d05308 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcab2e9e53f44b54a01d0e834e5583fa (127.21.64.197:33895), 2ce556f373d742d9bfc164bee15cf16d (127.21.64.195:42883)
W20260810 01:56:09.082052 26082 tablet.cc:2406] T 32147a40a4314129b99cfadf7edf2a7d P dcab2e9e53f44b54a01d0e834e5583fa: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:56:09.084479 26120 raft_consensus.cc:515] T 32147a40a4314129b99cfadf7edf2a7d P 2ce556f373d742d9bfc164bee15cf16d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef95f3260d34328a3c756a148d05308" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 45581 } } peers { permanent_uuid: "dcab2e9e53f44b54a01d0e834e5583fa" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 33895 } } peers { permanent_uuid: "2ce556f373d742d9bfc164bee15cf16d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 42883 } }
I20260810 01:56:09.085902 26021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32147a40a4314129b99cfadf7edf2a7d" candidate_uuid: "2ce556f373d742d9bfc164bee15cf16d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcab2e9e53f44b54a01d0e834e5583fa"
I20260810 01:56:09.085992 25479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32147a40a4314129b99cfadf7edf2a7d" candidate_uuid: "2ce556f373d742d9bfc164bee15cf16d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eef95f3260d34328a3c756a148d05308"
I20260810 01:56:09.086130 26021 raft_consensus.cc:3060] T 32147a40a4314129b99cfadf7edf2a7d P dcab2e9e53f44b54a01d0e834e5583fa [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:56:09.086256 25479 raft_consensus.cc:3060] T 32147a40a4314129b99cfadf7edf2a7d P eef95f3260d34328a3c756a148d05308 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:56:09.090821 25479 raft_consensus.cc:2468] T 32147a40a4314129b99cfadf7edf2a7d P eef95f3260d34328a3c756a148d05308 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ce556f373d742d9bfc164bee15cf16d in term 1.
I20260810 01:56:09.091331 25567 leader_election.cc:304] T 32147a40a4314129b99cfadf7edf2a7d P 2ce556f373d742d9bfc164bee15cf16d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ce556f373d742d9bfc164bee15cf16d, eef95f3260d34328a3c756a148d05308; no voters:
I20260810 01:56:09.092106 26127 raft_consensus.cc:2804] T 32147a40a4314129b99cfadf7edf2a7d P 2ce556f373d742d9bfc164bee15cf16d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:56:09.092717 26127 raft_consensus.cc:697] T 32147a40a4314129b99cfadf7edf2a7d P 2ce556f373d742d9bfc164bee15cf16d [term 1 LEADER]: Becoming Leader. State: Replica: 2ce556f373d742d9bfc164bee15cf16d, State: Running, Role: LEADER
W20260810 01:56:09.093829 25725 tablet.cc:2406] T 32147a40a4314129b99cfadf7edf2a7d P 2ce556f373d742d9bfc164bee15cf16d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:56:09.093370 26127 consensus_queue.cc:237] T 32147a40a4314129b99cfadf7edf2a7d P 2ce556f373d742d9bfc164bee15cf16d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef95f3260d34328a3c756a148d05308" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 45581 } } peers { permanent_uuid: "dcab2e9e53f44b54a01d0e834e5583fa" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 33895 } } peers { permanent_uuid: "2ce556f373d742d9bfc164bee15cf16d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 42883 } }
W20260810 01:56:09.094483 25540 tablet.cc:2406] T 32147a40a4314129b99cfadf7edf2a7d P eef95f3260d34328a3c756a148d05308: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:56:09.096371 25655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32147a40a4314129b99cfadf7edf2a7d" candidate_uuid: "eef95f3260d34328a3c756a148d05308" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ce556f373d742d9bfc164bee15cf16d" is_pre_election: true
I20260810 01:56:09.096518 26019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32147a40a4314129b99cfadf7edf2a7d" candidate_uuid: "eef95f3260d34328a3c756a148d05308" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcab2e9e53f44b54a01d0e834e5583fa" is_pre_election: true
I20260810 01:56:09.097827 25388 leader_election.cc:304] T 32147a40a4314129b99cfadf7edf2a7d P eef95f3260d34328a3c756a148d05308 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eef95f3260d34328a3c756a148d05308; no voters: 2ce556f373d742d9bfc164bee15cf16d, dcab2e9e53f44b54a01d0e834e5583fa
I20260810 01:56:09.098371 26118 raft_consensus.cc:2749] T 32147a40a4314129b99cfadf7edf2a7d P eef95f3260d34328a3c756a148d05308 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 01:56:09.098814 26021 raft_consensus.cc:2468] T 32147a40a4314129b99cfadf7edf2a7d P dcab2e9e53f44b54a01d0e834e5583fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ce556f373d742d9bfc164bee15cf16d in term 1.
I20260810 01:56:09.099109 26120 leader_election.cc:290] T 32147a40a4314129b99cfadf7edf2a7d P 2ce556f373d742d9bfc164bee15cf16d [CANDIDATE]: Term 1 election: Requested vote from peers eef95f3260d34328a3c756a148d05308 (127.21.64.194:45581), dcab2e9e53f44b54a01d0e834e5583fa (127.21.64.197:33895)
I20260810 01:56:09.102068 25098 catalog_manager.cc:5719] T 32147a40a4314129b99cfadf7edf2a7d P 2ce556f373d742d9bfc164bee15cf16d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ce556f373d742d9bfc164bee15cf16d (127.21.64.195). New cstate: current_term: 1 leader_uuid: "2ce556f373d742d9bfc164bee15cf16d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef95f3260d34328a3c756a148d05308" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 45581 } } peers { permanent_uuid: "dcab2e9e53f44b54a01d0e834e5583fa" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 33895 } } peers { permanent_uuid: "2ce556f373d742d9bfc164bee15cf16d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 42883 } } }
I20260810 01:56:09.150380 21763 external_mini_cluster.cc:955] 5 TS(s) registered with all masters
I20260810 01:56:09.153215 21763 ts_itest-base.cc:246] Waiting for 1 tablets on tserver eef95f3260d34328a3c756a148d05308 to finish bootstrapping
I20260810 01:56:09.162930 21763 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 2ce556f373d742d9bfc164bee15cf16d to finish bootstrapping
I20260810 01:56:09.171622 21763 ts_itest-base.cc:246] Waiting for 1 tablets on tserver dcab2e9e53f44b54a01d0e834e5583fa to finish bootstrapping
I20260810 01:56:09.358261 25905 heartbeater.cc:499] Master 127.21.64.254:38339 was elected leader, sending a full tablet report...
I20260810 01:56:09.491196 26127 consensus_queue.cc:1048] T 32147a40a4314129b99cfadf7edf2a7d P 2ce556f373d742d9bfc164bee15cf16d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcab2e9e53f44b54a01d0e834e5583fa" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 33895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:56:09.501302 26120 consensus_queue.cc:1048] T 32147a40a4314129b99cfadf7edf2a7d P 2ce556f373d742d9bfc164bee15cf16d [LEADER]: Connected to new peer: Peer: permanent_uuid: "eef95f3260d34328a3c756a148d05308" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 45581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:56:09.688865 25625 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:56:09.703188 25992 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:09.705192 25271 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:09.716271 25816 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:09.723577 25452 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:09.893514 25625 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:56:09.900820 25271 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:09.901062 25992 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:09.902765 25816 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:09.925204 25452 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:10.639606 25625 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:56:10.652004 25816 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:10.656255 25452 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:10.661099 25271 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:10.661324 25992 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:10.841372 25992 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:10.847456 25625 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:56:10.866219 25816 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:10.880461 25271 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:10.930270 25452 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:11.083164 25625 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:56:11.090613 25992 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:11.095813 25271 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:11.101678 25816 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:11.104507 25452 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:11.333732 21763 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskNubV1X/build/asan/bin/kudu pid 25179
I20260810 01:56:11.341710 25354 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 01:56:11.439713 21763 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskNubV1X/build/asan/bin/kudu with pid 25179
I20260810 01:56:11.467159 21763 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskNubV1X/build/asan/bin/kudu pid 25363
I20260810 01:56:11.468618 25530 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 01:56:11.581162 21763 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskNubV1X/build/asan/bin/kudu with pid 25363
W20260810 01:56:11.610442 25078 connection.cc:573] server connection from 127.21.64.194:50235 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 01:56:11.610790 21763 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskNubV1X/build/asan/bin/kudu pid 25545
I20260810 01:56:11.612046 25716 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 01:56:11.716885 21763 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskNubV1X/build/asan/bin/kudu with pid 25545
I20260810 01:56:11.744547 21763 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskNubV1X/build/asan/bin/kudu pid 25727
I20260810 01:56:11.751820 25900 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 01:56:11.849797 21763 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskNubV1X/build/asan/bin/kudu with pid 25727
I20260810 01:56:11.875219 21763 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskNubV1X/build/asan/bin/kudu pid 25909
I20260810 01:56:11.876391 26076 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 01:56:11.977329 21763 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskNubV1X/build/asan/bin/kudu with pid 25909
I20260810 01:56:12.002708 21763 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskNubV1X/build/asan/bin/kudu pid 25057
I20260810 01:56:12.004148 25135 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 01:56:12.132376 21763 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskNubV1X/build/asan/bin/kudu with pid 25057
2026-08-10T01:56:12Z chronyd exiting
[ OK ] RebalanceStartCriteriaTest.UnknownIgnoredTServer/0 (8117 ms)
[----------] 1 test from RebalanceStartCriteriaTest (8117 ms total)
[----------] 1 test from RebalanceParamTest
[ RUN ] RebalanceParamTest.Rebalance/2
I20260810 01:56:12.192175 21763 ts_itest-base.cc:115] Starting cluster with:
I20260810 01:56:12.192276 21763 ts_itest-base.cc:116] --------------
I20260810 01:56:12.192338 21763 ts_itest-base.cc:117] 7 tablet servers
I20260810 01:56:12.192404 21763 ts_itest-base.cc:118] 2 replicas per TS
I20260810 01:56:12.192483 21763 ts_itest-base.cc:119] --------------
2026-08-10T01:56:12Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:56:12Z Disabled control of system clock
I20260810 01:56:12.242753 21763 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNubV1X/build/asan/bin/kudu
/tmp/dist-test-taskNubV1X/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.64.254:38173
--webserver_interface=127.21.64.254
--webserver_port=0
--builtin_ntp_servers=127.21.64.212:42671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.64.254:38173
--allow_unsafe_replication_factor
--enable_range_replica_placement=false
--raft_prepare_replacement_before_eviction=false
--tserver_unresponsive_timeout_ms=3000 with env {}
W20260810 01:56:12.605682 26412 flags.cc:432] Enabled unsafe flag: --allow_unsafe_replication_factor=true
W20260810 01:56:12.606020 26412 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:56:12.606081 26412 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:56:12.606165 26412 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 01:56:12.614464 26412 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260810 01:56:12.614593 26412 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:56:12.614642 26412 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:56:12.614714 26412 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:56:12.614770 26412 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:56:12.625016 26412 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.64.212:42671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/wal
--allow_unsafe_replication_factor=true
--enable_range_replica_placement=false
--ipki_ca_key_size=768
--master_addresses=127.21.64.254:38173
--tserver_unresponsive_timeout_ms=3000
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.64.254:38173
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.21.64.254
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 01:44:04 UTC on e7f111948823
build id 13266
ASAN enabled
I20260810 01:56:12.626842 26412 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:56:12.628666 26412 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 01:56:12.637423 26425 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:56:12.637451 26424 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:56:12.638538 26428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:56:12.639526 26412 server_base.cc:1061] running on GCE node
I20260810 01:56:12.640281 26412 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:56:12.641844 26412 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:56:12.643123 26412 hybrid_clock.cc:648] HybridClock initialized: now 1786326972643080 us; error 60 us; skew 500 ppm
I20260810 01:56:12.643509 26412 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 01:56:12.645890 26412 webserver.cc:533] Webserver started at http://127.21.64.254:39321/ using document root <none> and password file <none>
I20260810 01:56:12.646687 26412 fs_manager.cc:362] Metadata directory not provided
I20260810 01:56:12.646833 26412 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:56:12.647217 26412 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:56:12.649768 26412 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "c7a6ab8e5a4c4f8a98fa2c3426f0ed8f"
format_stamp: "Formatted at 2026-08-10 01:56:12 on dist-test-slave-bw88"
I20260810 01:56:12.650616 26412 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "c7a6ab8e5a4c4f8a98fa2c3426f0ed8f"
format_stamp: "Formatted at 2026-08-10 01:56:12 on dist-test-slave-bw88"
I20260810 01:56:12.656215 26412 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260810 01:56:12.659907 26439 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:56:12.661671 26412 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260810 01:56:12.661870 26412 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/wal
uuid: "c7a6ab8e5a4c4f8a98fa2c3426f0ed8f"
format_stamp: "Formatted at 2026-08-10 01:56:12 on dist-test-slave-bw88"
I20260810 01:56:12.662112 26412 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:56:12.675823 26412 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 01:56:12.676823 26412 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:56:12.677172 26412 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:56:12.699950 26412 rpc_server.cc:307] RPC server started. Bound to: 127.21.64.254:38173
I20260810 01:56:12.699975 26521 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.64.254:38173 every 8 connection(s)
I20260810 01:56:12.701871 26412 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260810 01:56:12.706761 26522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:56:12.712009 21763 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNubV1X/build/asan/bin/kudu as pid 26412
I20260810 01:56:12.712289 21763 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/wal/instance
I20260810 01:56:12.717615 26522 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7a6ab8e5a4c4f8a98fa2c3426f0ed8f: Bootstrap starting.
I20260810 01:56:12.720980 26522 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c7a6ab8e5a4c4f8a98fa2c3426f0ed8f: Neither blocks nor log segments found. Creating new log.
I20260810 01:56:12.722193 26522 log.cc:826] T 00000000000000000000000000000000 P c7a6ab8e5a4c4f8a98fa2c3426f0ed8f: Log is configured to *not* fsync() on all Append() calls
I20260810 01:56:12.725646 26522 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7a6ab8e5a4c4f8a98fa2c3426f0ed8f: No bootstrap required, opened a new log
I20260810 01:56:12.732012 26522 raft_consensus.cc:359] T 00000000000000000000000000000000 P c7a6ab8e5a4c4f8a98fa2c3426f0ed8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7a6ab8e5a4c4f8a98fa2c3426f0ed8f" member_type: VOTER last_known_addr { host: "127.21.64.254" port: 38173 } }
I20260810 01:56:12.732439 26522 raft_consensus.cc:385] T 00000000000000000000000000000000 P c7a6ab8e5a4c4f8a98fa2c3426f0ed8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:56:12.732589 26522 raft_consensus.cc:740] T 00000000000000000000000000000000 P c7a6ab8e5a4c4f8a98fa2c3426f0ed8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7a6ab8e5a4c4f8a98fa2c3426f0ed8f, State: Initialized, Role: FOLLOWER
I20260810 01:56:12.733278 26522 consensus_queue.cc:260] T 00000000000000000000000000000000 P c7a6ab8e5a4c4f8a98fa2c3426f0ed8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7a6ab8e5a4c4f8a98fa2c3426f0ed8f" member_type: VOTER last_known_addr { host: "127.21.64.254" port: 38173 } }
I20260810 01:56:12.733599 26522 raft_consensus.cc:399] T 00000000000000000000000000000000 P c7a6ab8e5a4c4f8a98fa2c3426f0ed8f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:56:12.733788 26522 raft_consensus.cc:493] T 00000000000000000000000000000000 P c7a6ab8e5a4c4f8a98fa2c3426f0ed8f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:56:12.734020 26522 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c7a6ab8e5a4c4f8a98fa2c3426f0ed8f [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:56:12.737051 26522 raft_consensus.cc:515] T 00000000000000000000000000000000 P c7a6ab8e5a4c4f8a98fa2c3426f0ed8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7a6ab8e5a4c4f8a98fa2c3426f0ed8f" member_type: VOTER last_known_addr { host: "127.21.64.254" port: 38173 } }
I20260810 01:56:12.737668 26522 leader_election.cc:304] T 00000000000000000000000000000000 P c7a6ab8e5a4c4f8a98fa2c3426f0ed8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c7a6ab8e5a4c4f8a98fa2c3426f0ed8f; no voters:
I20260810 01:56:12.738314 26522 leader_election.cc:290] T 00000000000000000000000000000000 P c7a6ab8e5a4c4f8a98fa2c3426f0ed8f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:56:12.738437 26527 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c7a6ab8e5a4c4f8a98fa2c3426f0ed8f [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:56:12.739315 26527 raft_consensus.cc:697] T 00000000000000000000000000000000 P c7a6ab8e5a4c4f8a98fa2c3426f0ed8f [term 1 LEADER]: Becoming Leader. State: Replica: c7a6ab8e5a4c4f8a98fa2c3426f0ed8f, State: Running, Role: LEADER
I20260810 01:56:12.739884 26527 consensus_queue.cc:237] T 00000000000000000000000000000000 P c7a6ab8e5a4c4f8a98fa2c3426f0ed8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7a6ab8e5a4c4f8a98fa2c3426f0ed8f" member_type: VOTER last_known_addr { host: "127.21.64.254" port: 38173 } }
I20260810 01:56:12.740809 26522 sys_catalog.cc:565] T 00000000000000000000000000000000 P c7a6ab8e5a4c4f8a98fa2c3426f0ed8f [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:56:12.743106 26530 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7a6ab8e5a4c4f8a98fa2c3426f0ed8f [sys.catalog]: SysCatalogTable state changed. Reason: New leader c7a6ab8e5a4c4f8a98fa2c3426f0ed8f. Latest consensus state: current_term: 1 leader_uuid: "c7a6ab8e5a4c4f8a98fa2c3426f0ed8f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7a6ab8e5a4c4f8a98fa2c3426f0ed8f" member_type: VOTER last_known_addr { host: "127.21.64.254" port: 38173 } } }
I20260810 01:56:12.743498 26530 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7a6ab8e5a4c4f8a98fa2c3426f0ed8f [sys.catalog]: This master's current role is: LEADER
I20260810 01:56:12.745571 26529 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7a6ab8e5a4c4f8a98fa2c3426f0ed8f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c7a6ab8e5a4c4f8a98fa2c3426f0ed8f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7a6ab8e5a4c4f8a98fa2c3426f0ed8f" member_type: VOTER last_known_addr { host: "127.21.64.254" port: 38173 } } }
I20260810 01:56:12.745936 26529 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7a6ab8e5a4c4f8a98fa2c3426f0ed8f [sys.catalog]: This master's current role is: LEADER
I20260810 01:56:12.746721 26538 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260810 01:56:12.751674 26538 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260810 01:56:12.760643 26538 catalog_manager.cc:1383] Generated new cluster ID: d80259600af145d0b6146b64e0538ce9
I20260810 01:56:12.760807 26538 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260810 01:56:12.789832 26538 catalog_manager.cc:1406] Generated new certificate authority record
I20260810 01:56:12.791311 26538 catalog_manager.cc:1540] Loading token signing keys...
I20260810 01:56:12.800820 26538 catalog_manager.cc:6092] T 00000000000000000000000000000000 P c7a6ab8e5a4c4f8a98fa2c3426f0ed8f: Generated new TSK 0
I20260810 01:56:12.801775 26538 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260810 01:56:12.817480 21763 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNubV1X/build/asan/bin/kudu
/tmp/dist-test-taskNubV1X/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.64.193:0
--local_ip_for_outbound_sockets=127.21.64.193
--webserver_interface=127.21.64.193
--webserver_port=0
--tserver_master_addrs=127.21.64.254:38173
--builtin_ntp_servers=127.21.64.212:42671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
W20260810 01:56:13.188581 26557 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:56:13.189071 26557 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:56:13.189216 26557 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 01:56:13.199270 26557 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260810 01:56:13.199371 26557 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:56:13.199566 26557 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.64.193
I20260810 01:56:13.210114 26557 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.64.212:42671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.64.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.21.64.193
--webserver_port=0
--tserver_master_addrs=127.21.64.254:38173
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.64.193
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 01:44:04 UTC on e7f111948823
build id 13266
ASAN enabled
I20260810 01:56:13.211891 26557 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:56:13.213992 26557 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 01:56:13.224359 26564 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:56:13.224575 26567 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:56:13.225210 26565 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:56:13.225770 26557 server_base.cc:1061] running on GCE node
I20260810 01:56:13.226455 26557 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:56:13.227373 26557 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:56:13.228598 26557 hybrid_clock.cc:648] HybridClock initialized: now 1786326973228537 us; error 29 us; skew 500 ppm
I20260810 01:56:13.228926 26557 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 01:56:13.234875 26557 webserver.cc:533] Webserver started at http://127.21.64.193:43777/ using document root <none> and password file <none>
I20260810 01:56:13.235668 26557 fs_manager.cc:362] Metadata directory not provided
I20260810 01:56:13.235816 26557 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:56:13.236196 26557 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:56:13.238881 26557 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "a46364d7cd504f8ca7fc003c59ae6d31"
format_stamp: "Formatted at 2026-08-10 01:56:13 on dist-test-slave-bw88"
I20260810 01:56:13.239650 26557 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "a46364d7cd504f8ca7fc003c59ae6d31"
format_stamp: "Formatted at 2026-08-10 01:56:13 on dist-test-slave-bw88"
I20260810 01:56:13.245260 26557 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260810 01:56:13.249068 26573 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:56:13.250494 26557 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260810 01:56:13.250679 26557 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "a46364d7cd504f8ca7fc003c59ae6d31"
format_stamp: "Formatted at 2026-08-10 01:56:13 on dist-test-slave-bw88"
I20260810 01:56:13.250886 26557 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:56:13.267979 26557 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 01:56:13.268797 26557 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:56:13.269111 26557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:56:13.270172 26557 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260810 01:56:13.271896 26557 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:56:13.272011 26557 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:56:13.272156 26557 ts_tablet_manager.cc:616] Registered 0 tablets
I20260810 01:56:13.272235 26557 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:56:13.308564 26557 rpc_server.cc:307] RPC server started. Bound to: 127.21.64.193:45781
I20260810 01:56:13.308658 26715 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.64.193:45781 every 8 connection(s)
I20260810 01:56:13.310721 26557 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20260810 01:56:13.314020 21763 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNubV1X/build/asan/bin/kudu as pid 26557
I20260810 01:56:13.314244 21763 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20260810 01:56:13.318312 21763 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNubV1X/build/asan/bin/kudu
/tmp/dist-test-taskNubV1X/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.64.194:0
--local_ip_for_outbound_sockets=127.21.64.194
--webserver_interface=127.21.64.194
--webserver_port=0
--tserver_master_addrs=127.21.64.254:38173
--builtin_ntp_servers=127.21.64.212:42671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
I20260810 01:56:13.325866 26718 heartbeater.cc:344] Connected to a master server at 127.21.64.254:38173
I20260810 01:56:13.326247 26718 heartbeater.cc:461] Registering TS with master...
I20260810 01:56:13.327059 26718 heartbeater.cc:507] Master 127.21.64.254:38173 requested a full tablet report, sending...
I20260810 01:56:13.329329 26470 ts_manager.cc:194] Registered new tserver with Master: a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193:45781)
I20260810 01:56:13.331702 26470 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.21.64.193:42351
W20260810 01:56:13.682476 26722 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:56:13.682840 26722 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:56:13.682986 26722 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 01:56:13.691311 26722 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260810 01:56:13.691457 26722 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:56:13.691642 26722 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.64.194
I20260810 01:56:13.708485 26722 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.64.212:42671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.64.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.21.64.194
--webserver_port=0
--tserver_master_addrs=127.21.64.254:38173
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.64.194
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 01:44:04 UTC on e7f111948823
build id 13266
ASAN enabled
I20260810 01:56:13.710672 26722 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:56:13.713330 26722 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 01:56:13.725139 26729 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:56:13.725266 26728 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:56:13.727034 26731 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:56:13.728047 26722 server_base.cc:1061] running on GCE node
I20260810 01:56:13.728726 26722 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:56:13.737620 26722 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:56:13.738911 26722 hybrid_clock.cc:648] HybridClock initialized: now 1786326973738789 us; error 67 us; skew 500 ppm
I20260810 01:56:13.739295 26722 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 01:56:13.741869 26722 webserver.cc:533] Webserver started at http://127.21.64.194:39723/ using document root <none> and password file <none>
I20260810 01:56:13.742797 26722 fs_manager.cc:362] Metadata directory not provided
I20260810 01:56:13.742971 26722 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:56:13.743327 26722 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:56:13.746028 26722 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "60d4538b78b44201964cf440ea562c72"
format_stamp: "Formatted at 2026-08-10 01:56:13 on dist-test-slave-bw88"
I20260810 01:56:13.747136 26722 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "60d4538b78b44201964cf440ea562c72"
format_stamp: "Formatted at 2026-08-10 01:56:13 on dist-test-slave-bw88"
I20260810 01:56:13.754184 26722 fs_manager.cc:696] Time spent creating directory manager: real 0.007s user 0.006s sys 0.000s
I20260810 01:56:13.759240 26738 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:56:13.761132 26722 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260810 01:56:13.761416 26722 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "60d4538b78b44201964cf440ea562c72"
format_stamp: "Formatted at 2026-08-10 01:56:13 on dist-test-slave-bw88"
I20260810 01:56:13.761686 26722 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:56:13.811923 26722 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 01:56:13.812860 26722 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:56:13.813180 26722 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:56:13.814208 26722 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260810 01:56:13.815944 26722 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:56:13.816027 26722 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:56:13.816205 26722 ts_tablet_manager.cc:616] Registered 0 tablets
I20260810 01:56:13.816257 26722 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:56:13.852537 26722 rpc_server.cc:307] RPC server started. Bound to: 127.21.64.194:36943
I20260810 01:56:13.852634 26881 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.64.194:36943 every 8 connection(s)
I20260810 01:56:13.854135 26722 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20260810 01:56:13.863306 21763 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNubV1X/build/asan/bin/kudu as pid 26722
I20260810 01:56:13.863565 21763 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20260810 01:56:13.867448 21763 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNubV1X/build/asan/bin/kudu
/tmp/dist-test-taskNubV1X/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.64.195:0
--local_ip_for_outbound_sockets=127.21.64.195
--webserver_interface=127.21.64.195
--webserver_port=0
--tserver_master_addrs=127.21.64.254:38173
--builtin_ntp_servers=127.21.64.212:42671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
I20260810 01:56:13.868688 26884 heartbeater.cc:344] Connected to a master server at 127.21.64.254:38173
I20260810 01:56:13.869057 26884 heartbeater.cc:461] Registering TS with master...
I20260810 01:56:13.869895 26884 heartbeater.cc:507] Master 127.21.64.254:38173 requested a full tablet report, sending...
I20260810 01:56:13.871546 26470 ts_manager.cc:194] Registered new tserver with Master: 60d4538b78b44201964cf440ea562c72 (127.21.64.194:36943)
I20260810 01:56:13.872643 26470 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.21.64.194:37225
W20260810 01:56:14.225091 26889 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:56:14.225497 26889 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:56:14.225589 26889 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 01:56:14.233966 26889 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260810 01:56:14.234067 26889 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:56:14.234270 26889 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.64.195
I20260810 01:56:14.244561 26889 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.64.212:42671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.64.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.21.64.195
--webserver_port=0
--tserver_master_addrs=127.21.64.254:38173
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.64.195
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 01:44:04 UTC on e7f111948823
build id 13266
ASAN enabled
I20260810 01:56:14.246610 26889 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:56:14.248558 26889 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 01:56:14.258658 26895 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:56:14.259064 26896 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:56:14.259707 26898 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:56:14.260437 26889 server_base.cc:1061] running on GCE node
I20260810 01:56:14.261045 26889 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:56:14.262082 26889 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:56:14.263341 26889 hybrid_clock.cc:648] HybridClock initialized: now 1786326974263285 us; error 54 us; skew 500 ppm
I20260810 01:56:14.263675 26889 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 01:56:14.265961 26889 webserver.cc:533] Webserver started at http://127.21.64.195:40999/ using document root <none> and password file <none>
I20260810 01:56:14.266726 26889 fs_manager.cc:362] Metadata directory not provided
I20260810 01:56:14.266893 26889 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:56:14.267284 26889 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:56:14.270058 26889 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "56388bef1a0f453cadc8b6aa9434311d"
format_stamp: "Formatted at 2026-08-10 01:56:14 on dist-test-slave-bw88"
I20260810 01:56:14.270865 26889 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "56388bef1a0f453cadc8b6aa9434311d"
format_stamp: "Formatted at 2026-08-10 01:56:14 on dist-test-slave-bw88"
I20260810 01:56:14.276221 26889 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260810 01:56:14.279695 26908 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:56:14.281029 26889 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260810 01:56:14.281235 26889 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "56388bef1a0f453cadc8b6aa9434311d"
format_stamp: "Formatted at 2026-08-10 01:56:14 on dist-test-slave-bw88"
I20260810 01:56:14.281533 26889 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:56:14.303675 26889 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 01:56:14.304512 26889 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:56:14.304845 26889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:56:14.305891 26889 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260810 01:56:14.307468 26889 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:56:14.307585 26889 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:56:14.307752 26889 ts_tablet_manager.cc:616] Registered 0 tablets
I20260810 01:56:14.307852 26889 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:56:14.335500 26718 heartbeater.cc:499] Master 127.21.64.254:38173 was elected leader, sending a full tablet report...
I20260810 01:56:14.345805 26889 rpc_server.cc:307] RPC server started. Bound to: 127.21.64.195:45355
I20260810 01:56:14.345890 27065 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.64.195:45355 every 8 connection(s)
I20260810 01:56:14.347304 26889 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20260810 01:56:14.349758 21763 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNubV1X/build/asan/bin/kudu as pid 26889
I20260810 01:56:14.349951 21763 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20260810 01:56:14.353641 21763 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNubV1X/build/asan/bin/kudu
/tmp/dist-test-taskNubV1X/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.64.196:0
--local_ip_for_outbound_sockets=127.21.64.196
--webserver_interface=127.21.64.196
--webserver_port=0
--tserver_master_addrs=127.21.64.254:38173
--builtin_ntp_servers=127.21.64.212:42671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
I20260810 01:56:14.361852 27067 heartbeater.cc:344] Connected to a master server at 127.21.64.254:38173
I20260810 01:56:14.362238 27067 heartbeater.cc:461] Registering TS with master...
I20260810 01:56:14.363101 27067 heartbeater.cc:507] Master 127.21.64.254:38173 requested a full tablet report, sending...
I20260810 01:56:14.364799 26470 ts_manager.cc:194] Registered new tserver with Master: 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195:45355)
I20260810 01:56:14.365978 26470 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.21.64.195:51771
W20260810 01:56:14.718271 27070 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:56:14.718638 27070 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:56:14.718775 27070 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 01:56:14.727516 27070 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260810 01:56:14.727653 27070 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:56:14.727854 27070 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.64.196
I20260810 01:56:14.738018 27070 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.64.212:42671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.64.196:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--webserver_interface=127.21.64.196
--webserver_port=0
--tserver_master_addrs=127.21.64.254:38173
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.64.196
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 01:44:04 UTC on e7f111948823
build id 13266
ASAN enabled
I20260810 01:56:14.739782 27070 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:56:14.741829 27070 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 01:56:14.751766 27081 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:56:14.752264 27079 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:56:14.752365 27083 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:56:14.753916 27070 server_base.cc:1061] running on GCE node
I20260810 01:56:14.754586 27070 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:56:14.755537 27070 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:56:14.756855 27070 hybrid_clock.cc:648] HybridClock initialized: now 1786326974756782 us; error 67 us; skew 500 ppm
I20260810 01:56:14.757198 27070 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 01:56:14.759613 27070 webserver.cc:533] Webserver started at http://127.21.64.196:40419/ using document root <none> and password file <none>
I20260810 01:56:14.760411 27070 fs_manager.cc:362] Metadata directory not provided
I20260810 01:56:14.760579 27070 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:56:14.760957 27070 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:56:14.763765 27070 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/data/instance:
uuid: "28812b178f824d539cab11abfe98d77d"
format_stamp: "Formatted at 2026-08-10 01:56:14 on dist-test-slave-bw88"
I20260810 01:56:14.764632 27070 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal/instance:
uuid: "28812b178f824d539cab11abfe98d77d"
format_stamp: "Formatted at 2026-08-10 01:56:14 on dist-test-slave-bw88"
I20260810 01:56:14.770653 27070 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.006s sys 0.002s
I20260810 01:56:14.774181 27089 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:56:14.775650 27070 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260810 01:56:14.775880 27070 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/data,/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal
uuid: "28812b178f824d539cab11abfe98d77d"
format_stamp: "Formatted at 2026-08-10 01:56:14 on dist-test-slave-bw88"
I20260810 01:56:14.776111 27070 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal
metadata directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal
1 data directories: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:56:14.804617 27070 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 01:56:14.805562 27070 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:56:14.805878 27070 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:56:14.807032 27070 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260810 01:56:14.808785 27070 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:56:14.808897 27070 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:56:14.809067 27070 ts_tablet_manager.cc:616] Registered 0 tablets
I20260810 01:56:14.809145 27070 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:56:14.845432 27070 rpc_server.cc:307] RPC server started. Bound to: 127.21.64.196:41095
I20260810 01:56:14.845557 27249 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.64.196:41095 every 8 connection(s)
I20260810 01:56:14.847082 27070 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/data/info.pb
I20260810 01:56:14.857096 21763 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNubV1X/build/asan/bin/kudu as pid 27070
I20260810 01:56:14.857375 21763 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal/instance
I20260810 01:56:14.861284 21763 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNubV1X/build/asan/bin/kudu
/tmp/dist-test-taskNubV1X/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/wal
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/logs
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.64.197:0
--local_ip_for_outbound_sockets=127.21.64.197
--webserver_interface=127.21.64.197
--webserver_port=0
--tserver_master_addrs=127.21.64.254:38173
--builtin_ntp_servers=127.21.64.212:42671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
I20260810 01:56:14.862569 27250 heartbeater.cc:344] Connected to a master server at 127.21.64.254:38173
I20260810 01:56:14.863039 27250 heartbeater.cc:461] Registering TS with master...
I20260810 01:56:14.864176 27250 heartbeater.cc:507] Master 127.21.64.254:38173 requested a full tablet report, sending...
I20260810 01:56:14.866122 26470 ts_manager.cc:194] Registered new tserver with Master: 28812b178f824d539cab11abfe98d77d (127.21.64.196:41095)
I20260810 01:56:14.867115 26470 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.21.64.196:35891
I20260810 01:56:14.875212 26884 heartbeater.cc:499] Master 127.21.64.254:38173 was elected leader, sending a full tablet report...
W20260810 01:56:15.239899 27257 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:56:15.240315 27257 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:56:15.240480 27257 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 01:56:15.249596 27257 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260810 01:56:15.249706 27257 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:56:15.249954 27257 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.64.197
I20260810 01:56:15.260600 27257 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.64.212:42671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.64.197:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--webserver_interface=127.21.64.197
--webserver_port=0
--tserver_master_addrs=127.21.64.254:38173
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.64.197
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 01:44:04 UTC on e7f111948823
build id 13266
ASAN enabled
I20260810 01:56:15.262532 27257 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:56:15.264508 27257 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 01:56:15.275350 27263 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:56:15.275259 27262 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:56:15.276721 27265 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:56:15.277248 27257 server_base.cc:1061] running on GCE node
I20260810 01:56:15.277886 27257 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:56:15.278867 27257 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:56:15.280099 27257 hybrid_clock.cc:648] HybridClock initialized: now 1786326975280022 us; error 49 us; skew 500 ppm
I20260810 01:56:15.280426 27257 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 01:56:15.282876 27257 webserver.cc:533] Webserver started at http://127.21.64.197:42715/ using document root <none> and password file <none>
I20260810 01:56:15.283638 27257 fs_manager.cc:362] Metadata directory not provided
I20260810 01:56:15.283782 27257 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:56:15.284161 27257 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:56:15.286806 27257 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data/instance:
uuid: "8be4ab1c5cca41849942448806160d19"
format_stamp: "Formatted at 2026-08-10 01:56:15 on dist-test-slave-bw88"
I20260810 01:56:15.287619 27257 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/wal/instance:
uuid: "8be4ab1c5cca41849942448806160d19"
format_stamp: "Formatted at 2026-08-10 01:56:15 on dist-test-slave-bw88"
I20260810 01:56:15.293219 27257 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260810 01:56:15.296778 27279 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:56:15.298501 27257 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:56:15.298733 27257 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data,/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/wal
uuid: "8be4ab1c5cca41849942448806160d19"
format_stamp: "Formatted at 2026-08-10 01:56:15 on dist-test-slave-bw88"
I20260810 01:56:15.298969 27257 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/wal
metadata directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/wal
1 data directories: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:56:15.319455 27257 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 01:56:15.320437 27257 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:56:15.320796 27257 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:56:15.321950 27257 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260810 01:56:15.323824 27257 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:56:15.323951 27257 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:56:15.324118 27257 ts_tablet_manager.cc:616] Registered 0 tablets
I20260810 01:56:15.324203 27257 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:56:15.365496 27257 rpc_server.cc:307] RPC server started. Bound to: 127.21.64.197:46107
I20260810 01:56:15.365595 27444 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.64.197:46107 every 8 connection(s)
I20260810 01:56:15.367096 27257 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data/info.pb
I20260810 01:56:15.369304 27067 heartbeater.cc:499] Master 127.21.64.254:38173 was elected leader, sending a full tablet report...
I20260810 01:56:15.371500 21763 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNubV1X/build/asan/bin/kudu as pid 27257
I20260810 01:56:15.371699 21763 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/wal/instance
I20260810 01:56:15.375003 21763 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNubV1X/build/asan/bin/kudu
/tmp/dist-test-taskNubV1X/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/wal
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/logs
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.64.198:0
--local_ip_for_outbound_sockets=127.21.64.198
--webserver_interface=127.21.64.198
--webserver_port=0
--tserver_master_addrs=127.21.64.254:38173
--builtin_ntp_servers=127.21.64.212:42671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
I20260810 01:56:15.382076 27445 heartbeater.cc:344] Connected to a master server at 127.21.64.254:38173
I20260810 01:56:15.382472 27445 heartbeater.cc:461] Registering TS with master...
I20260810 01:56:15.383409 27445 heartbeater.cc:507] Master 127.21.64.254:38173 requested a full tablet report, sending...
I20260810 01:56:15.385082 26470 ts_manager.cc:194] Registered new tserver with Master: 8be4ab1c5cca41849942448806160d19 (127.21.64.197:46107)
I20260810 01:56:15.386298 26470 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.21.64.197:53737
W20260810 01:56:15.735445 27450 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:56:15.735813 27450 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:56:15.735965 27450 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 01:56:15.744434 27450 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260810 01:56:15.744536 27450 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:56:15.744745 27450 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.64.198
I20260810 01:56:15.755093 27450 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.64.212:42671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/data
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.64.198:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/data/info.pb
--webserver_interface=127.21.64.198
--webserver_port=0
--tserver_master_addrs=127.21.64.254:38173
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.64.198
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 01:44:04 UTC on e7f111948823
build id 13266
ASAN enabled
I20260810 01:56:15.756964 27450 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:56:15.758854 27450 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 01:56:15.768492 27458 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:56:15.768846 27457 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:56:15.769519 27462 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:56:15.770145 27450 server_base.cc:1061] running on GCE node
I20260810 01:56:15.770727 27450 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:56:15.771658 27450 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:56:15.772905 27450 hybrid_clock.cc:648] HybridClock initialized: now 1786326975772828 us; error 58 us; skew 500 ppm
I20260810 01:56:15.773301 27450 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 01:56:15.775750 27450 webserver.cc:533] Webserver started at http://127.21.64.198:44291/ using document root <none> and password file <none>
I20260810 01:56:15.776535 27450 fs_manager.cc:362] Metadata directory not provided
I20260810 01:56:15.776646 27450 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:56:15.777045 27450 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:56:15.779577 27450 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/data/instance:
uuid: "9353b63b4d854d23b51a8103bc899aab"
format_stamp: "Formatted at 2026-08-10 01:56:15 on dist-test-slave-bw88"
I20260810 01:56:15.780385 27450 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/wal/instance:
uuid: "9353b63b4d854d23b51a8103bc899aab"
format_stamp: "Formatted at 2026-08-10 01:56:15 on dist-test-slave-bw88"
I20260810 01:56:15.786269 27450 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260810 01:56:15.790001 27468 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:56:15.791631 27450 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.002s
I20260810 01:56:15.791814 27450 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/data,/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/wal
uuid: "9353b63b4d854d23b51a8103bc899aab"
format_stamp: "Formatted at 2026-08-10 01:56:15 on dist-test-slave-bw88"
I20260810 01:56:15.792016 27450 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/wal
metadata directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/wal
1 data directories: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:56:15.809177 27450 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 01:56:15.810153 27450 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:56:15.810468 27450 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:56:15.811480 27450 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260810 01:56:15.813199 27450 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:56:15.813273 27450 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:56:15.813457 27450 ts_tablet_manager.cc:616] Registered 0 tablets
I20260810 01:56:15.813541 27450 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:56:15.850481 27450 rpc_server.cc:307] RPC server started. Bound to: 127.21.64.198:41745
I20260810 01:56:15.850587 27616 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.64.198:41745 every 8 connection(s)
I20260810 01:56:15.851987 27450 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/data/info.pb
I20260810 01:56:15.858289 21763 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNubV1X/build/asan/bin/kudu as pid 27450
I20260810 01:56:15.858518 21763 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/wal/instance
I20260810 01:56:15.861994 21763 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNubV1X/build/asan/bin/kudu
/tmp/dist-test-taskNubV1X/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/wal
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/logs
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.64.199:0
--local_ip_for_outbound_sockets=127.21.64.199
--webserver_interface=127.21.64.199
--webserver_port=0
--tserver_master_addrs=127.21.64.254:38173
--builtin_ntp_servers=127.21.64.212:42671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
I20260810 01:56:15.866350 27617 heartbeater.cc:344] Connected to a master server at 127.21.64.254:38173
I20260810 01:56:15.866739 27617 heartbeater.cc:461] Registering TS with master...
I20260810 01:56:15.867669 27617 heartbeater.cc:507] Master 127.21.64.254:38173 requested a full tablet report, sending...
I20260810 01:56:15.869293 26470 ts_manager.cc:194] Registered new tserver with Master: 9353b63b4d854d23b51a8103bc899aab (127.21.64.198:41745)
I20260810 01:56:15.869781 27250 heartbeater.cc:499] Master 127.21.64.254:38173 was elected leader, sending a full tablet report...
I20260810 01:56:15.870568 26470 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.21.64.198:41037
W20260810 01:56:16.229727 27620 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:56:16.230103 27620 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:56:16.230244 27620 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 01:56:16.238570 27620 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260810 01:56:16.238725 27620 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:56:16.238951 27620 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.64.199
I20260810 01:56:16.249243 27620 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.64.212:42671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/data
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.64.199:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/data/info.pb
--webserver_interface=127.21.64.199
--webserver_port=0
--tserver_master_addrs=127.21.64.254:38173
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.64.199
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 01:44:04 UTC on e7f111948823
build id 13266
ASAN enabled
I20260810 01:56:16.251015 27620 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:56:16.252914 27620 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 01:56:16.263638 27627 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:56:16.263674 27628 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:56:16.263795 27632 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:56:16.264849 27620 server_base.cc:1061] running on GCE node
I20260810 01:56:16.265615 27620 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:56:16.266603 27620 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:56:16.267861 27620 hybrid_clock.cc:648] HybridClock initialized: now 1786326976267781 us; error 45 us; skew 500 ppm
I20260810 01:56:16.268318 27620 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 01:56:16.270648 27620 webserver.cc:533] Webserver started at http://127.21.64.199:46429/ using document root <none> and password file <none>
I20260810 01:56:16.271399 27620 fs_manager.cc:362] Metadata directory not provided
I20260810 01:56:16.271562 27620 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:56:16.271937 27620 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:56:16.274381 27620 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/data/instance:
uuid: "07e0a39216984856b2ff8c512c4c2f93"
format_stamp: "Formatted at 2026-08-10 01:56:16 on dist-test-slave-bw88"
I20260810 01:56:16.275262 27620 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/wal/instance:
uuid: "07e0a39216984856b2ff8c512c4c2f93"
format_stamp: "Formatted at 2026-08-10 01:56:16 on dist-test-slave-bw88"
I20260810 01:56:16.280620 27620 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260810 01:56:16.284047 27639 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:56:16.285463 27620 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:56:16.285640 27620 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/data,/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/wal
uuid: "07e0a39216984856b2ff8c512c4c2f93"
format_stamp: "Formatted at 2026-08-10 01:56:16 on dist-test-slave-bw88"
I20260810 01:56:16.285843 27620 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/wal
metadata directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/wal
1 data directories: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:56:16.321547 27620 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 01:56:16.322458 27620 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:56:16.322765 27620 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:56:16.323752 27620 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260810 01:56:16.325539 27620 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:56:16.325641 27620 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:56:16.325796 27620 ts_tablet_manager.cc:616] Registered 0 tablets
I20260810 01:56:16.325870 27620 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:56:16.363611 27620 rpc_server.cc:307] RPC server started. Bound to: 127.21.64.199:42747
I20260810 01:56:16.363670 27783 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.64.199:42747 every 8 connection(s)
I20260810 01:56:16.365339 27620 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/data/info.pb
I20260810 01:56:16.367815 21763 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNubV1X/build/asan/bin/kudu as pid 27620
I20260810 01:56:16.368039 21763 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/wal/instance
I20260810 01:56:16.384895 27786 heartbeater.cc:344] Connected to a master server at 127.21.64.254:38173
I20260810 01:56:16.385340 27786 heartbeater.cc:461] Registering TS with master...
I20260810 01:56:16.386204 27786 heartbeater.cc:507] Master 127.21.64.254:38173 requested a full tablet report, sending...
I20260810 01:56:16.387688 26468 ts_manager.cc:194] Registered new tserver with Master: 07e0a39216984856b2ff8c512c4c2f93 (127.21.64.199:42747)
I20260810 01:56:16.388682 26468 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.21.64.199:37281
I20260810 01:56:16.388963 27445 heartbeater.cc:499] Master 127.21.64.254:38173 was elected leader, sending a full tablet report...
I20260810 01:56:16.399080 21763 external_mini_cluster.cc:955] 7 TS(s) registered with all masters
I20260810 01:56:16.416087 26468 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53804:
name: "TestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 2
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
owner: "alice"
I20260810 01:56:16.448882 26634 tablet_service.cc:1511] Processing CreateTablet for tablet 4277bfd83a7e48f8a89be6d3ee55558d (DEFAULT_TABLE table=TestTable [id=f1ed845809e84391b90ff1948a854775]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:56:16.448840 26976 tablet_service.cc:1511] Processing CreateTablet for tablet 4277bfd83a7e48f8a89be6d3ee55558d (DEFAULT_TABLE table=TestTable [id=f1ed845809e84391b90ff1948a854775]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:56:16.450331 26634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4277bfd83a7e48f8a89be6d3ee55558d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:56:16.450352 26976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4277bfd83a7e48f8a89be6d3ee55558d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:56:16.461229 27806 tablet_bootstrap.cc:492] T 4277bfd83a7e48f8a89be6d3ee55558d P a46364d7cd504f8ca7fc003c59ae6d31: Bootstrap starting.
I20260810 01:56:16.461758 27808 tablet_bootstrap.cc:492] T 4277bfd83a7e48f8a89be6d3ee55558d P 56388bef1a0f453cadc8b6aa9434311d: Bootstrap starting.
I20260810 01:56:16.464797 27808 tablet_bootstrap.cc:654] T 4277bfd83a7e48f8a89be6d3ee55558d P 56388bef1a0f453cadc8b6aa9434311d: Neither blocks nor log segments found. Creating new log.
I20260810 01:56:16.464820 27806 tablet_bootstrap.cc:654] T 4277bfd83a7e48f8a89be6d3ee55558d P a46364d7cd504f8ca7fc003c59ae6d31: Neither blocks nor log segments found. Creating new log.
I20260810 01:56:16.465941 27808 log.cc:826] T 4277bfd83a7e48f8a89be6d3ee55558d P 56388bef1a0f453cadc8b6aa9434311d: Log is configured to *not* fsync() on all Append() calls
I20260810 01:56:16.466022 27806 log.cc:826] T 4277bfd83a7e48f8a89be6d3ee55558d P a46364d7cd504f8ca7fc003c59ae6d31: Log is configured to *not* fsync() on all Append() calls
I20260810 01:56:16.469733 27806 tablet_bootstrap.cc:492] T 4277bfd83a7e48f8a89be6d3ee55558d P a46364d7cd504f8ca7fc003c59ae6d31: No bootstrap required, opened a new log
I20260810 01:56:16.469733 27808 tablet_bootstrap.cc:492] T 4277bfd83a7e48f8a89be6d3ee55558d P 56388bef1a0f453cadc8b6aa9434311d: No bootstrap required, opened a new log
I20260810 01:56:16.470048 27806 ts_tablet_manager.cc:1403] T 4277bfd83a7e48f8a89be6d3ee55558d P a46364d7cd504f8ca7fc003c59ae6d31: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.003s
I20260810 01:56:16.470045 27808 ts_tablet_manager.cc:1403] T 4277bfd83a7e48f8a89be6d3ee55558d P 56388bef1a0f453cadc8b6aa9434311d: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260810 01:56:16.478066 27808 raft_consensus.cc:359] T 4277bfd83a7e48f8a89be6d3ee55558d P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } }
I20260810 01:56:16.478065 27806 raft_consensus.cc:359] T 4277bfd83a7e48f8a89be6d3ee55558d P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } }
I20260810 01:56:16.478508 27806 raft_consensus.cc:385] T 4277bfd83a7e48f8a89be6d3ee55558d P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:56:16.478508 27808 raft_consensus.cc:385] T 4277bfd83a7e48f8a89be6d3ee55558d P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:56:16.478633 27806 raft_consensus.cc:740] T 4277bfd83a7e48f8a89be6d3ee55558d P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46364d7cd504f8ca7fc003c59ae6d31, State: Initialized, Role: FOLLOWER
I20260810 01:56:16.478633 27808 raft_consensus.cc:740] T 4277bfd83a7e48f8a89be6d3ee55558d P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56388bef1a0f453cadc8b6aa9434311d, State: Initialized, Role: FOLLOWER
I20260810 01:56:16.479398 27806 consensus_queue.cc:260] T 4277bfd83a7e48f8a89be6d3ee55558d P a46364d7cd504f8ca7fc003c59ae6d31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } }
I20260810 01:56:16.479408 27808 consensus_queue.cc:260] T 4277bfd83a7e48f8a89be6d3ee55558d P 56388bef1a0f453cadc8b6aa9434311d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } }
I20260810 01:56:16.481509 27808 ts_tablet_manager.cc:1434] T 4277bfd83a7e48f8a89be6d3ee55558d P 56388bef1a0f453cadc8b6aa9434311d: Time spent starting tablet: real 0.011s user 0.012s sys 0.000s
I20260810 01:56:16.483186 27806 ts_tablet_manager.cc:1434] T 4277bfd83a7e48f8a89be6d3ee55558d P a46364d7cd504f8ca7fc003c59ae6d31: Time spent starting tablet: real 0.013s user 0.011s sys 0.001s
W20260810 01:56:16.564980 26719 tablet.cc:2406] T 4277bfd83a7e48f8a89be6d3ee55558d P a46364d7cd504f8ca7fc003c59ae6d31: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 01:56:16.600512 27068 tablet.cc:2406] T 4277bfd83a7e48f8a89be6d3ee55558d P 56388bef1a0f453cadc8b6aa9434311d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:56:16.625942 27812 raft_consensus.cc:493] T 4277bfd83a7e48f8a89be6d3ee55558d P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:56:16.626304 27812 raft_consensus.cc:515] T 4277bfd83a7e48f8a89be6d3ee55558d P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } }
I20260810 01:56:16.628901 27812 leader_election.cc:290] T 4277bfd83a7e48f8a89be6d3ee55558d P a46364d7cd504f8ca7fc003c59ae6d31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195:45355)
I20260810 01:56:16.637749 27006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4277bfd83a7e48f8a89be6d3ee55558d" candidate_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56388bef1a0f453cadc8b6aa9434311d" is_pre_election: true
I20260810 01:56:16.638306 27006 raft_consensus.cc:2468] T 4277bfd83a7e48f8a89be6d3ee55558d P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46364d7cd504f8ca7fc003c59ae6d31 in term 0.
I20260810 01:56:16.639077 26576 leader_election.cc:304] T 4277bfd83a7e48f8a89be6d3ee55558d P a46364d7cd504f8ca7fc003c59ae6d31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 56388bef1a0f453cadc8b6aa9434311d, a46364d7cd504f8ca7fc003c59ae6d31; no voters:
I20260810 01:56:16.639580 27812 raft_consensus.cc:2804] T 4277bfd83a7e48f8a89be6d3ee55558d P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:56:16.639786 27812 raft_consensus.cc:493] T 4277bfd83a7e48f8a89be6d3ee55558d P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:56:16.639909 27812 raft_consensus.cc:3060] T 4277bfd83a7e48f8a89be6d3ee55558d P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:56:16.643968 27812 raft_consensus.cc:515] T 4277bfd83a7e48f8a89be6d3ee55558d P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } }
I20260810 01:56:16.644778 27812 leader_election.cc:290] T 4277bfd83a7e48f8a89be6d3ee55558d P a46364d7cd504f8ca7fc003c59ae6d31 [CANDIDATE]: Term 1 election: Requested vote from peers 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195:45355)
I20260810 01:56:16.645440 27006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4277bfd83a7e48f8a89be6d3ee55558d" candidate_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56388bef1a0f453cadc8b6aa9434311d"
I20260810 01:56:16.645668 27006 raft_consensus.cc:3060] T 4277bfd83a7e48f8a89be6d3ee55558d P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:56:16.647965 27006 raft_consensus.cc:2468] T 4277bfd83a7e48f8a89be6d3ee55558d P 56388bef1a0f453cadc8b6aa9434311d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46364d7cd504f8ca7fc003c59ae6d31 in term 1.
I20260810 01:56:16.648478 26576 leader_election.cc:304] T 4277bfd83a7e48f8a89be6d3ee55558d P a46364d7cd504f8ca7fc003c59ae6d31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 56388bef1a0f453cadc8b6aa9434311d, a46364d7cd504f8ca7fc003c59ae6d31; no voters:
I20260810 01:56:16.648825 27812 raft_consensus.cc:2804] T 4277bfd83a7e48f8a89be6d3ee55558d P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:56:16.649386 27812 raft_consensus.cc:697] T 4277bfd83a7e48f8a89be6d3ee55558d P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 LEADER]: Becoming Leader. State: Replica: a46364d7cd504f8ca7fc003c59ae6d31, State: Running, Role: LEADER
I20260810 01:56:16.650028 27812 consensus_queue.cc:237] T 4277bfd83a7e48f8a89be6d3ee55558d P a46364d7cd504f8ca7fc003c59ae6d31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } }
I20260810 01:56:16.655692 26468 catalog_manager.cc:5719] T 4277bfd83a7e48f8a89be6d3ee55558d P a46364d7cd504f8ca7fc003c59ae6d31 reported cstate change: term changed from 0 to 1, leader changed from <none> to a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193). New cstate: current_term: 1 leader_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } }
I20260810 01:56:16.681084 21763 external_mini_cluster.cc:955] 7 TS(s) registered with all masters
I20260810 01:56:16.683981 21763 ts_itest-base.cc:246] Waiting for 1 tablets on tserver a46364d7cd504f8ca7fc003c59ae6d31 to finish bootstrapping
I20260810 01:56:16.694043 21763 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 56388bef1a0f453cadc8b6aa9434311d to finish bootstrapping
I20260810 01:56:16.703650 21763 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskNubV1X/build/asan/bin/kudu pid 27070
I20260810 01:56:16.712890 27241 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 01:56:16.800285 21763 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskNubV1X/build/asan/bin/kudu with pid 27070
I20260810 01:56:16.827797 21763 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskNubV1X/build/asan/bin/kudu pid 27257
I20260810 01:56:16.837826 27435 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 01:56:16.873310 27617 heartbeater.cc:499] Master 127.21.64.254:38173 was elected leader, sending a full tablet report...
I20260810 01:56:16.978783 21763 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskNubV1X/build/asan/bin/kudu with pid 27257
I20260810 01:56:17.004012 21763 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskNubV1X/build/asan/bin/kudu pid 27450
I20260810 01:56:17.012868 27612 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 01:56:17.100903 21763 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskNubV1X/build/asan/bin/kudu with pid 27450
I20260810 01:56:17.120428 27812 consensus_queue.cc:1048] T 4277bfd83a7e48f8a89be6d3ee55558d P a46364d7cd504f8ca7fc003c59ae6d31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:56:17.127665 21763 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskNubV1X/build/asan/bin/kudu pid 27620
I20260810 01:56:17.137179 27779 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 01:56:17.223771 21763 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskNubV1X/build/asan/bin/kudu with pid 27620
I20260810 01:56:21.000312 26468 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53804:
name: "rebalance_test_table_0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 2
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260810 01:56:21.013020 26634 tablet_service.cc:1511] Processing CreateTablet for tablet c72cec0deb794dac95b7a88308c56167 (DEFAULT_TABLE table=rebalance_test_table_0 [id=52f00827f2964d63b49607d8194867d6]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:56:21.013608 26634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c72cec0deb794dac95b7a88308c56167. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:56:21.014021 26976 tablet_service.cc:1511] Processing CreateTablet for tablet 059c8fa5da994e6c9f3582df4542d276 (DEFAULT_TABLE table=rebalance_test_table_0 [id=52f00827f2964d63b49607d8194867d6]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:56:21.014251 26633 tablet_service.cc:1511] Processing CreateTablet for tablet 4403a36d26db47278a82abb5df118bbd (DEFAULT_TABLE table=rebalance_test_table_0 [id=52f00827f2964d63b49607d8194867d6]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:56:21.014470 26976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 059c8fa5da994e6c9f3582df4542d276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:56:21.014732 26633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4403a36d26db47278a82abb5df118bbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:56:21.025828 27849 tablet_bootstrap.cc:492] T c72cec0deb794dac95b7a88308c56167 P a46364d7cd504f8ca7fc003c59ae6d31: Bootstrap starting.
I20260810 01:56:21.026496 27850 tablet_bootstrap.cc:492] T 059c8fa5da994e6c9f3582df4542d276 P 56388bef1a0f453cadc8b6aa9434311d: Bootstrap starting.
I20260810 01:56:21.028607 27850 tablet_bootstrap.cc:654] T 059c8fa5da994e6c9f3582df4542d276 P 56388bef1a0f453cadc8b6aa9434311d: Neither blocks nor log segments found. Creating new log.
I20260810 01:56:21.028239 26806 tablet_service.cc:1511] Processing CreateTablet for tablet 059c8fa5da994e6c9f3582df4542d276 (DEFAULT_TABLE table=rebalance_test_table_0 [id=52f00827f2964d63b49607d8194867d6]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:56:21.028606 27849 tablet_bootstrap.cc:654] T c72cec0deb794dac95b7a88308c56167 P a46364d7cd504f8ca7fc003c59ae6d31: Neither blocks nor log segments found. Creating new log.
I20260810 01:56:21.029803 26806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 059c8fa5da994e6c9f3582df4542d276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:56:21.027956 26807 tablet_service.cc:1511] Processing CreateTablet for tablet c72cec0deb794dac95b7a88308c56167 (DEFAULT_TABLE table=rebalance_test_table_0 [id=52f00827f2964d63b49607d8194867d6]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:56:21.030484 26807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c72cec0deb794dac95b7a88308c56167. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:56:21.028753 26805 tablet_service.cc:1511] Processing CreateTablet for tablet 4403a36d26db47278a82abb5df118bbd (DEFAULT_TABLE table=rebalance_test_table_0 [id=52f00827f2964d63b49607d8194867d6]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:56:21.031905 26805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4403a36d26db47278a82abb5df118bbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:56:21.034560 27849 tablet_bootstrap.cc:492] T c72cec0deb794dac95b7a88308c56167 P a46364d7cd504f8ca7fc003c59ae6d31: No bootstrap required, opened a new log
I20260810 01:56:21.034729 27849 ts_tablet_manager.cc:1403] T c72cec0deb794dac95b7a88308c56167 P a46364d7cd504f8ca7fc003c59ae6d31: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260810 01:56:21.035000 27850 tablet_bootstrap.cc:492] T 059c8fa5da994e6c9f3582df4542d276 P 56388bef1a0f453cadc8b6aa9434311d: No bootstrap required, opened a new log
I20260810 01:56:21.035148 27850 ts_tablet_manager.cc:1403] T 059c8fa5da994e6c9f3582df4542d276 P 56388bef1a0f453cadc8b6aa9434311d: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.007s
I20260810 01:56:21.035837 27849 raft_consensus.cc:359] T c72cec0deb794dac95b7a88308c56167 P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } }
I20260810 01:56:21.036068 27849 raft_consensus.cc:385] T c72cec0deb794dac95b7a88308c56167 P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:56:21.036185 27849 raft_consensus.cc:740] T c72cec0deb794dac95b7a88308c56167 P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46364d7cd504f8ca7fc003c59ae6d31, State: Initialized, Role: FOLLOWER
I20260810 01:56:21.036106 27850 raft_consensus.cc:359] T 059c8fa5da994e6c9f3582df4542d276 P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } }
I20260810 01:56:21.036288 27850 raft_consensus.cc:385] T 059c8fa5da994e6c9f3582df4542d276 P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:56:21.036388 27850 raft_consensus.cc:740] T 059c8fa5da994e6c9f3582df4542d276 P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56388bef1a0f453cadc8b6aa9434311d, State: Initialized, Role: FOLLOWER
I20260810 01:56:21.036528 27849 consensus_queue.cc:260] T c72cec0deb794dac95b7a88308c56167 P a46364d7cd504f8ca7fc003c59ae6d31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } }
I20260810 01:56:21.036635 27850 consensus_queue.cc:260] T 059c8fa5da994e6c9f3582df4542d276 P 56388bef1a0f453cadc8b6aa9434311d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } }
I20260810 01:56:21.037213 27849 ts_tablet_manager.cc:1434] T c72cec0deb794dac95b7a88308c56167 P a46364d7cd504f8ca7fc003c59ae6d31: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 01:56:21.037678 27849 tablet_bootstrap.cc:492] T 4403a36d26db47278a82abb5df118bbd P a46364d7cd504f8ca7fc003c59ae6d31: Bootstrap starting.
I20260810 01:56:21.040052 27849 tablet_bootstrap.cc:654] T 4403a36d26db47278a82abb5df118bbd P a46364d7cd504f8ca7fc003c59ae6d31: Neither blocks nor log segments found. Creating new log.
I20260810 01:56:21.043936 27850 ts_tablet_manager.cc:1434] T 059c8fa5da994e6c9f3582df4542d276 P 56388bef1a0f453cadc8b6aa9434311d: Time spent starting tablet: real 0.009s user 0.008s sys 0.000s
I20260810 01:56:21.048048 27849 tablet_bootstrap.cc:492] T 4403a36d26db47278a82abb5df118bbd P a46364d7cd504f8ca7fc003c59ae6d31: No bootstrap required, opened a new log
I20260810 01:56:21.048292 27849 ts_tablet_manager.cc:1403] T 4403a36d26db47278a82abb5df118bbd P a46364d7cd504f8ca7fc003c59ae6d31: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.005s
I20260810 01:56:21.049292 27849 raft_consensus.cc:359] T 4403a36d26db47278a82abb5df118bbd P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } }
I20260810 01:56:21.049621 27849 raft_consensus.cc:385] T 4403a36d26db47278a82abb5df118bbd P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:56:21.049748 27849 raft_consensus.cc:740] T 4403a36d26db47278a82abb5df118bbd P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46364d7cd504f8ca7fc003c59ae6d31, State: Initialized, Role: FOLLOWER
I20260810 01:56:21.050032 27849 consensus_queue.cc:260] T 4403a36d26db47278a82abb5df118bbd P a46364d7cd504f8ca7fc003c59ae6d31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } }
I20260810 01:56:21.050344 27856 tablet_bootstrap.cc:492] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72: Bootstrap starting.
I20260810 01:56:21.050581 27849 ts_tablet_manager.cc:1434] T 4403a36d26db47278a82abb5df118bbd P a46364d7cd504f8ca7fc003c59ae6d31: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:56:21.054069 27856 tablet_bootstrap.cc:654] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72: Neither blocks nor log segments found. Creating new log.
I20260810 01:56:21.055188 27856 log.cc:826] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72: Log is configured to *not* fsync() on all Append() calls
I20260810 01:56:21.058066 27856 tablet_bootstrap.cc:492] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72: No bootstrap required, opened a new log
I20260810 01:56:21.058331 27856 ts_tablet_manager.cc:1403] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260810 01:56:21.063313 27856 raft_consensus.cc:359] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } }
I20260810 01:56:21.063634 27856 raft_consensus.cc:385] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:56:21.063766 27856 raft_consensus.cc:740] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d4538b78b44201964cf440ea562c72, State: Initialized, Role: FOLLOWER
I20260810 01:56:21.064363 27856 consensus_queue.cc:260] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } }
I20260810 01:56:21.066123 27856 ts_tablet_manager.cc:1434] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20260810 01:56:21.066497 27856 tablet_bootstrap.cc:492] T 4403a36d26db47278a82abb5df118bbd P 60d4538b78b44201964cf440ea562c72: Bootstrap starting.
I20260810 01:56:21.068228 27856 tablet_bootstrap.cc:654] T 4403a36d26db47278a82abb5df118bbd P 60d4538b78b44201964cf440ea562c72: Neither blocks nor log segments found. Creating new log.
I20260810 01:56:21.070749 27856 tablet_bootstrap.cc:492] T 4403a36d26db47278a82abb5df118bbd P 60d4538b78b44201964cf440ea562c72: No bootstrap required, opened a new log
I20260810 01:56:21.070886 27856 ts_tablet_manager.cc:1403] T 4403a36d26db47278a82abb5df118bbd P 60d4538b78b44201964cf440ea562c72: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.001s
I20260810 01:56:21.071614 27856 raft_consensus.cc:359] T 4403a36d26db47278a82abb5df118bbd P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } }
I20260810 01:56:21.071735 27856 raft_consensus.cc:385] T 4403a36d26db47278a82abb5df118bbd P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:56:21.071856 27856 raft_consensus.cc:740] T 4403a36d26db47278a82abb5df118bbd P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d4538b78b44201964cf440ea562c72, State: Initialized, Role: FOLLOWER
I20260810 01:56:21.072070 27856 consensus_queue.cc:260] T 4403a36d26db47278a82abb5df118bbd P 60d4538b78b44201964cf440ea562c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } }
I20260810 01:56:21.072559 27856 ts_tablet_manager.cc:1434] T 4403a36d26db47278a82abb5df118bbd P 60d4538b78b44201964cf440ea562c72: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 01:56:21.072860 27856 tablet_bootstrap.cc:492] T 059c8fa5da994e6c9f3582df4542d276 P 60d4538b78b44201964cf440ea562c72: Bootstrap starting.
I20260810 01:56:21.074378 27856 tablet_bootstrap.cc:654] T 059c8fa5da994e6c9f3582df4542d276 P 60d4538b78b44201964cf440ea562c72: Neither blocks nor log segments found. Creating new log.
I20260810 01:56:21.076714 27856 tablet_bootstrap.cc:492] T 059c8fa5da994e6c9f3582df4542d276 P 60d4538b78b44201964cf440ea562c72: No bootstrap required, opened a new log
I20260810 01:56:21.076885 27856 ts_tablet_manager.cc:1403] T 059c8fa5da994e6c9f3582df4542d276 P 60d4538b78b44201964cf440ea562c72: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260810 01:56:21.077544 27856 raft_consensus.cc:359] T 059c8fa5da994e6c9f3582df4542d276 P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } }
I20260810 01:56:21.077726 27856 raft_consensus.cc:385] T 059c8fa5da994e6c9f3582df4542d276 P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:56:21.077824 27856 raft_consensus.cc:740] T 059c8fa5da994e6c9f3582df4542d276 P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d4538b78b44201964cf440ea562c72, State: Initialized, Role: FOLLOWER
I20260810 01:56:21.078080 27856 consensus_queue.cc:260] T 059c8fa5da994e6c9f3582df4542d276 P 60d4538b78b44201964cf440ea562c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } }
I20260810 01:56:21.078534 27856 ts_tablet_manager.cc:1434] T 059c8fa5da994e6c9f3582df4542d276 P 60d4538b78b44201964cf440ea562c72: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
W20260810 01:56:21.111306 26886 tablet.cc:2406] T 059c8fa5da994e6c9f3582df4542d276 P 60d4538b78b44201964cf440ea562c72: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:56:21.125953 27858 raft_consensus.cc:493] T 4403a36d26db47278a82abb5df118bbd P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:56:21.126238 27858 raft_consensus.cc:515] T 4403a36d26db47278a82abb5df118bbd P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } }
I20260810 01:56:21.127869 27858 leader_election.cc:290] T 4403a36d26db47278a82abb5df118bbd P 60d4538b78b44201964cf440ea562c72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193:45781)
I20260810 01:56:21.134656 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4403a36d26db47278a82abb5df118bbd" candidate_uuid: "60d4538b78b44201964cf440ea562c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" is_pre_election: true
I20260810 01:56:21.135008 26660 raft_consensus.cc:2468] T 4403a36d26db47278a82abb5df118bbd P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60d4538b78b44201964cf440ea562c72 in term 0.
I20260810 01:56:21.135604 26745 leader_election.cc:304] T 4403a36d26db47278a82abb5df118bbd P 60d4538b78b44201964cf440ea562c72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 60d4538b78b44201964cf440ea562c72, a46364d7cd504f8ca7fc003c59ae6d31; no voters:
I20260810 01:56:21.135963 27858 raft_consensus.cc:2804] T 4403a36d26db47278a82abb5df118bbd P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:56:21.136123 27858 raft_consensus.cc:493] T 4403a36d26db47278a82abb5df118bbd P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:56:21.136235 27858 raft_consensus.cc:3060] T 4403a36d26db47278a82abb5df118bbd P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:56:21.138476 27858 raft_consensus.cc:515] T 4403a36d26db47278a82abb5df118bbd P 60d4538b78b44201964cf440ea562c72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } }
I20260810 01:56:21.138965 27858 leader_election.cc:290] T 4403a36d26db47278a82abb5df118bbd P 60d4538b78b44201964cf440ea562c72 [CANDIDATE]: Term 1 election: Requested vote from peers a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193:45781)
I20260810 01:56:21.139545 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4403a36d26db47278a82abb5df118bbd" candidate_uuid: "60d4538b78b44201964cf440ea562c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46364d7cd504f8ca7fc003c59ae6d31"
I20260810 01:56:21.139744 26660 raft_consensus.cc:3060] T 4403a36d26db47278a82abb5df118bbd P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:56:21.142148 26660 raft_consensus.cc:2468] T 4403a36d26db47278a82abb5df118bbd P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60d4538b78b44201964cf440ea562c72 in term 1.
I20260810 01:56:21.142829 26745 leader_election.cc:304] T 4403a36d26db47278a82abb5df118bbd P 60d4538b78b44201964cf440ea562c72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 60d4538b78b44201964cf440ea562c72, a46364d7cd504f8ca7fc003c59ae6d31; no voters:
I20260810 01:56:21.143132 27858 raft_consensus.cc:2804] T 4403a36d26db47278a82abb5df118bbd P 60d4538b78b44201964cf440ea562c72 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:56:21.143568 27858 raft_consensus.cc:697] T 4403a36d26db47278a82abb5df118bbd P 60d4538b78b44201964cf440ea562c72 [term 1 LEADER]: Becoming Leader. State: Replica: 60d4538b78b44201964cf440ea562c72, State: Running, Role: LEADER
I20260810 01:56:21.144037 27858 consensus_queue.cc:237] T 4403a36d26db47278a82abb5df118bbd P 60d4538b78b44201964cf440ea562c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } }
I20260810 01:56:21.148432 26468 catalog_manager.cc:5719] T 4403a36d26db47278a82abb5df118bbd P 60d4538b78b44201964cf440ea562c72 reported cstate change: term changed from 0 to 1, leader changed from <none> to 60d4538b78b44201964cf440ea562c72 (127.21.64.194). New cstate: current_term: 1 leader_uuid: "60d4538b78b44201964cf440ea562c72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } }
I20260810 01:56:21.216784 27858 raft_consensus.cc:493] T 059c8fa5da994e6c9f3582df4542d276 P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:56:21.217127 27858 raft_consensus.cc:515] T 059c8fa5da994e6c9f3582df4542d276 P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } }
I20260810 01:56:21.217835 27858 leader_election.cc:290] T 059c8fa5da994e6c9f3582df4542d276 P 60d4538b78b44201964cf440ea562c72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195:45355)
I20260810 01:56:21.225728 27006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059c8fa5da994e6c9f3582df4542d276" candidate_uuid: "60d4538b78b44201964cf440ea562c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56388bef1a0f453cadc8b6aa9434311d" is_pre_election: true
I20260810 01:56:21.226009 27006 raft_consensus.cc:2468] T 059c8fa5da994e6c9f3582df4542d276 P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60d4538b78b44201964cf440ea562c72 in term 0.
I20260810 01:56:21.226552 26744 leader_election.cc:304] T 059c8fa5da994e6c9f3582df4542d276 P 60d4538b78b44201964cf440ea562c72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 56388bef1a0f453cadc8b6aa9434311d, 60d4538b78b44201964cf440ea562c72; no voters:
I20260810 01:56:21.226918 27858 raft_consensus.cc:2804] T 059c8fa5da994e6c9f3582df4542d276 P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:56:21.227069 27858 raft_consensus.cc:493] T 059c8fa5da994e6c9f3582df4542d276 P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:56:21.227219 27858 raft_consensus.cc:3060] T 059c8fa5da994e6c9f3582df4542d276 P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:56:21.229542 27858 raft_consensus.cc:515] T 059c8fa5da994e6c9f3582df4542d276 P 60d4538b78b44201964cf440ea562c72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } }
I20260810 01:56:21.230168 27858 leader_election.cc:290] T 059c8fa5da994e6c9f3582df4542d276 P 60d4538b78b44201964cf440ea562c72 [CANDIDATE]: Term 1 election: Requested vote from peers 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195:45355)
I20260810 01:56:21.230752 27006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059c8fa5da994e6c9f3582df4542d276" candidate_uuid: "60d4538b78b44201964cf440ea562c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56388bef1a0f453cadc8b6aa9434311d"
I20260810 01:56:21.230989 27006 raft_consensus.cc:3060] T 059c8fa5da994e6c9f3582df4542d276 P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:56:21.233049 27006 raft_consensus.cc:2468] T 059c8fa5da994e6c9f3582df4542d276 P 56388bef1a0f453cadc8b6aa9434311d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60d4538b78b44201964cf440ea562c72 in term 1.
I20260810 01:56:21.233507 26744 leader_election.cc:304] T 059c8fa5da994e6c9f3582df4542d276 P 60d4538b78b44201964cf440ea562c72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 56388bef1a0f453cadc8b6aa9434311d, 60d4538b78b44201964cf440ea562c72; no voters:
I20260810 01:56:21.233817 27858 raft_consensus.cc:2804] T 059c8fa5da994e6c9f3582df4542d276 P 60d4538b78b44201964cf440ea562c72 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:56:21.234040 27858 raft_consensus.cc:697] T 059c8fa5da994e6c9f3582df4542d276 P 60d4538b78b44201964cf440ea562c72 [term 1 LEADER]: Becoming Leader. State: Replica: 60d4538b78b44201964cf440ea562c72, State: Running, Role: LEADER
I20260810 01:56:21.234329 27858 consensus_queue.cc:237] T 059c8fa5da994e6c9f3582df4542d276 P 60d4538b78b44201964cf440ea562c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } }
I20260810 01:56:21.237160 26468 catalog_manager.cc:5719] T 059c8fa5da994e6c9f3582df4542d276 P 60d4538b78b44201964cf440ea562c72 reported cstate change: term changed from 0 to 1, leader changed from <none> to 60d4538b78b44201964cf440ea562c72 (127.21.64.194). New cstate: current_term: 1 leader_uuid: "60d4538b78b44201964cf440ea562c72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } }
I20260810 01:56:21.344496 27858 raft_consensus.cc:493] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:56:21.344704 27858 raft_consensus.cc:515] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } }
I20260810 01:56:21.345521 27858 leader_election.cc:290] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193:45781)
I20260810 01:56:21.346400 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72cec0deb794dac95b7a88308c56167" candidate_uuid: "60d4538b78b44201964cf440ea562c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" is_pre_election: true
I20260810 01:56:21.346675 26660 raft_consensus.cc:2468] T c72cec0deb794dac95b7a88308c56167 P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60d4538b78b44201964cf440ea562c72 in term 0.
I20260810 01:56:21.347234 26745 leader_election.cc:304] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 60d4538b78b44201964cf440ea562c72, a46364d7cd504f8ca7fc003c59ae6d31; no voters:
I20260810 01:56:21.347533 27858 raft_consensus.cc:2804] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:56:21.347671 27858 raft_consensus.cc:493] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:56:21.347800 27858 raft_consensus.cc:3060] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:56:21.349968 27858 raft_consensus.cc:515] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } }
I20260810 01:56:21.350492 27858 leader_election.cc:290] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72 [CANDIDATE]: Term 1 election: Requested vote from peers a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193:45781)
I20260810 01:56:21.351008 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72cec0deb794dac95b7a88308c56167" candidate_uuid: "60d4538b78b44201964cf440ea562c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46364d7cd504f8ca7fc003c59ae6d31"
I20260810 01:56:21.351220 26660 raft_consensus.cc:3060] T c72cec0deb794dac95b7a88308c56167 P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:56:21.354274 26660 raft_consensus.cc:2468] T c72cec0deb794dac95b7a88308c56167 P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60d4538b78b44201964cf440ea562c72 in term 1.
I20260810 01:56:21.354779 26745 leader_election.cc:304] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 60d4538b78b44201964cf440ea562c72, a46364d7cd504f8ca7fc003c59ae6d31; no voters:
I20260810 01:56:21.355115 27858 raft_consensus.cc:2804] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:56:21.355257 27858 raft_consensus.cc:697] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72 [term 1 LEADER]: Becoming Leader. State: Replica: 60d4538b78b44201964cf440ea562c72, State: Running, Role: LEADER
I20260810 01:56:21.355540 27858 consensus_queue.cc:237] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } }
I20260810 01:56:21.358383 26468 catalog_manager.cc:5719] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72 reported cstate change: term changed from 0 to 1, leader changed from <none> to 60d4538b78b44201964cf440ea562c72 (127.21.64.194). New cstate: current_term: 1 leader_uuid: "60d4538b78b44201964cf440ea562c72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } }
I20260810 01:56:21.553012 27858 consensus_queue.cc:1048] T 4403a36d26db47278a82abb5df118bbd P 60d4538b78b44201964cf440ea562c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 01:56:21.768231 27872 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:56:21.768596 27872 flags.cc:432] Enabled unsafe flag: --never_fsync=true
Using table 'rebalance_test_table_0'
I20260810 01:56:21.842710 27865 consensus_queue.cc:1048] T 059c8fa5da994e6c9f3582df4542d276 P 60d4538b78b44201964cf440ea562c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:56:21.886991 27858 consensus_queue.cc:1048] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 178.091 ms
time per row: 0.0890457 ms
I20260810 01:56:22.160043 26468 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53804:
name: "rebalance_test_table_1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 2
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260810 01:56:22.169629 26634 tablet_service.cc:1511] Processing CreateTablet for tablet b10c8ac173fc40ca9817d1b654117ca1 (DEFAULT_TABLE table=rebalance_test_table_1 [id=bdbf5b2bb6b04aa9baa11723c241453d]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:56:22.170096 26634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b10c8ac173fc40ca9817d1b654117ca1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:56:22.170029 26976 tablet_service.cc:1511] Processing CreateTablet for tablet b10c8ac173fc40ca9817d1b654117ca1 (DEFAULT_TABLE table=rebalance_test_table_1 [id=bdbf5b2bb6b04aa9baa11723c241453d]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:56:22.170495 26976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b10c8ac173fc40ca9817d1b654117ca1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:56:22.171444 26974 tablet_service.cc:1511] Processing CreateTablet for tablet 127b90e3636b4715b441964a1c43afc1 (DEFAULT_TABLE table=rebalance_test_table_1 [id=bdbf5b2bb6b04aa9baa11723c241453d]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:56:22.172005 26974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 127b90e3636b4715b441964a1c43afc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:56:22.174053 26973 tablet_service.cc:1511] Processing CreateTablet for tablet fdf1cc811a8349efa251d05e9b077fad (DEFAULT_TABLE table=rebalance_test_table_1 [id=bdbf5b2bb6b04aa9baa11723c241453d]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:56:22.174397 26806 tablet_service.cc:1511] Processing CreateTablet for tablet 127b90e3636b4715b441964a1c43afc1 (DEFAULT_TABLE table=rebalance_test_table_1 [id=bdbf5b2bb6b04aa9baa11723c241453d]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:56:22.174631 26973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdf1cc811a8349efa251d05e9b077fad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:56:22.174839 26806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 127b90e3636b4715b441964a1c43afc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:56:22.175239 26633 tablet_service.cc:1511] Processing CreateTablet for tablet fdf1cc811a8349efa251d05e9b077fad (DEFAULT_TABLE table=rebalance_test_table_1 [id=bdbf5b2bb6b04aa9baa11723c241453d]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:56:22.175606 26633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdf1cc811a8349efa251d05e9b077fad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:56:22.183161 27946 tablet_bootstrap.cc:492] T 127b90e3636b4715b441964a1c43afc1 P 60d4538b78b44201964cf440ea562c72: Bootstrap starting.
I20260810 01:56:22.187237 27946 tablet_bootstrap.cc:654] T 127b90e3636b4715b441964a1c43afc1 P 60d4538b78b44201964cf440ea562c72: Neither blocks nor log segments found. Creating new log.
I20260810 01:56:22.189455 27944 tablet_bootstrap.cc:492] T 127b90e3636b4715b441964a1c43afc1 P 56388bef1a0f453cadc8b6aa9434311d: Bootstrap starting.
I20260810 01:56:22.191020 27944 tablet_bootstrap.cc:654] T 127b90e3636b4715b441964a1c43afc1 P 56388bef1a0f453cadc8b6aa9434311d: Neither blocks nor log segments found. Creating new log.
I20260810 01:56:22.191887 27946 tablet_bootstrap.cc:492] T 127b90e3636b4715b441964a1c43afc1 P 60d4538b78b44201964cf440ea562c72: No bootstrap required, opened a new log
I20260810 01:56:22.192103 27946 ts_tablet_manager.cc:1403] T 127b90e3636b4715b441964a1c43afc1 P 60d4538b78b44201964cf440ea562c72: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s
I20260810 01:56:22.192785 27947 tablet_bootstrap.cc:492] T b10c8ac173fc40ca9817d1b654117ca1 P a46364d7cd504f8ca7fc003c59ae6d31: Bootstrap starting.
I20260810 01:56:22.193153 27946 raft_consensus.cc:359] T 127b90e3636b4715b441964a1c43afc1 P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } }
I20260810 01:56:22.193348 27946 raft_consensus.cc:385] T 127b90e3636b4715b441964a1c43afc1 P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:56:22.193415 27944 tablet_bootstrap.cc:492] T 127b90e3636b4715b441964a1c43afc1 P 56388bef1a0f453cadc8b6aa9434311d: No bootstrap required, opened a new log
I20260810 01:56:22.193619 27944 ts_tablet_manager.cc:1403] T 127b90e3636b4715b441964a1c43afc1 P 56388bef1a0f453cadc8b6aa9434311d: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.001s
I20260810 01:56:22.194267 27944 raft_consensus.cc:359] T 127b90e3636b4715b441964a1c43afc1 P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } }
I20260810 01:56:22.194432 27944 raft_consensus.cc:385] T 127b90e3636b4715b441964a1c43afc1 P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:56:22.194530 27944 raft_consensus.cc:740] T 127b90e3636b4715b441964a1c43afc1 P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56388bef1a0f453cadc8b6aa9434311d, State: Initialized, Role: FOLLOWER
I20260810 01:56:22.194662 27946 raft_consensus.cc:740] T 127b90e3636b4715b441964a1c43afc1 P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d4538b78b44201964cf440ea562c72, State: Initialized, Role: FOLLOWER
I20260810 01:56:22.194829 27944 consensus_queue.cc:260] T 127b90e3636b4715b441964a1c43afc1 P 56388bef1a0f453cadc8b6aa9434311d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } }
I20260810 01:56:22.194983 27946 consensus_queue.cc:260] T 127b90e3636b4715b441964a1c43afc1 P 60d4538b78b44201964cf440ea562c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } }
I20260810 01:56:22.195636 27946 ts_tablet_manager.cc:1434] T 127b90e3636b4715b441964a1c43afc1 P 60d4538b78b44201964cf440ea562c72: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260810 01:56:22.195920 27947 tablet_bootstrap.cc:654] T b10c8ac173fc40ca9817d1b654117ca1 P a46364d7cd504f8ca7fc003c59ae6d31: Neither blocks nor log segments found. Creating new log.
I20260810 01:56:22.196086 27944 ts_tablet_manager.cc:1434] T 127b90e3636b4715b441964a1c43afc1 P 56388bef1a0f453cadc8b6aa9434311d: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 01:56:22.196375 27944 tablet_bootstrap.cc:492] T fdf1cc811a8349efa251d05e9b077fad P 56388bef1a0f453cadc8b6aa9434311d: Bootstrap starting.
I20260810 01:56:22.198545 27947 tablet_bootstrap.cc:492] T b10c8ac173fc40ca9817d1b654117ca1 P a46364d7cd504f8ca7fc003c59ae6d31: No bootstrap required, opened a new log
I20260810 01:56:22.198732 27947 ts_tablet_manager.cc:1403] T b10c8ac173fc40ca9817d1b654117ca1 P a46364d7cd504f8ca7fc003c59ae6d31: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 01:56:22.198832 27944 tablet_bootstrap.cc:654] T fdf1cc811a8349efa251d05e9b077fad P 56388bef1a0f453cadc8b6aa9434311d: Neither blocks nor log segments found. Creating new log.
I20260810 01:56:22.200682 27947 raft_consensus.cc:359] T b10c8ac173fc40ca9817d1b654117ca1 P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } }
I20260810 01:56:22.200941 27947 raft_consensus.cc:385] T b10c8ac173fc40ca9817d1b654117ca1 P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:56:22.201078 27947 raft_consensus.cc:740] T b10c8ac173fc40ca9817d1b654117ca1 P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46364d7cd504f8ca7fc003c59ae6d31, State: Initialized, Role: FOLLOWER
I20260810 01:56:22.201387 27947 consensus_queue.cc:260] T b10c8ac173fc40ca9817d1b654117ca1 P a46364d7cd504f8ca7fc003c59ae6d31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } }
I20260810 01:56:22.201954 27947 ts_tablet_manager.cc:1434] T b10c8ac173fc40ca9817d1b654117ca1 P a46364d7cd504f8ca7fc003c59ae6d31: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260810 01:56:22.202260 27947 tablet_bootstrap.cc:492] T fdf1cc811a8349efa251d05e9b077fad P a46364d7cd504f8ca7fc003c59ae6d31: Bootstrap starting.
I20260810 01:56:22.204008 27947 tablet_bootstrap.cc:654] T fdf1cc811a8349efa251d05e9b077fad P a46364d7cd504f8ca7fc003c59ae6d31: Neither blocks nor log segments found. Creating new log.
I20260810 01:56:22.206729 27947 tablet_bootstrap.cc:492] T fdf1cc811a8349efa251d05e9b077fad P a46364d7cd504f8ca7fc003c59ae6d31: No bootstrap required, opened a new log
I20260810 01:56:22.206845 27944 tablet_bootstrap.cc:492] T fdf1cc811a8349efa251d05e9b077fad P 56388bef1a0f453cadc8b6aa9434311d: No bootstrap required, opened a new log
I20260810 01:56:22.207010 27944 ts_tablet_manager.cc:1403] T fdf1cc811a8349efa251d05e9b077fad P 56388bef1a0f453cadc8b6aa9434311d: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.006s
I20260810 01:56:22.207057 27947 ts_tablet_manager.cc:1403] T fdf1cc811a8349efa251d05e9b077fad P a46364d7cd504f8ca7fc003c59ae6d31: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260810 01:56:22.207849 27944 raft_consensus.cc:359] T fdf1cc811a8349efa251d05e9b077fad P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } }
I20260810 01:56:22.207839 27947 raft_consensus.cc:359] T fdf1cc811a8349efa251d05e9b077fad P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } }
I20260810 01:56:22.208053 27947 raft_consensus.cc:385] T fdf1cc811a8349efa251d05e9b077fad P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:56:22.208041 27944 raft_consensus.cc:385] T fdf1cc811a8349efa251d05e9b077fad P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:56:22.208140 27947 raft_consensus.cc:740] T fdf1cc811a8349efa251d05e9b077fad P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46364d7cd504f8ca7fc003c59ae6d31, State: Initialized, Role: FOLLOWER
I20260810 01:56:22.208140 27944 raft_consensus.cc:740] T fdf1cc811a8349efa251d05e9b077fad P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56388bef1a0f453cadc8b6aa9434311d, State: Initialized, Role: FOLLOWER
I20260810 01:56:22.208384 27947 consensus_queue.cc:260] T fdf1cc811a8349efa251d05e9b077fad P a46364d7cd504f8ca7fc003c59ae6d31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } }
I20260810 01:56:22.208384 27944 consensus_queue.cc:260] T fdf1cc811a8349efa251d05e9b077fad P 56388bef1a0f453cadc8b6aa9434311d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } }
I20260810 01:56:22.208849 27947 ts_tablet_manager.cc:1434] T fdf1cc811a8349efa251d05e9b077fad P a46364d7cd504f8ca7fc003c59ae6d31: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 01:56:22.208849 27944 ts_tablet_manager.cc:1434] T fdf1cc811a8349efa251d05e9b077fad P 56388bef1a0f453cadc8b6aa9434311d: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 01:56:22.209149 27944 tablet_bootstrap.cc:492] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d: Bootstrap starting.
I20260810 01:56:22.210587 27944 tablet_bootstrap.cc:654] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d: Neither blocks nor log segments found. Creating new log.
I20260810 01:56:22.213774 27944 tablet_bootstrap.cc:492] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d: No bootstrap required, opened a new log
I20260810 01:56:22.213915 27944 ts_tablet_manager.cc:1403] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260810 01:56:22.214532 27944 raft_consensus.cc:359] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } }
I20260810 01:56:22.214661 27944 raft_consensus.cc:385] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:56:22.214776 27944 raft_consensus.cc:740] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56388bef1a0f453cadc8b6aa9434311d, State: Initialized, Role: FOLLOWER
I20260810 01:56:22.215030 27944 consensus_queue.cc:260] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } }
I20260810 01:56:22.215502 27944 ts_tablet_manager.cc:1434] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260810 01:56:22.233647 27839 raft_consensus.cc:493] T fdf1cc811a8349efa251d05e9b077fad P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:56:22.233862 27839 raft_consensus.cc:515] T fdf1cc811a8349efa251d05e9b077fad P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } }
I20260810 01:56:22.234583 27839 leader_election.cc:290] T fdf1cc811a8349efa251d05e9b077fad P a46364d7cd504f8ca7fc003c59ae6d31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195:45355)
I20260810 01:56:22.235172 27006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf1cc811a8349efa251d05e9b077fad" candidate_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56388bef1a0f453cadc8b6aa9434311d" is_pre_election: true
I20260810 01:56:22.235381 27006 raft_consensus.cc:2468] T fdf1cc811a8349efa251d05e9b077fad P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46364d7cd504f8ca7fc003c59ae6d31 in term 0.
I20260810 01:56:22.235850 26576 leader_election.cc:304] T fdf1cc811a8349efa251d05e9b077fad P a46364d7cd504f8ca7fc003c59ae6d31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 56388bef1a0f453cadc8b6aa9434311d, a46364d7cd504f8ca7fc003c59ae6d31; no voters:
I20260810 01:56:22.236186 27839 raft_consensus.cc:2804] T fdf1cc811a8349efa251d05e9b077fad P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:56:22.236313 27839 raft_consensus.cc:493] T fdf1cc811a8349efa251d05e9b077fad P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:56:22.236413 27839 raft_consensus.cc:3060] T fdf1cc811a8349efa251d05e9b077fad P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:56:22.238667 27839 raft_consensus.cc:515] T fdf1cc811a8349efa251d05e9b077fad P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } }
I20260810 01:56:22.239204 27839 leader_election.cc:290] T fdf1cc811a8349efa251d05e9b077fad P a46364d7cd504f8ca7fc003c59ae6d31 [CANDIDATE]: Term 1 election: Requested vote from peers 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195:45355)
I20260810 01:56:22.239806 27006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf1cc811a8349efa251d05e9b077fad" candidate_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56388bef1a0f453cadc8b6aa9434311d"
I20260810 01:56:22.240037 27006 raft_consensus.cc:3060] T fdf1cc811a8349efa251d05e9b077fad P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:56:22.242288 27006 raft_consensus.cc:2468] T fdf1cc811a8349efa251d05e9b077fad P 56388bef1a0f453cadc8b6aa9434311d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46364d7cd504f8ca7fc003c59ae6d31 in term 1.
I20260810 01:56:22.242792 26576 leader_election.cc:304] T fdf1cc811a8349efa251d05e9b077fad P a46364d7cd504f8ca7fc003c59ae6d31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 56388bef1a0f453cadc8b6aa9434311d, a46364d7cd504f8ca7fc003c59ae6d31; no voters:
I20260810 01:56:22.243127 27839 raft_consensus.cc:2804] T fdf1cc811a8349efa251d05e9b077fad P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:56:22.243605 27839 raft_consensus.cc:697] T fdf1cc811a8349efa251d05e9b077fad P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 LEADER]: Becoming Leader. State: Replica: a46364d7cd504f8ca7fc003c59ae6d31, State: Running, Role: LEADER
I20260810 01:56:22.243938 27839 consensus_queue.cc:237] T fdf1cc811a8349efa251d05e9b077fad P a46364d7cd504f8ca7fc003c59ae6d31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } }
I20260810 01:56:22.246778 26470 catalog_manager.cc:5719] T fdf1cc811a8349efa251d05e9b077fad P a46364d7cd504f8ca7fc003c59ae6d31 reported cstate change: term changed from 0 to 1, leader changed from <none> to a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193). New cstate: current_term: 1 leader_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } }
I20260810 01:56:22.256362 27904 raft_consensus.cc:493] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:56:22.256628 27904 raft_consensus.cc:515] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } }
I20260810 01:56:22.258193 27904 leader_election.cc:290] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193:45781)
I20260810 01:56:22.265057 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b10c8ac173fc40ca9817d1b654117ca1" candidate_uuid: "56388bef1a0f453cadc8b6aa9434311d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" is_pre_election: true
I20260810 01:56:22.265298 26660 raft_consensus.cc:2468] T b10c8ac173fc40ca9817d1b654117ca1 P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56388bef1a0f453cadc8b6aa9434311d in term 0.
I20260810 01:56:22.265929 26914 leader_election.cc:304] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 56388bef1a0f453cadc8b6aa9434311d, a46364d7cd504f8ca7fc003c59ae6d31; no voters:
I20260810 01:56:22.266343 27904 raft_consensus.cc:2804] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:56:22.266505 27904 raft_consensus.cc:493] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:56:22.266603 27904 raft_consensus.cc:3060] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:56:22.268998 27904 raft_consensus.cc:515] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } }
I20260810 01:56:22.269538 27904 leader_election.cc:290] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d [CANDIDATE]: Term 1 election: Requested vote from peers a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193:45781)
I20260810 01:56:22.270151 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b10c8ac173fc40ca9817d1b654117ca1" candidate_uuid: "56388bef1a0f453cadc8b6aa9434311d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46364d7cd504f8ca7fc003c59ae6d31"
I20260810 01:56:22.270354 26660 raft_consensus.cc:3060] T b10c8ac173fc40ca9817d1b654117ca1 P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:56:22.272316 26660 raft_consensus.cc:2468] T b10c8ac173fc40ca9817d1b654117ca1 P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56388bef1a0f453cadc8b6aa9434311d in term 1.
I20260810 01:56:22.272802 26914 leader_election.cc:304] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 56388bef1a0f453cadc8b6aa9434311d, a46364d7cd504f8ca7fc003c59ae6d31; no voters:
I20260810 01:56:22.273120 27904 raft_consensus.cc:2804] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:56:22.273782 27904 raft_consensus.cc:697] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d [term 1 LEADER]: Becoming Leader. State: Replica: 56388bef1a0f453cadc8b6aa9434311d, State: Running, Role: LEADER
I20260810 01:56:22.274322 27904 consensus_queue.cc:237] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } }
I20260810 01:56:22.277518 26470 catalog_manager.cc:5719] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d reported cstate change: term changed from 0 to 1, leader changed from <none> to 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195). New cstate: current_term: 1 leader_uuid: "56388bef1a0f453cadc8b6aa9434311d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } }
I20260810 01:56:22.595788 27904 raft_consensus.cc:493] T 127b90e3636b4715b441964a1c43afc1 P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:56:22.596050 27904 raft_consensus.cc:515] T 127b90e3636b4715b441964a1c43afc1 P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } }
I20260810 01:56:22.596761 27904 leader_election.cc:290] T 127b90e3636b4715b441964a1c43afc1 P 56388bef1a0f453cadc8b6aa9434311d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60d4538b78b44201964cf440ea562c72 (127.21.64.194:36943)
I20260810 01:56:22.602766 26833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "127b90e3636b4715b441964a1c43afc1" candidate_uuid: "56388bef1a0f453cadc8b6aa9434311d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d4538b78b44201964cf440ea562c72" is_pre_election: true
I20260810 01:56:22.603127 26833 raft_consensus.cc:2468] T 127b90e3636b4715b441964a1c43afc1 P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56388bef1a0f453cadc8b6aa9434311d in term 0.
I20260810 01:56:22.603672 26910 leader_election.cc:304] T 127b90e3636b4715b441964a1c43afc1 P 56388bef1a0f453cadc8b6aa9434311d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 56388bef1a0f453cadc8b6aa9434311d, 60d4538b78b44201964cf440ea562c72; no voters:
I20260810 01:56:22.604066 27904 raft_consensus.cc:2804] T 127b90e3636b4715b441964a1c43afc1 P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:56:22.604193 27904 raft_consensus.cc:493] T 127b90e3636b4715b441964a1c43afc1 P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:56:22.604339 27904 raft_consensus.cc:3060] T 127b90e3636b4715b441964a1c43afc1 P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:56:22.606395 27904 raft_consensus.cc:515] T 127b90e3636b4715b441964a1c43afc1 P 56388bef1a0f453cadc8b6aa9434311d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } }
I20260810 01:56:22.606886 27904 leader_election.cc:290] T 127b90e3636b4715b441964a1c43afc1 P 56388bef1a0f453cadc8b6aa9434311d [CANDIDATE]: Term 1 election: Requested vote from peers 60d4538b78b44201964cf440ea562c72 (127.21.64.194:36943)
I20260810 01:56:22.607404 26833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "127b90e3636b4715b441964a1c43afc1" candidate_uuid: "56388bef1a0f453cadc8b6aa9434311d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d4538b78b44201964cf440ea562c72"
I20260810 01:56:22.607613 26833 raft_consensus.cc:3060] T 127b90e3636b4715b441964a1c43afc1 P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:56:22.609717 26833 raft_consensus.cc:2468] T 127b90e3636b4715b441964a1c43afc1 P 60d4538b78b44201964cf440ea562c72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56388bef1a0f453cadc8b6aa9434311d in term 1.
I20260810 01:56:22.610141 26910 leader_election.cc:304] T 127b90e3636b4715b441964a1c43afc1 P 56388bef1a0f453cadc8b6aa9434311d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 56388bef1a0f453cadc8b6aa9434311d, 60d4538b78b44201964cf440ea562c72; no voters:
I20260810 01:56:22.610538 27904 raft_consensus.cc:2804] T 127b90e3636b4715b441964a1c43afc1 P 56388bef1a0f453cadc8b6aa9434311d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:56:22.610721 27904 raft_consensus.cc:697] T 127b90e3636b4715b441964a1c43afc1 P 56388bef1a0f453cadc8b6aa9434311d [term 1 LEADER]: Becoming Leader. State: Replica: 56388bef1a0f453cadc8b6aa9434311d, State: Running, Role: LEADER
I20260810 01:56:22.610991 27904 consensus_queue.cc:237] T 127b90e3636b4715b441964a1c43afc1 P 56388bef1a0f453cadc8b6aa9434311d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } }
I20260810 01:56:22.613695 26470 catalog_manager.cc:5719] T 127b90e3636b4715b441964a1c43afc1 P 56388bef1a0f453cadc8b6aa9434311d reported cstate change: term changed from 0 to 1, leader changed from <none> to 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195). New cstate: current_term: 1 leader_uuid: "56388bef1a0f453cadc8b6aa9434311d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } }
I20260810 01:56:22.683899 27839 consensus_queue.cc:1048] T fdf1cc811a8349efa251d05e9b077fad P a46364d7cd504f8ca7fc003c59ae6d31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:56:22.843977 27904 consensus_queue.cc:1048] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 01:56:23.006606 27965 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:56:23.007078 27965 flags.cc:432] Enabled unsafe flag: --never_fsync=true
Using table 'rebalance_test_table_1'
I20260810 01:56:23.183352 26833 raft_consensus.cc:1275] T 127b90e3636b4715b441964a1c43afc1 P 60d4538b78b44201964cf440ea562c72 [term 1 FOLLOWER]: Refusing update from remote peer 56388bef1a0f453cadc8b6aa9434311d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:56:23.185878 27904 consensus_queue.cc:1048] T 127b90e3636b4715b441964a1c43afc1 P 56388bef1a0f453cadc8b6aa9434311d [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:56:23.200718 28008 mvcc.cc:204] Tried to move back new op lower bound from 7316795323108220928 to 7316795320776146944. Current Snapshot: MvccSnapshot[applied={T|T < 7316795323108220928}]
I20260810 01:56:23.209481 28011 mvcc.cc:204] Tried to move back new op lower bound from 7316795323108220928 to 7316795320776146944. Current Snapshot: MvccSnapshot[applied={T|T < 7316795323108220928}]
INSERT report
rows total: 2000
time total: 202.294 ms
time per row: 0.101147 ms
I20260810 01:56:23.385291 26470 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53804:
name: "rebalance_test_table_2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 2
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260810 01:56:23.396023 26634 tablet_service.cc:1511] Processing CreateTablet for tablet d76ed7c57001495fb62e15bd9f14a162 (DEFAULT_TABLE table=rebalance_test_table_2 [id=e4e97ceec9a145e095f04aa5c373d684]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:56:23.396368 26806 tablet_service.cc:1511] Processing CreateTablet for tablet d76ed7c57001495fb62e15bd9f14a162 (DEFAULT_TABLE table=rebalance_test_table_2 [id=e4e97ceec9a145e095f04aa5c373d684]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:56:23.396615 26634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d76ed7c57001495fb62e15bd9f14a162. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:56:23.396870 26806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d76ed7c57001495fb62e15bd9f14a162. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:56:23.397742 26974 tablet_service.cc:1511] Processing CreateTablet for tablet 40f41d25879b4c58ade48978afadf2ef (DEFAULT_TABLE table=rebalance_test_table_2 [id=e4e97ceec9a145e095f04aa5c373d684]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:56:23.398051 26633 tablet_service.cc:1511] Processing CreateTablet for tablet 39a14ec9527d43b4a6f78b48ad4165cf (DEFAULT_TABLE table=rebalance_test_table_2 [id=e4e97ceec9a145e095f04aa5c373d684]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:56:23.398180 26974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40f41d25879b4c58ade48978afadf2ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:56:23.398465 26633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39a14ec9527d43b4a6f78b48ad4165cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:56:23.405292 26807 tablet_service.cc:1511] Processing CreateTablet for tablet 40f41d25879b4c58ade48978afadf2ef (DEFAULT_TABLE table=rebalance_test_table_2 [id=e4e97ceec9a145e095f04aa5c373d684]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:56:23.405869 26807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40f41d25879b4c58ade48978afadf2ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:56:23.410205 28034 tablet_bootstrap.cc:492] T d76ed7c57001495fb62e15bd9f14a162 P a46364d7cd504f8ca7fc003c59ae6d31: Bootstrap starting.
I20260810 01:56:23.410897 28033 tablet_bootstrap.cc:492] T d76ed7c57001495fb62e15bd9f14a162 P 60d4538b78b44201964cf440ea562c72: Bootstrap starting.
I20260810 01:56:23.411273 26805 tablet_service.cc:1511] Processing CreateTablet for tablet 39a14ec9527d43b4a6f78b48ad4165cf (DEFAULT_TABLE table=rebalance_test_table_2 [id=e4e97ceec9a145e095f04aa5c373d684]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:56:23.411734 26805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39a14ec9527d43b4a6f78b48ad4165cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:56:23.412366 28034 tablet_bootstrap.cc:654] T d76ed7c57001495fb62e15bd9f14a162 P a46364d7cd504f8ca7fc003c59ae6d31: Neither blocks nor log segments found. Creating new log.
I20260810 01:56:23.412990 28033 tablet_bootstrap.cc:654] T d76ed7c57001495fb62e15bd9f14a162 P 60d4538b78b44201964cf440ea562c72: Neither blocks nor log segments found. Creating new log.
I20260810 01:56:23.415001 28034 tablet_bootstrap.cc:492] T d76ed7c57001495fb62e15bd9f14a162 P a46364d7cd504f8ca7fc003c59ae6d31: No bootstrap required, opened a new log
I20260810 01:56:23.415221 28034 ts_tablet_manager.cc:1403] T d76ed7c57001495fb62e15bd9f14a162 P a46364d7cd504f8ca7fc003c59ae6d31: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260810 01:56:23.417313 28034 raft_consensus.cc:359] T d76ed7c57001495fb62e15bd9f14a162 P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } }
I20260810 01:56:23.417606 28034 raft_consensus.cc:385] T d76ed7c57001495fb62e15bd9f14a162 P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:56:23.417757 28034 raft_consensus.cc:740] T d76ed7c57001495fb62e15bd9f14a162 P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46364d7cd504f8ca7fc003c59ae6d31, State: Initialized, Role: FOLLOWER
I20260810 01:56:23.418097 28034 consensus_queue.cc:260] T d76ed7c57001495fb62e15bd9f14a162 P a46364d7cd504f8ca7fc003c59ae6d31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } }
I20260810 01:56:23.418785 28034 ts_tablet_manager.cc:1434] T d76ed7c57001495fb62e15bd9f14a162 P a46364d7cd504f8ca7fc003c59ae6d31: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 01:56:23.419116 28039 tablet_bootstrap.cc:492] T 40f41d25879b4c58ade48978afadf2ef P 56388bef1a0f453cadc8b6aa9434311d: Bootstrap starting.
I20260810 01:56:23.419167 28034 tablet_bootstrap.cc:492] T 39a14ec9527d43b4a6f78b48ad4165cf P a46364d7cd504f8ca7fc003c59ae6d31: Bootstrap starting.
I20260810 01:56:23.420864 28033 tablet_bootstrap.cc:492] T d76ed7c57001495fb62e15bd9f14a162 P 60d4538b78b44201964cf440ea562c72: No bootstrap required, opened a new log
I20260810 01:56:23.421075 28033 ts_tablet_manager.cc:1403] T d76ed7c57001495fb62e15bd9f14a162 P 60d4538b78b44201964cf440ea562c72: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.008s
I20260810 01:56:23.421808 28034 tablet_bootstrap.cc:654] T 39a14ec9527d43b4a6f78b48ad4165cf P a46364d7cd504f8ca7fc003c59ae6d31: Neither blocks nor log segments found. Creating new log.
I20260810 01:56:23.421909 28039 tablet_bootstrap.cc:654] T 40f41d25879b4c58ade48978afadf2ef P 56388bef1a0f453cadc8b6aa9434311d: Neither blocks nor log segments found. Creating new log.
I20260810 01:56:23.422106 28033 raft_consensus.cc:359] T d76ed7c57001495fb62e15bd9f14a162 P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } }
I20260810 01:56:23.422374 28033 raft_consensus.cc:385] T d76ed7c57001495fb62e15bd9f14a162 P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:56:23.422554 28033 raft_consensus.cc:740] T d76ed7c57001495fb62e15bd9f14a162 P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d4538b78b44201964cf440ea562c72, State: Initialized, Role: FOLLOWER
I20260810 01:56:23.422907 28033 consensus_queue.cc:260] T d76ed7c57001495fb62e15bd9f14a162 P 60d4538b78b44201964cf440ea562c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } }
I20260810 01:56:23.423765 28033 ts_tablet_manager.cc:1434] T d76ed7c57001495fb62e15bd9f14a162 P 60d4538b78b44201964cf440ea562c72: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:56:23.424096 28033 tablet_bootstrap.cc:492] T 40f41d25879b4c58ade48978afadf2ef P 60d4538b78b44201964cf440ea562c72: Bootstrap starting.
I20260810 01:56:23.425961 28033 tablet_bootstrap.cc:654] T 40f41d25879b4c58ade48978afadf2ef P 60d4538b78b44201964cf440ea562c72: Neither blocks nor log segments found. Creating new log.
I20260810 01:56:23.433465 28034 tablet_bootstrap.cc:492] T 39a14ec9527d43b4a6f78b48ad4165cf P a46364d7cd504f8ca7fc003c59ae6d31: No bootstrap required, opened a new log
I20260810 01:56:23.433513 28033 tablet_bootstrap.cc:492] T 40f41d25879b4c58ade48978afadf2ef P 60d4538b78b44201964cf440ea562c72: No bootstrap required, opened a new log
I20260810 01:56:23.433550 28039 tablet_bootstrap.cc:492] T 40f41d25879b4c58ade48978afadf2ef P 56388bef1a0f453cadc8b6aa9434311d: No bootstrap required, opened a new log
I20260810 01:56:23.433681 28034 ts_tablet_manager.cc:1403] T 39a14ec9527d43b4a6f78b48ad4165cf P a46364d7cd504f8ca7fc003c59ae6d31: Time spent bootstrapping tablet: real 0.015s user 0.008s sys 0.005s
I20260810 01:56:23.433684 28033 ts_tablet_manager.cc:1403] T 40f41d25879b4c58ade48978afadf2ef P 60d4538b78b44201964cf440ea562c72: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.003s
I20260810 01:56:23.433759 28039 ts_tablet_manager.cc:1403] T 40f41d25879b4c58ade48978afadf2ef P 56388bef1a0f453cadc8b6aa9434311d: Time spent bootstrapping tablet: real 0.015s user 0.009s sys 0.004s
I20260810 01:56:23.434438 28034 raft_consensus.cc:359] T 39a14ec9527d43b4a6f78b48ad4165cf P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } }
I20260810 01:56:23.434676 28034 raft_consensus.cc:385] T 39a14ec9527d43b4a6f78b48ad4165cf P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:56:23.434592 28033 raft_consensus.cc:359] T 40f41d25879b4c58ade48978afadf2ef P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } }
I20260810 01:56:23.434799 28034 raft_consensus.cc:740] T 39a14ec9527d43b4a6f78b48ad4165cf P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46364d7cd504f8ca7fc003c59ae6d31, State: Initialized, Role: FOLLOWER
I20260810 01:56:23.434823 28033 raft_consensus.cc:385] T 40f41d25879b4c58ade48978afadf2ef P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:56:23.434736 28039 raft_consensus.cc:359] T 40f41d25879b4c58ade48978afadf2ef P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } }
I20260810 01:56:23.434891 28033 raft_consensus.cc:740] T 40f41d25879b4c58ade48978afadf2ef P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d4538b78b44201964cf440ea562c72, State: Initialized, Role: FOLLOWER
I20260810 01:56:23.434965 28039 raft_consensus.cc:385] T 40f41d25879b4c58ade48978afadf2ef P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:56:23.435166 28039 raft_consensus.cc:740] T 40f41d25879b4c58ade48978afadf2ef P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56388bef1a0f453cadc8b6aa9434311d, State: Initialized, Role: FOLLOWER
I20260810 01:56:23.435139 28034 consensus_queue.cc:260] T 39a14ec9527d43b4a6f78b48ad4165cf P a46364d7cd504f8ca7fc003c59ae6d31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } }
I20260810 01:56:23.435175 28033 consensus_queue.cc:260] T 40f41d25879b4c58ade48978afadf2ef P 60d4538b78b44201964cf440ea562c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } }
I20260810 01:56:23.435429 28039 consensus_queue.cc:260] T 40f41d25879b4c58ade48978afadf2ef P 56388bef1a0f453cadc8b6aa9434311d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } }
I20260810 01:56:23.435943 28033 ts_tablet_manager.cc:1434] T 40f41d25879b4c58ade48978afadf2ef P 60d4538b78b44201964cf440ea562c72: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:56:23.435982 28039 ts_tablet_manager.cc:1434] T 40f41d25879b4c58ade48978afadf2ef P 56388bef1a0f453cadc8b6aa9434311d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 01:56:23.436312 28033 tablet_bootstrap.cc:492] T 39a14ec9527d43b4a6f78b48ad4165cf P 60d4538b78b44201964cf440ea562c72: Bootstrap starting.
I20260810 01:56:23.437036 28034 ts_tablet_manager.cc:1434] T 39a14ec9527d43b4a6f78b48ad4165cf P a46364d7cd504f8ca7fc003c59ae6d31: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 01:56:23.438177 28033 tablet_bootstrap.cc:654] T 39a14ec9527d43b4a6f78b48ad4165cf P 60d4538b78b44201964cf440ea562c72: Neither blocks nor log segments found. Creating new log.
I20260810 01:56:23.440783 28033 tablet_bootstrap.cc:492] T 39a14ec9527d43b4a6f78b48ad4165cf P 60d4538b78b44201964cf440ea562c72: No bootstrap required, opened a new log
I20260810 01:56:23.440963 28033 ts_tablet_manager.cc:1403] T 39a14ec9527d43b4a6f78b48ad4165cf P 60d4538b78b44201964cf440ea562c72: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260810 01:56:23.441798 28033 raft_consensus.cc:359] T 39a14ec9527d43b4a6f78b48ad4165cf P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } }
I20260810 01:56:23.442021 28033 raft_consensus.cc:385] T 39a14ec9527d43b4a6f78b48ad4165cf P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:56:23.442148 28033 raft_consensus.cc:740] T 39a14ec9527d43b4a6f78b48ad4165cf P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d4538b78b44201964cf440ea562c72, State: Initialized, Role: FOLLOWER
I20260810 01:56:23.442441 28033 consensus_queue.cc:260] T 39a14ec9527d43b4a6f78b48ad4165cf P 60d4538b78b44201964cf440ea562c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } }
I20260810 01:56:23.442963 28033 ts_tablet_manager.cc:1434] T 39a14ec9527d43b4a6f78b48ad4165cf P 60d4538b78b44201964cf440ea562c72: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:56:23.653021 28012 raft_consensus.cc:493] T 39a14ec9527d43b4a6f78b48ad4165cf P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:56:23.653267 28012 raft_consensus.cc:515] T 39a14ec9527d43b4a6f78b48ad4165cf P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } }
I20260810 01:56:23.654047 28012 leader_election.cc:290] T 39a14ec9527d43b4a6f78b48ad4165cf P a46364d7cd504f8ca7fc003c59ae6d31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60d4538b78b44201964cf440ea562c72 (127.21.64.194:36943)
I20260810 01:56:23.661087 26833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a14ec9527d43b4a6f78b48ad4165cf" candidate_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d4538b78b44201964cf440ea562c72" is_pre_election: true
I20260810 01:56:23.661353 26833 raft_consensus.cc:2468] T 39a14ec9527d43b4a6f78b48ad4165cf P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46364d7cd504f8ca7fc003c59ae6d31 in term 0.
I20260810 01:56:23.661972 26574 leader_election.cc:304] T 39a14ec9527d43b4a6f78b48ad4165cf P a46364d7cd504f8ca7fc003c59ae6d31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 60d4538b78b44201964cf440ea562c72, a46364d7cd504f8ca7fc003c59ae6d31; no voters:
I20260810 01:56:23.662317 28012 raft_consensus.cc:2804] T 39a14ec9527d43b4a6f78b48ad4165cf P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:56:23.662432 28012 raft_consensus.cc:493] T 39a14ec9527d43b4a6f78b48ad4165cf P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:56:23.662534 28012 raft_consensus.cc:3060] T 39a14ec9527d43b4a6f78b48ad4165cf P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:56:23.664587 28012 raft_consensus.cc:515] T 39a14ec9527d43b4a6f78b48ad4165cf P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } }
I20260810 01:56:23.665056 28012 leader_election.cc:290] T 39a14ec9527d43b4a6f78b48ad4165cf P a46364d7cd504f8ca7fc003c59ae6d31 [CANDIDATE]: Term 1 election: Requested vote from peers 60d4538b78b44201964cf440ea562c72 (127.21.64.194:36943)
I20260810 01:56:23.665745 26833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a14ec9527d43b4a6f78b48ad4165cf" candidate_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d4538b78b44201964cf440ea562c72"
I20260810 01:56:23.665932 26833 raft_consensus.cc:3060] T 39a14ec9527d43b4a6f78b48ad4165cf P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:56:23.668159 26833 raft_consensus.cc:2468] T 39a14ec9527d43b4a6f78b48ad4165cf P 60d4538b78b44201964cf440ea562c72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46364d7cd504f8ca7fc003c59ae6d31 in term 1.
I20260810 01:56:23.668633 26574 leader_election.cc:304] T 39a14ec9527d43b4a6f78b48ad4165cf P a46364d7cd504f8ca7fc003c59ae6d31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 60d4538b78b44201964cf440ea562c72, a46364d7cd504f8ca7fc003c59ae6d31; no voters:
I20260810 01:56:23.668936 28012 raft_consensus.cc:2804] T 39a14ec9527d43b4a6f78b48ad4165cf P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:56:23.669111 28012 raft_consensus.cc:697] T 39a14ec9527d43b4a6f78b48ad4165cf P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 LEADER]: Becoming Leader. State: Replica: a46364d7cd504f8ca7fc003c59ae6d31, State: Running, Role: LEADER
I20260810 01:56:23.669446 28012 consensus_queue.cc:237] T 39a14ec9527d43b4a6f78b48ad4165cf P a46364d7cd504f8ca7fc003c59ae6d31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } }
I20260810 01:56:23.672592 26470 catalog_manager.cc:5719] T 39a14ec9527d43b4a6f78b48ad4165cf P a46364d7cd504f8ca7fc003c59ae6d31 reported cstate change: term changed from 0 to 1, leader changed from <none> to a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193). New cstate: current_term: 1 leader_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } }
I20260810 01:56:23.701876 27865 raft_consensus.cc:493] T 40f41d25879b4c58ade48978afadf2ef P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:56:23.702107 27865 raft_consensus.cc:515] T 40f41d25879b4c58ade48978afadf2ef P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } }
I20260810 01:56:23.702721 27865 leader_election.cc:290] T 40f41d25879b4c58ade48978afadf2ef P 60d4538b78b44201964cf440ea562c72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195:45355)
I20260810 01:56:23.703415 27006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f41d25879b4c58ade48978afadf2ef" candidate_uuid: "60d4538b78b44201964cf440ea562c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56388bef1a0f453cadc8b6aa9434311d" is_pre_election: true
I20260810 01:56:23.703691 27006 raft_consensus.cc:2468] T 40f41d25879b4c58ade48978afadf2ef P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60d4538b78b44201964cf440ea562c72 in term 0.
I20260810 01:56:23.704370 26744 leader_election.cc:304] T 40f41d25879b4c58ade48978afadf2ef P 60d4538b78b44201964cf440ea562c72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 56388bef1a0f453cadc8b6aa9434311d, 60d4538b78b44201964cf440ea562c72; no voters:
I20260810 01:56:23.704670 27865 raft_consensus.cc:2804] T 40f41d25879b4c58ade48978afadf2ef P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:56:23.704775 27865 raft_consensus.cc:493] T 40f41d25879b4c58ade48978afadf2ef P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:56:23.704859 27865 raft_consensus.cc:3060] T 40f41d25879b4c58ade48978afadf2ef P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:56:23.707295 27865 raft_consensus.cc:515] T 40f41d25879b4c58ade48978afadf2ef P 60d4538b78b44201964cf440ea562c72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } }
I20260810 01:56:23.707839 27865 leader_election.cc:290] T 40f41d25879b4c58ade48978afadf2ef P 60d4538b78b44201964cf440ea562c72 [CANDIDATE]: Term 1 election: Requested vote from peers 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195:45355)
I20260810 01:56:23.708381 27006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f41d25879b4c58ade48978afadf2ef" candidate_uuid: "60d4538b78b44201964cf440ea562c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56388bef1a0f453cadc8b6aa9434311d"
I20260810 01:56:23.708659 27006 raft_consensus.cc:3060] T 40f41d25879b4c58ade48978afadf2ef P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:56:23.710902 27006 raft_consensus.cc:2468] T 40f41d25879b4c58ade48978afadf2ef P 56388bef1a0f453cadc8b6aa9434311d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60d4538b78b44201964cf440ea562c72 in term 1.
I20260810 01:56:23.711369 26744 leader_election.cc:304] T 40f41d25879b4c58ade48978afadf2ef P 60d4538b78b44201964cf440ea562c72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 56388bef1a0f453cadc8b6aa9434311d, 60d4538b78b44201964cf440ea562c72; no voters:
I20260810 01:56:23.711719 27865 raft_consensus.cc:2804] T 40f41d25879b4c58ade48978afadf2ef P 60d4538b78b44201964cf440ea562c72 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:56:23.712178 27865 raft_consensus.cc:697] T 40f41d25879b4c58ade48978afadf2ef P 60d4538b78b44201964cf440ea562c72 [term 1 LEADER]: Becoming Leader. State: Replica: 60d4538b78b44201964cf440ea562c72, State: Running, Role: LEADER
I20260810 01:56:23.712503 27865 consensus_queue.cc:237] T 40f41d25879b4c58ade48978afadf2ef P 60d4538b78b44201964cf440ea562c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } }
I20260810 01:56:23.715322 26470 catalog_manager.cc:5719] T 40f41d25879b4c58ade48978afadf2ef P 60d4538b78b44201964cf440ea562c72 reported cstate change: term changed from 0 to 1, leader changed from <none> to 60d4538b78b44201964cf440ea562c72 (127.21.64.194). New cstate: current_term: 1 leader_uuid: "60d4538b78b44201964cf440ea562c72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } }
I20260810 01:56:23.816747 27865 raft_consensus.cc:493] T d76ed7c57001495fb62e15bd9f14a162 P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:56:23.817092 27865 raft_consensus.cc:515] T d76ed7c57001495fb62e15bd9f14a162 P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } }
I20260810 01:56:23.817967 27865 leader_election.cc:290] T d76ed7c57001495fb62e15bd9f14a162 P 60d4538b78b44201964cf440ea562c72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193:45781)
I20260810 01:56:23.818670 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76ed7c57001495fb62e15bd9f14a162" candidate_uuid: "60d4538b78b44201964cf440ea562c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" is_pre_election: true
I20260810 01:56:23.818959 26660 raft_consensus.cc:2468] T d76ed7c57001495fb62e15bd9f14a162 P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60d4538b78b44201964cf440ea562c72 in term 0.
I20260810 01:56:23.819648 26745 leader_election.cc:304] T d76ed7c57001495fb62e15bd9f14a162 P 60d4538b78b44201964cf440ea562c72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 60d4538b78b44201964cf440ea562c72, a46364d7cd504f8ca7fc003c59ae6d31; no voters:
I20260810 01:56:23.819998 27865 raft_consensus.cc:2804] T d76ed7c57001495fb62e15bd9f14a162 P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:56:23.820148 27865 raft_consensus.cc:493] T d76ed7c57001495fb62e15bd9f14a162 P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:56:23.820276 27865 raft_consensus.cc:3060] T d76ed7c57001495fb62e15bd9f14a162 P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:56:23.822907 27865 raft_consensus.cc:515] T d76ed7c57001495fb62e15bd9f14a162 P 60d4538b78b44201964cf440ea562c72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } }
I20260810 01:56:23.823448 27865 leader_election.cc:290] T d76ed7c57001495fb62e15bd9f14a162 P 60d4538b78b44201964cf440ea562c72 [CANDIDATE]: Term 1 election: Requested vote from peers a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193:45781)
I20260810 01:56:23.824102 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76ed7c57001495fb62e15bd9f14a162" candidate_uuid: "60d4538b78b44201964cf440ea562c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46364d7cd504f8ca7fc003c59ae6d31"
I20260810 01:56:23.824349 26660 raft_consensus.cc:3060] T d76ed7c57001495fb62e15bd9f14a162 P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:56:23.828899 26660 raft_consensus.cc:2468] T d76ed7c57001495fb62e15bd9f14a162 P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60d4538b78b44201964cf440ea562c72 in term 1.
I20260810 01:56:23.829587 26745 leader_election.cc:304] T d76ed7c57001495fb62e15bd9f14a162 P 60d4538b78b44201964cf440ea562c72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 60d4538b78b44201964cf440ea562c72, a46364d7cd504f8ca7fc003c59ae6d31; no voters:
I20260810 01:56:23.830004 27865 raft_consensus.cc:2804] T d76ed7c57001495fb62e15bd9f14a162 P 60d4538b78b44201964cf440ea562c72 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:56:23.830475 27865 raft_consensus.cc:697] T d76ed7c57001495fb62e15bd9f14a162 P 60d4538b78b44201964cf440ea562c72 [term 1 LEADER]: Becoming Leader. State: Replica: 60d4538b78b44201964cf440ea562c72, State: Running, Role: LEADER
I20260810 01:56:23.831758 27865 consensus_queue.cc:237] T d76ed7c57001495fb62e15bd9f14a162 P 60d4538b78b44201964cf440ea562c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } }
I20260810 01:56:23.835067 26470 catalog_manager.cc:5719] T d76ed7c57001495fb62e15bd9f14a162 P 60d4538b78b44201964cf440ea562c72 reported cstate change: term changed from 0 to 1, leader changed from <none> to 60d4538b78b44201964cf440ea562c72 (127.21.64.194). New cstate: current_term: 1 leader_uuid: "60d4538b78b44201964cf440ea562c72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } }
I20260810 01:56:24.051115 28012 consensus_queue.cc:1048] T 39a14ec9527d43b4a6f78b48ad4165cf P a46364d7cd504f8ca7fc003c59ae6d31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:56:24.123128 27865 consensus_queue.cc:1048] T 40f41d25879b4c58ade48978afadf2ef P 60d4538b78b44201964cf440ea562c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 01:56:24.260232 28052 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:56:24.260615 28052 flags.cc:432] Enabled unsafe flag: --never_fsync=true
Using table 'rebalance_test_table_2'
I20260810 01:56:24.311410 27865 consensus_queue.cc:1048] T d76ed7c57001495fb62e15bd9f14a162 P 60d4538b78b44201964cf440ea562c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 184.718 ms
time per row: 0.0923589 ms
I20260810 01:56:24.667006 26457 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53804:
name: "rebalance_test_table_3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 2
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260810 01:56:24.676509 26974 tablet_service.cc:1511] Processing CreateTablet for tablet e8b0ab1f966840f3ade9f44232b39a5a (DEFAULT_TABLE table=rebalance_test_table_3 [id=165a82ad66824212a25d38b164e619d1]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:56:24.677052 26974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8b0ab1f966840f3ade9f44232b39a5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:56:24.677174 26634 tablet_service.cc:1511] Processing CreateTablet for tablet e8b0ab1f966840f3ade9f44232b39a5a (DEFAULT_TABLE table=rebalance_test_table_3 [id=165a82ad66824212a25d38b164e619d1]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:56:24.677655 26634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8b0ab1f966840f3ade9f44232b39a5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:56:24.677591 26807 tablet_service.cc:1511] Processing CreateTablet for tablet d771b2d03cb940018a706ecc38f68a9e (DEFAULT_TABLE table=rebalance_test_table_3 [id=165a82ad66824212a25d38b164e619d1]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:56:24.678079 26807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d771b2d03cb940018a706ecc38f68a9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:56:24.678339 26633 tablet_service.cc:1511] Processing CreateTablet for tablet 059177b44a51490f9765e20391967605 (DEFAULT_TABLE table=rebalance_test_table_3 [id=165a82ad66824212a25d38b164e619d1]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:56:24.678781 26633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 059177b44a51490f9765e20391967605. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:56:24.686383 26976 tablet_service.cc:1511] Processing CreateTablet for tablet d771b2d03cb940018a706ecc38f68a9e (DEFAULT_TABLE table=rebalance_test_table_3 [id=165a82ad66824212a25d38b164e619d1]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:56:24.686465 26973 tablet_service.cc:1511] Processing CreateTablet for tablet 059177b44a51490f9765e20391967605 (DEFAULT_TABLE table=rebalance_test_table_3 [id=165a82ad66824212a25d38b164e619d1]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:56:24.686937 26976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d771b2d03cb940018a706ecc38f68a9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:56:24.687186 26973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 059177b44a51490f9765e20391967605. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:56:24.687851 28125 tablet_bootstrap.cc:492] T e8b0ab1f966840f3ade9f44232b39a5a P 56388bef1a0f453cadc8b6aa9434311d: Bootstrap starting.
I20260810 01:56:24.690168 28125 tablet_bootstrap.cc:654] T e8b0ab1f966840f3ade9f44232b39a5a P 56388bef1a0f453cadc8b6aa9434311d: Neither blocks nor log segments found. Creating new log.
I20260810 01:56:24.692667 28126 tablet_bootstrap.cc:492] T d771b2d03cb940018a706ecc38f68a9e P 60d4538b78b44201964cf440ea562c72: Bootstrap starting.
I20260810 01:56:24.694634 28126 tablet_bootstrap.cc:654] T d771b2d03cb940018a706ecc38f68a9e P 60d4538b78b44201964cf440ea562c72: Neither blocks nor log segments found. Creating new log.
I20260810 01:56:24.696846 28127 tablet_bootstrap.cc:492] T e8b0ab1f966840f3ade9f44232b39a5a P a46364d7cd504f8ca7fc003c59ae6d31: Bootstrap starting.
I20260810 01:56:24.699934 28127 tablet_bootstrap.cc:654] T e8b0ab1f966840f3ade9f44232b39a5a P a46364d7cd504f8ca7fc003c59ae6d31: Neither blocks nor log segments found. Creating new log.
I20260810 01:56:24.700866 28126 tablet_bootstrap.cc:492] T d771b2d03cb940018a706ecc38f68a9e P 60d4538b78b44201964cf440ea562c72: No bootstrap required, opened a new log
I20260810 01:56:24.701131 28126 ts_tablet_manager.cc:1403] T d771b2d03cb940018a706ecc38f68a9e P 60d4538b78b44201964cf440ea562c72: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.004s
I20260810 01:56:24.702268 28126 raft_consensus.cc:359] T d771b2d03cb940018a706ecc38f68a9e P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } }
I20260810 01:56:24.702487 28126 raft_consensus.cc:385] T d771b2d03cb940018a706ecc38f68a9e P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:56:24.702623 28126 raft_consensus.cc:740] T d771b2d03cb940018a706ecc38f68a9e P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d4538b78b44201964cf440ea562c72, State: Initialized, Role: FOLLOWER
I20260810 01:56:24.702759 28125 tablet_bootstrap.cc:492] T e8b0ab1f966840f3ade9f44232b39a5a P 56388bef1a0f453cadc8b6aa9434311d: No bootstrap required, opened a new log
I20260810 01:56:24.702927 28125 ts_tablet_manager.cc:1403] T e8b0ab1f966840f3ade9f44232b39a5a P 56388bef1a0f453cadc8b6aa9434311d: Time spent bootstrapping tablet: real 0.015s user 0.009s sys 0.003s
I20260810 01:56:24.703348 28126 consensus_queue.cc:260] T d771b2d03cb940018a706ecc38f68a9e P 60d4538b78b44201964cf440ea562c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } }
I20260810 01:56:24.703904 28125 raft_consensus.cc:359] T e8b0ab1f966840f3ade9f44232b39a5a P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } }
I20260810 01:56:24.704149 28125 raft_consensus.cc:385] T e8b0ab1f966840f3ade9f44232b39a5a P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:56:24.704205 28126 ts_tablet_manager.cc:1434] T d771b2d03cb940018a706ecc38f68a9e P 60d4538b78b44201964cf440ea562c72: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 01:56:24.704264 28125 raft_consensus.cc:740] T e8b0ab1f966840f3ade9f44232b39a5a P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56388bef1a0f453cadc8b6aa9434311d, State: Initialized, Role: FOLLOWER
I20260810 01:56:24.704559 28125 consensus_queue.cc:260] T e8b0ab1f966840f3ade9f44232b39a5a P 56388bef1a0f453cadc8b6aa9434311d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } }
I20260810 01:56:24.704690 28127 tablet_bootstrap.cc:492] T e8b0ab1f966840f3ade9f44232b39a5a P a46364d7cd504f8ca7fc003c59ae6d31: No bootstrap required, opened a new log
I20260810 01:56:24.704830 28127 ts_tablet_manager.cc:1403] T e8b0ab1f966840f3ade9f44232b39a5a P a46364d7cd504f8ca7fc003c59ae6d31: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260810 01:56:24.705145 28125 ts_tablet_manager.cc:1434] T e8b0ab1f966840f3ade9f44232b39a5a P 56388bef1a0f453cadc8b6aa9434311d: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260810 01:56:24.705448 28125 tablet_bootstrap.cc:492] T 059177b44a51490f9765e20391967605 P 56388bef1a0f453cadc8b6aa9434311d: Bootstrap starting.
I20260810 01:56:24.705752 28127 raft_consensus.cc:359] T e8b0ab1f966840f3ade9f44232b39a5a P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } }
I20260810 01:56:24.705935 28127 raft_consensus.cc:385] T e8b0ab1f966840f3ade9f44232b39a5a P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:56:24.706035 28127 raft_consensus.cc:740] T e8b0ab1f966840f3ade9f44232b39a5a P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46364d7cd504f8ca7fc003c59ae6d31, State: Initialized, Role: FOLLOWER
I20260810 01:56:24.706297 28127 consensus_queue.cc:260] T e8b0ab1f966840f3ade9f44232b39a5a P a46364d7cd504f8ca7fc003c59ae6d31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } }
I20260810 01:56:24.706996 28127 ts_tablet_manager.cc:1434] T e8b0ab1f966840f3ade9f44232b39a5a P a46364d7cd504f8ca7fc003c59ae6d31: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:56:24.707337 28125 tablet_bootstrap.cc:654] T 059177b44a51490f9765e20391967605 P 56388bef1a0f453cadc8b6aa9434311d: Neither blocks nor log segments found. Creating new log.
I20260810 01:56:24.707376 28127 tablet_bootstrap.cc:492] T 059177b44a51490f9765e20391967605 P a46364d7cd504f8ca7fc003c59ae6d31: Bootstrap starting.
I20260810 01:56:24.709520 28127 tablet_bootstrap.cc:654] T 059177b44a51490f9765e20391967605 P a46364d7cd504f8ca7fc003c59ae6d31: Neither blocks nor log segments found. Creating new log.
I20260810 01:56:24.712198 28127 tablet_bootstrap.cc:492] T 059177b44a51490f9765e20391967605 P a46364d7cd504f8ca7fc003c59ae6d31: No bootstrap required, opened a new log
I20260810 01:56:24.712404 28127 ts_tablet_manager.cc:1403] T 059177b44a51490f9765e20391967605 P a46364d7cd504f8ca7fc003c59ae6d31: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.003s
I20260810 01:56:24.713268 28125 tablet_bootstrap.cc:492] T 059177b44a51490f9765e20391967605 P 56388bef1a0f453cadc8b6aa9434311d: No bootstrap required, opened a new log
I20260810 01:56:24.713318 28127 raft_consensus.cc:359] T 059177b44a51490f9765e20391967605 P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } }
I20260810 01:56:24.713476 28125 ts_tablet_manager.cc:1403] T 059177b44a51490f9765e20391967605 P 56388bef1a0f453cadc8b6aa9434311d: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.003s
I20260810 01:56:24.713573 28127 raft_consensus.cc:385] T 059177b44a51490f9765e20391967605 P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:56:24.713655 28127 raft_consensus.cc:740] T 059177b44a51490f9765e20391967605 P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46364d7cd504f8ca7fc003c59ae6d31, State: Initialized, Role: FOLLOWER
I20260810 01:56:24.713910 28127 consensus_queue.cc:260] T 059177b44a51490f9765e20391967605 P a46364d7cd504f8ca7fc003c59ae6d31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } }
I20260810 01:56:24.714221 28125 raft_consensus.cc:359] T 059177b44a51490f9765e20391967605 P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } }
I20260810 01:56:24.714395 28127 ts_tablet_manager.cc:1434] T 059177b44a51490f9765e20391967605 P a46364d7cd504f8ca7fc003c59ae6d31: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 01:56:24.714432 28125 raft_consensus.cc:385] T 059177b44a51490f9765e20391967605 P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:56:24.714521 28125 raft_consensus.cc:740] T 059177b44a51490f9765e20391967605 P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56388bef1a0f453cadc8b6aa9434311d, State: Initialized, Role: FOLLOWER
I20260810 01:56:24.714785 28125 consensus_queue.cc:260] T 059177b44a51490f9765e20391967605 P 56388bef1a0f453cadc8b6aa9434311d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } }
I20260810 01:56:24.715329 28125 ts_tablet_manager.cc:1434] T 059177b44a51490f9765e20391967605 P 56388bef1a0f453cadc8b6aa9434311d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:56:24.715910 28125 tablet_bootstrap.cc:492] T d771b2d03cb940018a706ecc38f68a9e P 56388bef1a0f453cadc8b6aa9434311d: Bootstrap starting.
I20260810 01:56:24.717736 28125 tablet_bootstrap.cc:654] T d771b2d03cb940018a706ecc38f68a9e P 56388bef1a0f453cadc8b6aa9434311d: Neither blocks nor log segments found. Creating new log.
I20260810 01:56:24.720345 28125 tablet_bootstrap.cc:492] T d771b2d03cb940018a706ecc38f68a9e P 56388bef1a0f453cadc8b6aa9434311d: No bootstrap required, opened a new log
I20260810 01:56:24.720474 28125 ts_tablet_manager.cc:1403] T d771b2d03cb940018a706ecc38f68a9e P 56388bef1a0f453cadc8b6aa9434311d: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260810 01:56:24.721015 28125 raft_consensus.cc:359] T d771b2d03cb940018a706ecc38f68a9e P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } }
I20260810 01:56:24.721172 28125 raft_consensus.cc:385] T d771b2d03cb940018a706ecc38f68a9e P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:56:24.721243 28125 raft_consensus.cc:740] T d771b2d03cb940018a706ecc38f68a9e P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56388bef1a0f453cadc8b6aa9434311d, State: Initialized, Role: FOLLOWER
I20260810 01:56:24.721475 28125 consensus_queue.cc:260] T d771b2d03cb940018a706ecc38f68a9e P 56388bef1a0f453cadc8b6aa9434311d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } }
I20260810 01:56:24.721971 28125 ts_tablet_manager.cc:1434] T d771b2d03cb940018a706ecc38f68a9e P 56388bef1a0f453cadc8b6aa9434311d: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260810 01:56:24.762288 27955 raft_consensus.cc:493] T 059177b44a51490f9765e20391967605 P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:56:24.762511 27955 raft_consensus.cc:515] T 059177b44a51490f9765e20391967605 P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } }
I20260810 01:56:24.763078 27955 leader_election.cc:290] T 059177b44a51490f9765e20391967605 P a46364d7cd504f8ca7fc003c59ae6d31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195:45355)
I20260810 01:56:24.763782 27006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059177b44a51490f9765e20391967605" candidate_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56388bef1a0f453cadc8b6aa9434311d" is_pre_election: true
I20260810 01:56:24.764016 27006 raft_consensus.cc:2468] T 059177b44a51490f9765e20391967605 P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46364d7cd504f8ca7fc003c59ae6d31 in term 0.
I20260810 01:56:24.764568 26576 leader_election.cc:304] T 059177b44a51490f9765e20391967605 P a46364d7cd504f8ca7fc003c59ae6d31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 56388bef1a0f453cadc8b6aa9434311d, a46364d7cd504f8ca7fc003c59ae6d31; no voters:
I20260810 01:56:24.764941 27955 raft_consensus.cc:2804] T 059177b44a51490f9765e20391967605 P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:56:24.765093 27955 raft_consensus.cc:493] T 059177b44a51490f9765e20391967605 P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:56:24.765268 27955 raft_consensus.cc:3060] T 059177b44a51490f9765e20391967605 P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:56:24.767810 27955 raft_consensus.cc:515] T 059177b44a51490f9765e20391967605 P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } }
I20260810 01:56:24.768344 27955 leader_election.cc:290] T 059177b44a51490f9765e20391967605 P a46364d7cd504f8ca7fc003c59ae6d31 [CANDIDATE]: Term 1 election: Requested vote from peers 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195:45355)
I20260810 01:56:24.768998 27006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059177b44a51490f9765e20391967605" candidate_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56388bef1a0f453cadc8b6aa9434311d"
I20260810 01:56:24.769229 27006 raft_consensus.cc:3060] T 059177b44a51490f9765e20391967605 P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:56:24.771363 27006 raft_consensus.cc:2468] T 059177b44a51490f9765e20391967605 P 56388bef1a0f453cadc8b6aa9434311d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46364d7cd504f8ca7fc003c59ae6d31 in term 1.
I20260810 01:56:24.771890 26576 leader_election.cc:304] T 059177b44a51490f9765e20391967605 P a46364d7cd504f8ca7fc003c59ae6d31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 56388bef1a0f453cadc8b6aa9434311d, a46364d7cd504f8ca7fc003c59ae6d31; no voters:
I20260810 01:56:24.772212 27955 raft_consensus.cc:2804] T 059177b44a51490f9765e20391967605 P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:56:24.772398 27955 raft_consensus.cc:697] T 059177b44a51490f9765e20391967605 P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 LEADER]: Becoming Leader. State: Replica: a46364d7cd504f8ca7fc003c59ae6d31, State: Running, Role: LEADER
I20260810 01:56:24.772759 27955 consensus_queue.cc:237] T 059177b44a51490f9765e20391967605 P a46364d7cd504f8ca7fc003c59ae6d31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } }
I20260810 01:56:24.775710 26466 catalog_manager.cc:5719] T 059177b44a51490f9765e20391967605 P a46364d7cd504f8ca7fc003c59ae6d31 reported cstate change: term changed from 0 to 1, leader changed from <none> to a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193). New cstate: current_term: 1 leader_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } }
I20260810 01:56:24.809427 28020 raft_consensus.cc:493] T d771b2d03cb940018a706ecc38f68a9e P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:56:24.809664 28020 raft_consensus.cc:515] T d771b2d03cb940018a706ecc38f68a9e P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } }
I20260810 01:56:24.810232 28020 leader_election.cc:290] T d771b2d03cb940018a706ecc38f68a9e P 56388bef1a0f453cadc8b6aa9434311d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60d4538b78b44201964cf440ea562c72 (127.21.64.194:36943)
I20260810 01:56:24.810792 26833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d771b2d03cb940018a706ecc38f68a9e" candidate_uuid: "56388bef1a0f453cadc8b6aa9434311d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d4538b78b44201964cf440ea562c72" is_pre_election: true
I20260810 01:56:24.811064 26833 raft_consensus.cc:2468] T d771b2d03cb940018a706ecc38f68a9e P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56388bef1a0f453cadc8b6aa9434311d in term 0.
I20260810 01:56:24.811579 26910 leader_election.cc:304] T d771b2d03cb940018a706ecc38f68a9e P 56388bef1a0f453cadc8b6aa9434311d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 56388bef1a0f453cadc8b6aa9434311d, 60d4538b78b44201964cf440ea562c72; no voters:
I20260810 01:56:24.811887 28020 raft_consensus.cc:2804] T d771b2d03cb940018a706ecc38f68a9e P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:56:24.812047 28020 raft_consensus.cc:493] T d771b2d03cb940018a706ecc38f68a9e P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:56:24.812150 28020 raft_consensus.cc:3060] T d771b2d03cb940018a706ecc38f68a9e P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:56:24.814373 28020 raft_consensus.cc:515] T d771b2d03cb940018a706ecc38f68a9e P 56388bef1a0f453cadc8b6aa9434311d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } }
I20260810 01:56:24.814841 28020 leader_election.cc:290] T d771b2d03cb940018a706ecc38f68a9e P 56388bef1a0f453cadc8b6aa9434311d [CANDIDATE]: Term 1 election: Requested vote from peers 60d4538b78b44201964cf440ea562c72 (127.21.64.194:36943)
I20260810 01:56:24.815451 26833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d771b2d03cb940018a706ecc38f68a9e" candidate_uuid: "56388bef1a0f453cadc8b6aa9434311d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d4538b78b44201964cf440ea562c72"
I20260810 01:56:24.815665 26833 raft_consensus.cc:3060] T d771b2d03cb940018a706ecc38f68a9e P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:56:24.818265 26833 raft_consensus.cc:2468] T d771b2d03cb940018a706ecc38f68a9e P 60d4538b78b44201964cf440ea562c72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56388bef1a0f453cadc8b6aa9434311d in term 1.
I20260810 01:56:24.818740 26910 leader_election.cc:304] T d771b2d03cb940018a706ecc38f68a9e P 56388bef1a0f453cadc8b6aa9434311d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 56388bef1a0f453cadc8b6aa9434311d, 60d4538b78b44201964cf440ea562c72; no voters:
I20260810 01:56:24.819049 28020 raft_consensus.cc:2804] T d771b2d03cb940018a706ecc38f68a9e P 56388bef1a0f453cadc8b6aa9434311d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:56:24.819528 28020 raft_consensus.cc:697] T d771b2d03cb940018a706ecc38f68a9e P 56388bef1a0f453cadc8b6aa9434311d [term 1 LEADER]: Becoming Leader. State: Replica: 56388bef1a0f453cadc8b6aa9434311d, State: Running, Role: LEADER
I20260810 01:56:24.819808 28020 consensus_queue.cc:237] T d771b2d03cb940018a706ecc38f68a9e P 56388bef1a0f453cadc8b6aa9434311d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } }
I20260810 01:56:24.821506 28020 raft_consensus.cc:493] T e8b0ab1f966840f3ade9f44232b39a5a P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:56:24.821686 28020 raft_consensus.cc:515] T e8b0ab1f966840f3ade9f44232b39a5a P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } }
I20260810 01:56:24.822207 28020 leader_election.cc:290] T e8b0ab1f966840f3ade9f44232b39a5a P 56388bef1a0f453cadc8b6aa9434311d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193:45781)
I20260810 01:56:24.822510 26466 catalog_manager.cc:5719] T d771b2d03cb940018a706ecc38f68a9e P 56388bef1a0f453cadc8b6aa9434311d reported cstate change: term changed from 0 to 1, leader changed from <none> to 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195). New cstate: current_term: 1 leader_uuid: "56388bef1a0f453cadc8b6aa9434311d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } }
I20260810 01:56:24.822794 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b0ab1f966840f3ade9f44232b39a5a" candidate_uuid: "56388bef1a0f453cadc8b6aa9434311d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" is_pre_election: true
I20260810 01:56:24.823022 26659 raft_consensus.cc:2468] T e8b0ab1f966840f3ade9f44232b39a5a P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56388bef1a0f453cadc8b6aa9434311d in term 0.
I20260810 01:56:24.823475 26914 leader_election.cc:304] T e8b0ab1f966840f3ade9f44232b39a5a P 56388bef1a0f453cadc8b6aa9434311d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 56388bef1a0f453cadc8b6aa9434311d, a46364d7cd504f8ca7fc003c59ae6d31; no voters:
I20260810 01:56:24.823774 28020 raft_consensus.cc:2804] T e8b0ab1f966840f3ade9f44232b39a5a P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:56:24.823880 28020 raft_consensus.cc:493] T e8b0ab1f966840f3ade9f44232b39a5a P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:56:24.824007 28020 raft_consensus.cc:3060] T e8b0ab1f966840f3ade9f44232b39a5a P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:56:24.826567 28020 raft_consensus.cc:515] T e8b0ab1f966840f3ade9f44232b39a5a P 56388bef1a0f453cadc8b6aa9434311d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } }
I20260810 01:56:24.826937 28020 leader_election.cc:290] T e8b0ab1f966840f3ade9f44232b39a5a P 56388bef1a0f453cadc8b6aa9434311d [CANDIDATE]: Term 1 election: Requested vote from peers a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193:45781)
I20260810 01:56:24.827584 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b0ab1f966840f3ade9f44232b39a5a" candidate_uuid: "56388bef1a0f453cadc8b6aa9434311d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46364d7cd504f8ca7fc003c59ae6d31"
I20260810 01:56:24.827805 26659 raft_consensus.cc:3060] T e8b0ab1f966840f3ade9f44232b39a5a P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:56:24.830112 26659 raft_consensus.cc:2468] T e8b0ab1f966840f3ade9f44232b39a5a P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56388bef1a0f453cadc8b6aa9434311d in term 1.
I20260810 01:56:24.830585 26914 leader_election.cc:304] T e8b0ab1f966840f3ade9f44232b39a5a P 56388bef1a0f453cadc8b6aa9434311d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 56388bef1a0f453cadc8b6aa9434311d, a46364d7cd504f8ca7fc003c59ae6d31; no voters:
I20260810 01:56:24.830917 28020 raft_consensus.cc:2804] T e8b0ab1f966840f3ade9f44232b39a5a P 56388bef1a0f453cadc8b6aa9434311d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:56:24.831153 28020 raft_consensus.cc:697] T e8b0ab1f966840f3ade9f44232b39a5a P 56388bef1a0f453cadc8b6aa9434311d [term 1 LEADER]: Becoming Leader. State: Replica: 56388bef1a0f453cadc8b6aa9434311d, State: Running, Role: LEADER
I20260810 01:56:24.831449 28020 consensus_queue.cc:237] T e8b0ab1f966840f3ade9f44232b39a5a P 56388bef1a0f453cadc8b6aa9434311d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } }
I20260810 01:56:24.834316 26466 catalog_manager.cc:5719] T e8b0ab1f966840f3ade9f44232b39a5a P 56388bef1a0f453cadc8b6aa9434311d reported cstate change: term changed from 0 to 1, leader changed from <none> to 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195). New cstate: current_term: 1 leader_uuid: "56388bef1a0f453cadc8b6aa9434311d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } }
W20260810 01:56:25.221240 28138 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:56:25.221710 28138 flags.cc:432] Enabled unsafe flag: --never_fsync=true
Using table 'rebalance_test_table_3'
I20260810 01:56:25.278043 28020 consensus_queue.cc:1048] T e8b0ab1f966840f3ade9f44232b39a5a P 56388bef1a0f453cadc8b6aa9434311d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:56:25.281534 28020 consensus_queue.cc:1048] T d771b2d03cb940018a706ecc38f68a9e P 56388bef1a0f453cadc8b6aa9434311d [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:56:25.371994 27955 consensus_queue.cc:1048] T 059177b44a51490f9765e20391967605 P a46364d7cd504f8ca7fc003c59ae6d31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 207.238 ms
time per row: 0.103619 ms
I20260810 01:56:25.592705 26457 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53804:
name: "rebalance_test_table_4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 2
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260810 01:56:25.602404 26807 tablet_service.cc:1511] Processing CreateTablet for tablet 3c77a4e4068b4dac971c281f5819a5a9 (DEFAULT_TABLE table=rebalance_test_table_4 [id=b8ab0a3e55d1493fb5fc271a33432c29]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:56:25.602952 26807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c77a4e4068b4dac971c281f5819a5a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:56:25.602880 26634 tablet_service.cc:1511] Processing CreateTablet for tablet 3c77a4e4068b4dac971c281f5819a5a9 (DEFAULT_TABLE table=rebalance_test_table_4 [id=b8ab0a3e55d1493fb5fc271a33432c29]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:56:25.603113 26805 tablet_service.cc:1511] Processing CreateTablet for tablet 4f7860cf1d8449fc9f062f3e09e4aafd (DEFAULT_TABLE table=rebalance_test_table_4 [id=b8ab0a3e55d1493fb5fc271a33432c29]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:56:25.603313 26634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c77a4e4068b4dac971c281f5819a5a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:56:25.603698 26805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f7860cf1d8449fc9f062f3e09e4aafd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:56:25.604185 26806 tablet_service.cc:1511] Processing CreateTablet for tablet b59ebeb3dc294227a54a82a640c798ce (DEFAULT_TABLE table=rebalance_test_table_4 [id=b8ab0a3e55d1493fb5fc271a33432c29]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:56:25.604574 26806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b59ebeb3dc294227a54a82a640c798ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:56:25.610327 26633 tablet_service.cc:1511] Processing CreateTablet for tablet b59ebeb3dc294227a54a82a640c798ce (DEFAULT_TABLE table=rebalance_test_table_4 [id=b8ab0a3e55d1493fb5fc271a33432c29]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:56:25.610718 26633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b59ebeb3dc294227a54a82a640c798ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:56:25.610733 26976 tablet_service.cc:1511] Processing CreateTablet for tablet 4f7860cf1d8449fc9f062f3e09e4aafd (DEFAULT_TABLE table=rebalance_test_table_4 [id=b8ab0a3e55d1493fb5fc271a33432c29]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:56:25.611189 26976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f7860cf1d8449fc9f062f3e09e4aafd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:56:25.623421 28207 tablet_bootstrap.cc:492] T 4f7860cf1d8449fc9f062f3e09e4aafd P 56388bef1a0f453cadc8b6aa9434311d: Bootstrap starting.
I20260810 01:56:25.623781 28204 tablet_bootstrap.cc:492] T 3c77a4e4068b4dac971c281f5819a5a9 P a46364d7cd504f8ca7fc003c59ae6d31: Bootstrap starting.
I20260810 01:56:25.625495 28207 tablet_bootstrap.cc:654] T 4f7860cf1d8449fc9f062f3e09e4aafd P 56388bef1a0f453cadc8b6aa9434311d: Neither blocks nor log segments found. Creating new log.
I20260810 01:56:25.626008 28199 tablet_bootstrap.cc:492] T b59ebeb3dc294227a54a82a640c798ce P 60d4538b78b44201964cf440ea562c72: Bootstrap starting.
I20260810 01:56:25.626122 28204 tablet_bootstrap.cc:654] T 3c77a4e4068b4dac971c281f5819a5a9 P a46364d7cd504f8ca7fc003c59ae6d31: Neither blocks nor log segments found. Creating new log.
I20260810 01:56:25.627966 28199 tablet_bootstrap.cc:654] T b59ebeb3dc294227a54a82a640c798ce P 60d4538b78b44201964cf440ea562c72: Neither blocks nor log segments found. Creating new log.
I20260810 01:56:25.628069 28207 tablet_bootstrap.cc:492] T 4f7860cf1d8449fc9f062f3e09e4aafd P 56388bef1a0f453cadc8b6aa9434311d: No bootstrap required, opened a new log
I20260810 01:56:25.628224 28207 ts_tablet_manager.cc:1403] T 4f7860cf1d8449fc9f062f3e09e4aafd P 56388bef1a0f453cadc8b6aa9434311d: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.002s
I20260810 01:56:25.628403 28204 tablet_bootstrap.cc:492] T 3c77a4e4068b4dac971c281f5819a5a9 P a46364d7cd504f8ca7fc003c59ae6d31: No bootstrap required, opened a new log
I20260810 01:56:25.628562 28204 ts_tablet_manager.cc:1403] T 3c77a4e4068b4dac971c281f5819a5a9 P a46364d7cd504f8ca7fc003c59ae6d31: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260810 01:56:25.629110 28207 raft_consensus.cc:359] T 4f7860cf1d8449fc9f062f3e09e4aafd P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } }
I20260810 01:56:25.629314 28207 raft_consensus.cc:385] T 4f7860cf1d8449fc9f062f3e09e4aafd P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:56:25.629460 28207 raft_consensus.cc:740] T 4f7860cf1d8449fc9f062f3e09e4aafd P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56388bef1a0f453cadc8b6aa9434311d, State: Initialized, Role: FOLLOWER
I20260810 01:56:25.629379 28204 raft_consensus.cc:359] T 3c77a4e4068b4dac971c281f5819a5a9 P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } }
I20260810 01:56:25.629563 28204 raft_consensus.cc:385] T 3c77a4e4068b4dac971c281f5819a5a9 P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:56:25.629650 28204 raft_consensus.cc:740] T 3c77a4e4068b4dac971c281f5819a5a9 P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46364d7cd504f8ca7fc003c59ae6d31, State: Initialized, Role: FOLLOWER
I20260810 01:56:25.629715 28207 consensus_queue.cc:260] T 4f7860cf1d8449fc9f062f3e09e4aafd P 56388bef1a0f453cadc8b6aa9434311d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } }
I20260810 01:56:25.629881 28204 consensus_queue.cc:260] T 3c77a4e4068b4dac971c281f5819a5a9 P a46364d7cd504f8ca7fc003c59ae6d31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } }
I20260810 01:56:25.630262 28207 ts_tablet_manager.cc:1434] T 4f7860cf1d8449fc9f062f3e09e4aafd P 56388bef1a0f453cadc8b6aa9434311d: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260810 01:56:25.630399 28204 ts_tablet_manager.cc:1434] T 3c77a4e4068b4dac971c281f5819a5a9 P a46364d7cd504f8ca7fc003c59ae6d31: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 01:56:25.630647 28204 tablet_bootstrap.cc:492] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31: Bootstrap starting.
I20260810 01:56:25.632355 28204 tablet_bootstrap.cc:654] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31: Neither blocks nor log segments found. Creating new log.
I20260810 01:56:25.632752 28199 tablet_bootstrap.cc:492] T b59ebeb3dc294227a54a82a640c798ce P 60d4538b78b44201964cf440ea562c72: No bootstrap required, opened a new log
I20260810 01:56:25.632968 28199 ts_tablet_manager.cc:1403] T b59ebeb3dc294227a54a82a640c798ce P 60d4538b78b44201964cf440ea562c72: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260810 01:56:25.634671 28204 tablet_bootstrap.cc:492] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31: No bootstrap required, opened a new log
I20260810 01:56:25.634734 28199 raft_consensus.cc:359] T b59ebeb3dc294227a54a82a640c798ce P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } }
I20260810 01:56:25.634865 28204 ts_tablet_manager.cc:1403] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.002s
I20260810 01:56:25.634987 28199 raft_consensus.cc:385] T b59ebeb3dc294227a54a82a640c798ce P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:56:25.635121 28199 raft_consensus.cc:740] T b59ebeb3dc294227a54a82a640c798ce P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d4538b78b44201964cf440ea562c72, State: Initialized, Role: FOLLOWER
I20260810 01:56:25.635385 28199 consensus_queue.cc:260] T b59ebeb3dc294227a54a82a640c798ce P 60d4538b78b44201964cf440ea562c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } }
I20260810 01:56:25.635653 28204 raft_consensus.cc:359] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } }
I20260810 01:56:25.635849 28204 raft_consensus.cc:385] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:56:25.635928 28204 raft_consensus.cc:740] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46364d7cd504f8ca7fc003c59ae6d31, State: Initialized, Role: FOLLOWER
I20260810 01:56:25.636178 28204 consensus_queue.cc:260] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } }
I20260810 01:56:25.636595 28199 ts_tablet_manager.cc:1434] T b59ebeb3dc294227a54a82a640c798ce P 60d4538b78b44201964cf440ea562c72: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260810 01:56:25.636677 28204 ts_tablet_manager.cc:1434] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:56:25.636961 28199 tablet_bootstrap.cc:492] T 3c77a4e4068b4dac971c281f5819a5a9 P 60d4538b78b44201964cf440ea562c72: Bootstrap starting.
I20260810 01:56:25.639302 28199 tablet_bootstrap.cc:654] T 3c77a4e4068b4dac971c281f5819a5a9 P 60d4538b78b44201964cf440ea562c72: Neither blocks nor log segments found. Creating new log.
I20260810 01:56:25.642604 28199 tablet_bootstrap.cc:492] T 3c77a4e4068b4dac971c281f5819a5a9 P 60d4538b78b44201964cf440ea562c72: No bootstrap required, opened a new log
I20260810 01:56:25.642786 28199 ts_tablet_manager.cc:1403] T 3c77a4e4068b4dac971c281f5819a5a9 P 60d4538b78b44201964cf440ea562c72: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20260810 01:56:25.643632 28199 raft_consensus.cc:359] T 3c77a4e4068b4dac971c281f5819a5a9 P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } }
I20260810 01:56:25.643831 28199 raft_consensus.cc:385] T 3c77a4e4068b4dac971c281f5819a5a9 P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:56:25.643925 28199 raft_consensus.cc:740] T 3c77a4e4068b4dac971c281f5819a5a9 P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d4538b78b44201964cf440ea562c72, State: Initialized, Role: FOLLOWER
I20260810 01:56:25.644220 28199 consensus_queue.cc:260] T 3c77a4e4068b4dac971c281f5819a5a9 P 60d4538b78b44201964cf440ea562c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } }
I20260810 01:56:25.644687 28199 ts_tablet_manager.cc:1434] T 3c77a4e4068b4dac971c281f5819a5a9 P 60d4538b78b44201964cf440ea562c72: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 01:56:25.644994 28199 tablet_bootstrap.cc:492] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72: Bootstrap starting.
I20260810 01:56:25.646392 28199 tablet_bootstrap.cc:654] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72: Neither blocks nor log segments found. Creating new log.
I20260810 01:56:25.648653 28199 tablet_bootstrap.cc:492] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72: No bootstrap required, opened a new log
I20260810 01:56:25.648793 28199 ts_tablet_manager.cc:1403] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260810 01:56:25.649533 28199 raft_consensus.cc:359] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } }
I20260810 01:56:25.649698 28199 raft_consensus.cc:385] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:56:25.649796 28199 raft_consensus.cc:740] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d4538b78b44201964cf440ea562c72, State: Initialized, Role: FOLLOWER
I20260810 01:56:25.650002 28199 consensus_queue.cc:260] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } }
I20260810 01:56:25.650547 28199 ts_tablet_manager.cc:1434] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 01:56:25.743585 28191 raft_consensus.cc:493] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:56:25.743819 28191 raft_consensus.cc:515] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } }
I20260810 01:56:25.744572 28191 leader_election.cc:290] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60d4538b78b44201964cf440ea562c72 (127.21.64.194:36943)
I20260810 01:56:25.745245 26833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59ebeb3dc294227a54a82a640c798ce" candidate_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d4538b78b44201964cf440ea562c72" is_pre_election: true
I20260810 01:56:25.745519 26833 raft_consensus.cc:2468] T b59ebeb3dc294227a54a82a640c798ce P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46364d7cd504f8ca7fc003c59ae6d31 in term 0.
I20260810 01:56:25.746033 26574 leader_election.cc:304] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 60d4538b78b44201964cf440ea562c72, a46364d7cd504f8ca7fc003c59ae6d31; no voters:
I20260810 01:56:25.746349 28191 raft_consensus.cc:2804] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:56:25.746493 28191 raft_consensus.cc:493] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:56:25.746603 28191 raft_consensus.cc:3060] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:56:25.748752 28191 raft_consensus.cc:515] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } }
I20260810 01:56:25.749217 28191 leader_election.cc:290] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31 [CANDIDATE]: Term 1 election: Requested vote from peers 60d4538b78b44201964cf440ea562c72 (127.21.64.194:36943)
I20260810 01:56:25.749867 26833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59ebeb3dc294227a54a82a640c798ce" candidate_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d4538b78b44201964cf440ea562c72"
I20260810 01:56:25.750085 26833 raft_consensus.cc:3060] T b59ebeb3dc294227a54a82a640c798ce P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:56:25.752230 26833 raft_consensus.cc:2468] T b59ebeb3dc294227a54a82a640c798ce P 60d4538b78b44201964cf440ea562c72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46364d7cd504f8ca7fc003c59ae6d31 in term 1.
I20260810 01:56:25.752694 26574 leader_election.cc:304] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 60d4538b78b44201964cf440ea562c72, a46364d7cd504f8ca7fc003c59ae6d31; no voters:
I20260810 01:56:25.753069 28191 raft_consensus.cc:2804] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:56:25.753247 28191 raft_consensus.cc:697] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 LEADER]: Becoming Leader. State: Replica: a46364d7cd504f8ca7fc003c59ae6d31, State: Running, Role: LEADER
I20260810 01:56:25.753623 28191 consensus_queue.cc:237] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } }
I20260810 01:56:25.756760 26457 catalog_manager.cc:5719] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31 reported cstate change: term changed from 0 to 1, leader changed from <none> to a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193). New cstate: current_term: 1 leader_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } }
I20260810 01:56:25.908732 27865 raft_consensus.cc:493] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:56:25.908963 27865 raft_consensus.cc:515] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } }
I20260810 01:56:25.909636 27865 leader_election.cc:290] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195:45355)
I20260810 01:56:25.910398 27006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7860cf1d8449fc9f062f3e09e4aafd" candidate_uuid: "60d4538b78b44201964cf440ea562c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56388bef1a0f453cadc8b6aa9434311d" is_pre_election: true
I20260810 01:56:25.910667 27006 raft_consensus.cc:2468] T 4f7860cf1d8449fc9f062f3e09e4aafd P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60d4538b78b44201964cf440ea562c72 in term 0.
I20260810 01:56:25.911248 26744 leader_election.cc:304] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 56388bef1a0f453cadc8b6aa9434311d, 60d4538b78b44201964cf440ea562c72; no voters:
I20260810 01:56:25.911597 27865 raft_consensus.cc:2804] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:56:25.911698 27865 raft_consensus.cc:493] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:56:25.911864 27865 raft_consensus.cc:3060] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:56:25.914000 27865 raft_consensus.cc:515] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } }
I20260810 01:56:25.914527 27865 leader_election.cc:290] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72 [CANDIDATE]: Term 1 election: Requested vote from peers 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195:45355)
I20260810 01:56:25.915076 27006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7860cf1d8449fc9f062f3e09e4aafd" candidate_uuid: "60d4538b78b44201964cf440ea562c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56388bef1a0f453cadc8b6aa9434311d"
I20260810 01:56:25.915361 27006 raft_consensus.cc:3060] T 4f7860cf1d8449fc9f062f3e09e4aafd P 56388bef1a0f453cadc8b6aa9434311d [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:56:25.917423 27006 raft_consensus.cc:2468] T 4f7860cf1d8449fc9f062f3e09e4aafd P 56388bef1a0f453cadc8b6aa9434311d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60d4538b78b44201964cf440ea562c72 in term 1.
I20260810 01:56:25.917814 26744 leader_election.cc:304] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 56388bef1a0f453cadc8b6aa9434311d, 60d4538b78b44201964cf440ea562c72; no voters:
I20260810 01:56:25.918090 27865 raft_consensus.cc:2804] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:56:25.918437 27865 raft_consensus.cc:697] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72 [term 1 LEADER]: Becoming Leader. State: Replica: 60d4538b78b44201964cf440ea562c72, State: Running, Role: LEADER
I20260810 01:56:25.918715 27865 consensus_queue.cc:237] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } }
I20260810 01:56:25.921218 26457 catalog_manager.cc:5719] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72 reported cstate change: term changed from 0 to 1, leader changed from <none> to 60d4538b78b44201964cf440ea562c72 (127.21.64.194). New cstate: current_term: 1 leader_uuid: "60d4538b78b44201964cf440ea562c72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } }
I20260810 01:56:26.030151 27865 raft_consensus.cc:493] T 3c77a4e4068b4dac971c281f5819a5a9 P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:56:26.030362 27865 raft_consensus.cc:515] T 3c77a4e4068b4dac971c281f5819a5a9 P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } }
I20260810 01:56:26.030917 27865 leader_election.cc:290] T 3c77a4e4068b4dac971c281f5819a5a9 P 60d4538b78b44201964cf440ea562c72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193:45781)
I20260810 01:56:26.031685 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c77a4e4068b4dac971c281f5819a5a9" candidate_uuid: "60d4538b78b44201964cf440ea562c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" is_pre_election: true
I20260810 01:56:26.031905 26659 raft_consensus.cc:2468] T 3c77a4e4068b4dac971c281f5819a5a9 P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60d4538b78b44201964cf440ea562c72 in term 0.
I20260810 01:56:26.032404 26745 leader_election.cc:304] T 3c77a4e4068b4dac971c281f5819a5a9 P 60d4538b78b44201964cf440ea562c72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 60d4538b78b44201964cf440ea562c72, a46364d7cd504f8ca7fc003c59ae6d31; no voters:
I20260810 01:56:26.032727 27865 raft_consensus.cc:2804] T 3c77a4e4068b4dac971c281f5819a5a9 P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:56:26.032851 27865 raft_consensus.cc:493] T 3c77a4e4068b4dac971c281f5819a5a9 P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:56:26.032925 27865 raft_consensus.cc:3060] T 3c77a4e4068b4dac971c281f5819a5a9 P 60d4538b78b44201964cf440ea562c72 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:56:26.035049 27865 raft_consensus.cc:515] T 3c77a4e4068b4dac971c281f5819a5a9 P 60d4538b78b44201964cf440ea562c72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } }
I20260810 01:56:26.035552 27865 leader_election.cc:290] T 3c77a4e4068b4dac971c281f5819a5a9 P 60d4538b78b44201964cf440ea562c72 [CANDIDATE]: Term 1 election: Requested vote from peers a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193:45781)
I20260810 01:56:26.036164 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c77a4e4068b4dac971c281f5819a5a9" candidate_uuid: "60d4538b78b44201964cf440ea562c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46364d7cd504f8ca7fc003c59ae6d31"
I20260810 01:56:26.036351 26659 raft_consensus.cc:3060] T 3c77a4e4068b4dac971c281f5819a5a9 P a46364d7cd504f8ca7fc003c59ae6d31 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:56:26.038228 26659 raft_consensus.cc:2468] T 3c77a4e4068b4dac971c281f5819a5a9 P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60d4538b78b44201964cf440ea562c72 in term 1.
I20260810 01:56:26.038705 26745 leader_election.cc:304] T 3c77a4e4068b4dac971c281f5819a5a9 P 60d4538b78b44201964cf440ea562c72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 60d4538b78b44201964cf440ea562c72, a46364d7cd504f8ca7fc003c59ae6d31; no voters:
I20260810 01:56:26.039037 27865 raft_consensus.cc:2804] T 3c77a4e4068b4dac971c281f5819a5a9 P 60d4538b78b44201964cf440ea562c72 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:56:26.039206 27865 raft_consensus.cc:697] T 3c77a4e4068b4dac971c281f5819a5a9 P 60d4538b78b44201964cf440ea562c72 [term 1 LEADER]: Becoming Leader. State: Replica: 60d4538b78b44201964cf440ea562c72, State: Running, Role: LEADER
I20260810 01:56:26.039549 27865 consensus_queue.cc:237] T 3c77a4e4068b4dac971c281f5819a5a9 P 60d4538b78b44201964cf440ea562c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } }
I20260810 01:56:26.042459 26457 catalog_manager.cc:5719] T 3c77a4e4068b4dac971c281f5819a5a9 P 60d4538b78b44201964cf440ea562c72 reported cstate change: term changed from 0 to 1, leader changed from <none> to 60d4538b78b44201964cf440ea562c72 (127.21.64.194). New cstate: current_term: 1 leader_uuid: "60d4538b78b44201964cf440ea562c72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } }
I20260810 01:56:26.364507 28191 consensus_queue.cc:1048] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 01:56:26.467859 28225 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:56:26.468281 28225 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260810 01:56:26.478627 27865 consensus_queue.cc:1048] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:56:26.479180 28219 consensus_queue.cc:1048] T 3c77a4e4068b4dac971c281f5819a5a9 P 60d4538b78b44201964cf440ea562c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
Using table 'rebalance_test_table_4'
INSERT report
rows total: 2000
time total: 186.301 ms
time per row: 0.0931506 ms
I20260810 01:56:26.827277 21763 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNubV1X/build/asan/bin/kudu
/tmp/dist-test-taskNubV1X/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.64.196:41095
--local_ip_for_outbound_sockets=127.21.64.196
--tserver_master_addrs=127.21.64.254:38173
--webserver_port=40419
--webserver_interface=127.21.64.196
--builtin_ntp_servers=127.21.64.212:42671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
W20260810 01:56:27.219655 28294 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:56:27.220049 28294 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:56:27.220191 28294 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 01:56:27.228919 28294 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260810 01:56:27.229059 28294 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:56:27.229254 28294 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.64.196
I20260810 01:56:27.239441 28294 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.64.212:42671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.64.196:41095
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--webserver_interface=127.21.64.196
--webserver_port=40419
--tserver_master_addrs=127.21.64.254:38173
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.64.196
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 01:44:04 UTC on e7f111948823
build id 13266
ASAN enabled
I20260810 01:56:27.241112 28294 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:56:27.243078 28294 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 01:56:27.254558 28303 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:56:27.254590 28302 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:56:27.254737 28305 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:56:27.255481 28294 server_base.cc:1061] running on GCE node
I20260810 01:56:27.256130 28294 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:56:27.257061 28294 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:56:27.258328 28294 hybrid_clock.cc:648] HybridClock initialized: now 1786326987258267 us; error 55 us; skew 500 ppm
I20260810 01:56:27.258692 28294 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 01:56:27.260878 28294 webserver.cc:533] Webserver started at http://127.21.64.196:40419/ using document root <none> and password file <none>
I20260810 01:56:27.261729 28294 fs_manager.cc:362] Metadata directory not provided
I20260810 01:56:27.261898 28294 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:56:27.267418 28294 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 01:56:27.270403 28312 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:56:27.271755 28294 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:56:27.271936 28294 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/data,/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal
uuid: "28812b178f824d539cab11abfe98d77d"
format_stamp: "Formatted at 2026-08-10 01:56:14 on dist-test-slave-bw88"
I20260810 01:56:27.272706 28294 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal
metadata directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal
1 data directories: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:56:27.299257 28294 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 01:56:27.300199 28294 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:56:27.300523 28294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:56:27.301656 28294 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260810 01:56:27.303371 28294 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:56:27.303511 28294 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:56:27.303649 28294 ts_tablet_manager.cc:616] Registered 0 tablets
I20260810 01:56:27.303746 28294 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:56:27.341733 28294 rpc_server.cc:307] RPC server started. Bound to: 127.21.64.196:41095
I20260810 01:56:27.341827 28462 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.64.196:41095 every 8 connection(s)
I20260810 01:56:27.343436 28294 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/data/info.pb
I20260810 01:56:27.350987 21763 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNubV1X/build/asan/bin/kudu as pid 28294
I20260810 01:56:27.351706 21763 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNubV1X/build/asan/bin/kudu
/tmp/dist-test-taskNubV1X/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/wal
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/logs
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.64.197:46107
--local_ip_for_outbound_sockets=127.21.64.197
--tserver_master_addrs=127.21.64.254:38173
--webserver_port=42715
--webserver_interface=127.21.64.197
--builtin_ntp_servers=127.21.64.212:42671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
I20260810 01:56:27.366952 28464 heartbeater.cc:344] Connected to a master server at 127.21.64.254:38173
I20260810 01:56:27.367424 28464 heartbeater.cc:461] Registering TS with master...
I20260810 01:56:27.368507 28464 heartbeater.cc:507] Master 127.21.64.254:38173 requested a full tablet report, sending...
I20260810 01:56:27.370822 26457 ts_manager.cc:194] Re-registered known tserver with Master: 28812b178f824d539cab11abfe98d77d (127.21.64.196:41095)
I20260810 01:56:27.371811 26457 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.21.64.196:46411
W20260810 01:56:27.718715 28469 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:56:27.719058 28469 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:56:27.719194 28469 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 01:56:27.728384 28469 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260810 01:56:27.728497 28469 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:56:27.728694 28469 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.64.197
I20260810 01:56:27.739007 28469 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.64.212:42671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.64.197:46107
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--webserver_interface=127.21.64.197
--webserver_port=42715
--tserver_master_addrs=127.21.64.254:38173
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.64.197
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 01:44:04 UTC on e7f111948823
build id 13266
ASAN enabled
I20260810 01:56:27.740739 28469 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:56:27.742708 28469 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 01:56:27.752573 28476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:56:27.753846 28475 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:56:27.755541 28482 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:56:27.755995 28469 server_base.cc:1061] running on GCE node
I20260810 01:56:27.756613 28469 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:56:27.757670 28469 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:56:27.758934 28469 hybrid_clock.cc:648] HybridClock initialized: now 1786326987758872 us; error 45 us; skew 500 ppm
I20260810 01:56:27.759316 28469 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 01:56:27.761595 28469 webserver.cc:533] Webserver started at http://127.21.64.197:42715/ using document root <none> and password file <none>
I20260810 01:56:27.762365 28469 fs_manager.cc:362] Metadata directory not provided
I20260810 01:56:27.762548 28469 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:56:27.768440 28469 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.003s sys 0.002s
I20260810 01:56:27.771296 28490 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:56:27.772656 28469 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 01:56:27.772851 28469 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data,/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/wal
uuid: "8be4ab1c5cca41849942448806160d19"
format_stamp: "Formatted at 2026-08-10 01:56:15 on dist-test-slave-bw88"
I20260810 01:56:27.773731 28469 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/wal
metadata directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/wal
1 data directories: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:56:27.799541 28469 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 01:56:27.800439 28469 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:56:27.800758 28469 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:56:27.801826 28469 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260810 01:56:27.803571 28469 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:56:27.803699 28469 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:56:27.803845 28469 ts_tablet_manager.cc:616] Registered 0 tablets
I20260810 01:56:27.803941 28469 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:56:27.842321 28469 rpc_server.cc:307] RPC server started. Bound to: 127.21.64.197:46107
I20260810 01:56:27.842418 28647 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.64.197:46107 every 8 connection(s)
I20260810 01:56:27.843927 28469 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data/info.pb
I20260810 01:56:27.846663 21763 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNubV1X/build/asan/bin/kudu as pid 28469
I20260810 01:56:27.847442 21763 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNubV1X/build/asan/bin/kudu
/tmp/dist-test-taskNubV1X/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/wal
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/logs
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.64.198:41745
--local_ip_for_outbound_sockets=127.21.64.198
--tserver_master_addrs=127.21.64.254:38173
--webserver_port=44291
--webserver_interface=127.21.64.198
--builtin_ntp_servers=127.21.64.212:42671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
I20260810 01:56:27.861855 28648 heartbeater.cc:344] Connected to a master server at 127.21.64.254:38173
I20260810 01:56:27.862288 28648 heartbeater.cc:461] Registering TS with master...
I20260810 01:56:27.863224 28648 heartbeater.cc:507] Master 127.21.64.254:38173 requested a full tablet report, sending...
I20260810 01:56:27.866214 26456 ts_manager.cc:194] Re-registered known tserver with Master: 8be4ab1c5cca41849942448806160d19 (127.21.64.197:46107)
I20260810 01:56:27.867450 26456 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.21.64.197:56051
W20260810 01:56:28.231388 28652 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:56:28.231726 28652 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:56:28.231805 28652 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 01:56:28.240518 28652 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260810 01:56:28.240628 28652 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:56:28.240767 28652 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.64.198
I20260810 01:56:28.252317 28652 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.64.212:42671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/data
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.64.198:41745
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/data/info.pb
--webserver_interface=127.21.64.198
--webserver_port=44291
--tserver_master_addrs=127.21.64.254:38173
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.64.198
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 01:44:04 UTC on e7f111948823
build id 13266
ASAN enabled
I20260810 01:56:28.254719 28652 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:56:28.256973 28652 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 01:56:28.268253 28658 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:56:28.268724 28661 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:56:28.268893 28659 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:56:28.269690 28652 server_base.cc:1061] running on GCE node
I20260810 01:56:28.270325 28652 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:56:28.271312 28652 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:56:28.272563 28652 hybrid_clock.cc:648] HybridClock initialized: now 1786326988272476 us; error 54 us; skew 500 ppm
I20260810 01:56:28.272887 28652 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 01:56:28.275183 28652 webserver.cc:533] Webserver started at http://127.21.64.198:44291/ using document root <none> and password file <none>
I20260810 01:56:28.275981 28652 fs_manager.cc:362] Metadata directory not provided
I20260810 01:56:28.276154 28652 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:56:28.281819 28652 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260810 01:56:28.284669 28672 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:56:28.286186 28652 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:56:28.286405 28652 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/data,/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/wal
uuid: "9353b63b4d854d23b51a8103bc899aab"
format_stamp: "Formatted at 2026-08-10 01:56:15 on dist-test-slave-bw88"
I20260810 01:56:28.287307 28652 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/wal
metadata directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/wal
1 data directories: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:56:28.315164 28652 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 01:56:28.316290 28652 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:56:28.316636 28652 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:56:28.317947 28652 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260810 01:56:28.320188 28652 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:56:28.320417 28652 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:56:28.320544 28652 ts_tablet_manager.cc:616] Registered 0 tablets
I20260810 01:56:28.320627 28652 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:56:28.368999 28652 rpc_server.cc:307] RPC server started. Bound to: 127.21.64.198:41745
I20260810 01:56:28.369095 28824 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.64.198:41745 every 8 connection(s)
I20260810 01:56:28.370747 28652 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/data/info.pb
I20260810 01:56:28.374655 28464 heartbeater.cc:499] Master 127.21.64.254:38173 was elected leader, sending a full tablet report...
I20260810 01:56:28.377640 21763 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNubV1X/build/asan/bin/kudu as pid 28652
I20260810 01:56:28.378520 21763 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNubV1X/build/asan/bin/kudu
/tmp/dist-test-taskNubV1X/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/wal
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/logs
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.64.199:42747
--local_ip_for_outbound_sockets=127.21.64.199
--tserver_master_addrs=127.21.64.254:38173
--webserver_port=46429
--webserver_interface=127.21.64.199
--builtin_ntp_servers=127.21.64.212:42671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
I20260810 01:56:28.386612 28825 heartbeater.cc:344] Connected to a master server at 127.21.64.254:38173
I20260810 01:56:28.386999 28825 heartbeater.cc:461] Registering TS with master...
I20260810 01:56:28.387840 28825 heartbeater.cc:507] Master 127.21.64.254:38173 requested a full tablet report, sending...
I20260810 01:56:28.389472 26456 ts_manager.cc:194] Re-registered known tserver with Master: 9353b63b4d854d23b51a8103bc899aab (127.21.64.198:41745)
I20260810 01:56:28.390317 26456 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.21.64.198:49569
W20260810 01:56:28.789183 28830 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:56:28.789590 28830 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:56:28.789752 28830 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 01:56:28.798074 28830 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260810 01:56:28.798159 28830 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:56:28.798342 28830 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.64.199
I20260810 01:56:28.808445 28830 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.64.212:42671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/data
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.64.199:42747
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/data/info.pb
--webserver_interface=127.21.64.199
--webserver_port=46429
--tserver_master_addrs=127.21.64.254:38173
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.64.199
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 01:44:04 UTC on e7f111948823
build id 13266
ASAN enabled
I20260810 01:56:28.810232 28830 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:56:28.812104 28830 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 01:56:28.821712 28838 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:56:28.821717 28837 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:56:28.822499 28841 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:56:28.823195 28830 server_base.cc:1061] running on GCE node
I20260810 01:56:28.823794 28830 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:56:28.824753 28830 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:56:28.826009 28830 hybrid_clock.cc:648] HybridClock initialized: now 1786326988825937 us; error 41 us; skew 500 ppm
I20260810 01:56:28.826432 28830 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 01:56:28.828877 28830 webserver.cc:533] Webserver started at http://127.21.64.199:46429/ using document root <none> and password file <none>
I20260810 01:56:28.829726 28830 fs_manager.cc:362] Metadata directory not provided
I20260810 01:56:28.829900 28830 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:56:28.835327 28830 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260810 01:56:28.838104 28849 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:56:28.839466 28830 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:56:28.839648 28830 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/data,/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/wal
uuid: "07e0a39216984856b2ff8c512c4c2f93"
format_stamp: "Formatted at 2026-08-10 01:56:16 on dist-test-slave-bw88"
I20260810 01:56:28.840430 28830 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/wal
metadata directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/wal
1 data directories: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:56:28.869016 28830 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 01:56:28.870002 28830 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:56:28.870337 28830 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:56:28.871228 28648 heartbeater.cc:499] Master 127.21.64.254:38173 was elected leader, sending a full tablet report...
I20260810 01:56:28.871493 28830 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260810 01:56:28.873716 28830 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:56:28.873816 28830 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:56:28.873982 28830 ts_tablet_manager.cc:616] Registered 0 tablets
I20260810 01:56:28.874058 28830 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:56:28.912884 28830 rpc_server.cc:307] RPC server started. Bound to: 127.21.64.199:42747
I20260810 01:56:28.913009 29005 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.64.199:42747 every 8 connection(s)
I20260810 01:56:28.914561 28830 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/data/info.pb
I20260810 01:56:28.924686 21763 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNubV1X/build/asan/bin/kudu as pid 28830
I20260810 01:56:28.928478 29006 heartbeater.cc:344] Connected to a master server at 127.21.64.254:38173
I20260810 01:56:28.928923 29006 heartbeater.cc:461] Registering TS with master...
I20260810 01:56:28.930145 29006 heartbeater.cc:507] Master 127.21.64.254:38173 requested a full tablet report, sending...
I20260810 01:56:28.932150 26457 ts_manager.cc:194] Re-registered known tserver with Master: 07e0a39216984856b2ff8c512c4c2f93 (127.21.64.199:42747)
I20260810 01:56:28.933118 26457 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.21.64.199:38361
I20260810 01:56:28.943837 21763 test_workload.cc:405] TestWorkload: Skipping table creation because table rebalance_test_table_0 already exists
I20260810 01:56:28.975577 21763 test_workload.cc:405] TestWorkload: Skipping table creation because table rebalance_test_table_1 already exists
I20260810 01:56:29.026645 21763 test_workload.cc:405] TestWorkload: Skipping table creation because table rebalance_test_table_2 already exists
I20260810 01:56:29.074476 21763 test_workload.cc:405] TestWorkload: Skipping table creation because table rebalance_test_table_3 already exists
I20260810 01:56:29.179967 21763 test_workload.cc:405] TestWorkload: Skipping table creation because table rebalance_test_table_4 already exists
I20260810 01:56:29.394233 28825 heartbeater.cc:499] Master 127.21.64.254:38173 was elected leader, sending a full tablet report...
I20260810 01:56:29.936690 29006 heartbeater.cc:499] Master 127.21.64.254:38173 was elected leader, sending a full tablet report...
I20260810 01:56:30.419055 28916 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:30.461216 28379 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:30.495924 26806 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:56:30.536484 28563 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:30.563516 26976 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:56:30.563741 28739 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:30.654816 26634 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:56:31.550761 28916 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:31.577272 26976 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:56:31.601068 28563 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:31.616091 28739 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:31.620719 28379 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:31.638859 26806 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:56:31.785564 26634 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:56:32.275892 26658 consensus_queue.cc:237] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 48, Committed index: 48, Last appended: 1.48, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 49 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } }
I20260810 01:56:32.296274 26833 raft_consensus.cc:1275] T b59ebeb3dc294227a54a82a640c798ce P 60d4538b78b44201964cf440ea562c72 [term 1 FOLLOWER]: Refusing update from remote peer a46364d7cd504f8ca7fc003c59ae6d31: Log matching property violated. Preceding OpId in replica: term: 1 index: 48. Preceding OpId from leader: term: 1 index: 49. (index mismatch)
I20260810 01:56:32.297242 29211 consensus_queue.cc:1048] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 49, Last known committed idx: 48, Time since last communication: 0.000s
I20260810 01:56:32.305431 29143 raft_consensus.cc:2955] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 LEADER]: Committing config change with OpId 1.49: config changed from index -1 to 49, VOTER 07e0a39216984856b2ff8c512c4c2f93 (127.21.64.199) added. New config: { opid_index: 49 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } }
I20260810 01:56:32.310312 26832 raft_consensus.cc:2955] T b59ebeb3dc294227a54a82a640c798ce P 60d4538b78b44201964cf440ea562c72 [term 1 FOLLOWER]: Committing config change with OpId 1.49: config changed from index -1 to 49, VOTER 07e0a39216984856b2ff8c512c4c2f93 (127.21.64.199) added. New config: { opid_index: 49 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } }
I20260810 01:56:32.319089 26457 catalog_manager.cc:5719] T b59ebeb3dc294227a54a82a640c798ce P 60d4538b78b44201964cf440ea562c72 reported cstate change: config changed from index -1 to 49, VOTER 07e0a39216984856b2ff8c512c4c2f93 (127.21.64.199) added. New cstate: current_term: 1 leader_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" committed_config { opid_index: 49 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } }
W20260810 01:56:32.357810 26576 consensus_peers.cc:597] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31 -> Peer 07e0a39216984856b2ff8c512c4c2f93 (127.21.64.199:42747): Couldn't send request to peer 07e0a39216984856b2ff8c512c4c2f93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b59ebeb3dc294227a54a82a640c798ce. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:56:32.740358 29330 ts_tablet_manager.cc:933] T b59ebeb3dc294227a54a82a640c798ce P 07e0a39216984856b2ff8c512c4c2f93: Initiating tablet copy from peer a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193:45781)
I20260810 01:56:32.753995 29330 tablet_copy_client.cc:323] T b59ebeb3dc294227a54a82a640c798ce P 07e0a39216984856b2ff8c512c4c2f93: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.193:45781
I20260810 01:56:32.786051 26686 tablet_copy_service.cc:140] P a46364d7cd504f8ca7fc003c59ae6d31: Received BeginTabletCopySession request for tablet b59ebeb3dc294227a54a82a640c798ce from peer 07e0a39216984856b2ff8c512c4c2f93 ({username='slave'} at 127.21.64.199:43241)
I20260810 01:56:32.786453 26686 tablet_copy_service.cc:161] P a46364d7cd504f8ca7fc003c59ae6d31: Beginning new tablet copy session on tablet b59ebeb3dc294227a54a82a640c798ce from peer 07e0a39216984856b2ff8c512c4c2f93 at {username='slave'} at 127.21.64.199:43241: session id = 07e0a39216984856b2ff8c512c4c2f93-b59ebeb3dc294227a54a82a640c798ce
I20260810 01:56:32.801601 26686 tablet_copy_source_session.cc:215] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:56:32.826249 29330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b59ebeb3dc294227a54a82a640c798ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:56:32.838248 26657 consensus_queue.cc:237] T 059177b44a51490f9765e20391967605 P a46364d7cd504f8ca7fc003c59ae6d31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 65, Committed index: 65, Last appended: 1.65, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 66 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } }
I20260810 01:56:32.851135 27006 raft_consensus.cc:1275] T 059177b44a51490f9765e20391967605 P 56388bef1a0f453cadc8b6aa9434311d [term 1 FOLLOWER]: Refusing update from remote peer a46364d7cd504f8ca7fc003c59ae6d31: Log matching property violated. Preceding OpId in replica: term: 1 index: 65. Preceding OpId from leader: term: 1 index: 66. (index mismatch)
I20260810 01:56:32.852535 29325 consensus_queue.cc:1048] T 059177b44a51490f9765e20391967605 P a46364d7cd504f8ca7fc003c59ae6d31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 66, Last known committed idx: 65, Time since last communication: 0.000s
I20260810 01:56:32.864812 29330 tablet_copy_client.cc:806] T b59ebeb3dc294227a54a82a640c798ce P 07e0a39216984856b2ff8c512c4c2f93: tablet copy: Starting download of 0 data blocks...
I20260810 01:56:32.865415 29330 tablet_copy_client.cc:670] T b59ebeb3dc294227a54a82a640c798ce P 07e0a39216984856b2ff8c512c4c2f93: tablet copy: Starting download of 1 WAL segments...
I20260810 01:56:32.872473 29330 tablet_copy_client.cc:538] T b59ebeb3dc294227a54a82a640c798ce P 07e0a39216984856b2ff8c512c4c2f93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:56:32.877861 29142 raft_consensus.cc:2955] T 059177b44a51490f9765e20391967605 P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 LEADER]: Committing config change with OpId 1.66: config changed from index -1 to 66, VOTER 9353b63b4d854d23b51a8103bc899aab (127.21.64.198) added. New config: { opid_index: 66 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } } }
I20260810 01:56:32.879739 29330 tablet_bootstrap.cc:492] T b59ebeb3dc294227a54a82a640c798ce P 07e0a39216984856b2ff8c512c4c2f93: Bootstrap starting.
W20260810 01:56:32.887117 26577 consensus_peers.cc:597] T 059177b44a51490f9765e20391967605 P a46364d7cd504f8ca7fc003c59ae6d31 -> Peer 9353b63b4d854d23b51a8103bc899aab (127.21.64.198:41745): Couldn't send request to peer 9353b63b4d854d23b51a8103bc899aab. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 059177b44a51490f9765e20391967605. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:56:32.890657 27006 raft_consensus.cc:2955] T 059177b44a51490f9765e20391967605 P 56388bef1a0f453cadc8b6aa9434311d [term 1 FOLLOWER]: Committing config change with OpId 1.66: config changed from index -1 to 66, VOTER 9353b63b4d854d23b51a8103bc899aab (127.21.64.198) added. New config: { opid_index: 66 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } } }
I20260810 01:56:32.891530 26456 catalog_manager.cc:5719] T 059177b44a51490f9765e20391967605 P a46364d7cd504f8ca7fc003c59ae6d31 reported cstate change: config changed from index -1 to 66, VOTER 9353b63b4d854d23b51a8103bc899aab (127.21.64.198) added. New cstate: current_term: 1 leader_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" committed_config { opid_index: 66 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } } }
I20260810 01:56:32.975780 29330 log.cc:826] T b59ebeb3dc294227a54a82a640c798ce P 07e0a39216984856b2ff8c512c4c2f93: Log is configured to *not* fsync() on all Append() calls
I20260810 01:56:33.204134 27005 consensus_queue.cc:237] T e8b0ab1f966840f3ade9f44232b39a5a P 56388bef1a0f453cadc8b6aa9434311d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 69, Committed index: 69, Last appended: 1.69, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 70 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } }
I20260810 01:56:33.207603 26660 raft_consensus.cc:1275] T e8b0ab1f966840f3ade9f44232b39a5a P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 FOLLOWER]: Refusing update from remote peer 56388bef1a0f453cadc8b6aa9434311d: Log matching property violated. Preceding OpId in replica: term: 1 index: 69. Preceding OpId from leader: term: 1 index: 70. (index mismatch)
I20260810 01:56:33.216775 29136 consensus_queue.cc:1048] T e8b0ab1f966840f3ade9f44232b39a5a P 56388bef1a0f453cadc8b6aa9434311d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 70, Last known committed idx: 69, Time since last communication: 0.000s
I20260810 01:56:33.217444 29330 tablet_bootstrap.cc:492] T b59ebeb3dc294227a54a82a640c798ce P 07e0a39216984856b2ff8c512c4c2f93: Bootstrap replayed 1/1 log segments. Stats: ops{read=64 overwritten=0 applied=63 ignored=0} inserts{seen=735 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260810 01:56:33.218431 29330 tablet_bootstrap.cc:492] T b59ebeb3dc294227a54a82a640c798ce P 07e0a39216984856b2ff8c512c4c2f93: Bootstrap complete.
I20260810 01:56:33.219842 29330 ts_tablet_manager.cc:1403] T b59ebeb3dc294227a54a82a640c798ce P 07e0a39216984856b2ff8c512c4c2f93: Time spent bootstrapping tablet: real 0.340s user 0.162s sys 0.010s
I20260810 01:56:33.226038 29330 raft_consensus.cc:359] T b59ebeb3dc294227a54a82a640c798ce P 07e0a39216984856b2ff8c512c4c2f93 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: 49 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } }
I20260810 01:56:33.228453 29330 raft_consensus.cc:740] T b59ebeb3dc294227a54a82a640c798ce P 07e0a39216984856b2ff8c512c4c2f93 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07e0a39216984856b2ff8c512c4c2f93, State: Initialized, Role: FOLLOWER
I20260810 01:56:33.228708 29342 raft_consensus.cc:2955] T e8b0ab1f966840f3ade9f44232b39a5a P 56388bef1a0f453cadc8b6aa9434311d [term 1 LEADER]: Committing config change with OpId 1.70: config changed from index -1 to 70, VOTER 28812b178f824d539cab11abfe98d77d (127.21.64.196) added. New config: { opid_index: 70 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } } }
I20260810 01:56:33.229275 29330 consensus_queue.cc:260] T b59ebeb3dc294227a54a82a640c798ce P 07e0a39216984856b2ff8c512c4c2f93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 63, Last appended: 1.64, Last appended by leader: 64, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 49 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } }
I20260810 01:56:33.237263 26456 catalog_manager.cc:5719] T e8b0ab1f966840f3ade9f44232b39a5a P 56388bef1a0f453cadc8b6aa9434311d reported cstate change: config changed from index -1 to 70, VOTER 28812b178f824d539cab11abfe98d77d (127.21.64.196) added. New cstate: current_term: 1 leader_uuid: "56388bef1a0f453cadc8b6aa9434311d" committed_config { opid_index: 70 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } } }
I20260810 01:56:33.238020 29330 ts_tablet_manager.cc:1434] T b59ebeb3dc294227a54a82a640c798ce P 07e0a39216984856b2ff8c512c4c2f93: Time spent starting tablet: real 0.018s user 0.013s sys 0.004s
I20260810 01:56:33.239514 26660 raft_consensus.cc:2955] T e8b0ab1f966840f3ade9f44232b39a5a P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 FOLLOWER]: Committing config change with OpId 1.70: config changed from index -1 to 70, VOTER 28812b178f824d539cab11abfe98d77d (127.21.64.196) added. New config: { opid_index: 70 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } } }
I20260810 01:56:33.240307 26686 tablet_copy_service.cc:342] P a46364d7cd504f8ca7fc003c59ae6d31: Request end of tablet copy session 07e0a39216984856b2ff8c512c4c2f93-b59ebeb3dc294227a54a82a640c798ce received from {username='slave'} at 127.21.64.199:43241
I20260810 01:56:33.240612 26686 tablet_copy_service.cc:434] P a46364d7cd504f8ca7fc003c59ae6d31: ending tablet copy session 07e0a39216984856b2ff8c512c4c2f93-b59ebeb3dc294227a54a82a640c798ce on tablet b59ebeb3dc294227a54a82a640c798ce with peer 07e0a39216984856b2ff8c512c4c2f93
W20260810 01:56:33.272480 26910 consensus_peers.cc:597] T e8b0ab1f966840f3ade9f44232b39a5a P 56388bef1a0f453cadc8b6aa9434311d -> Peer 28812b178f824d539cab11abfe98d77d (127.21.64.196:41095): Couldn't send request to peer 28812b178f824d539cab11abfe98d77d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e8b0ab1f966840f3ade9f44232b39a5a. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:56:33.284422 28943 raft_consensus.cc:1217] T b59ebeb3dc294227a54a82a640c798ce P 07e0a39216984856b2ff8c512c4c2f93 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.48->[1.49-1.70] Dedup: 1.64->[1.65-1.70]
I20260810 01:56:33.431715 29400 ts_tablet_manager.cc:933] T 059177b44a51490f9765e20391967605 P 9353b63b4d854d23b51a8103bc899aab: Initiating tablet copy from peer a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193:45781)
I20260810 01:56:33.480384 26660 consensus_queue.cc:237] T 39a14ec9527d43b4a6f78b48ad4165cf P a46364d7cd504f8ca7fc003c59ae6d31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 77, Committed index: 77, Last appended: 1.78, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 79 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } }
I20260810 01:56:33.501008 26832 raft_consensus.cc:1275] T 39a14ec9527d43b4a6f78b48ad4165cf P 60d4538b78b44201964cf440ea562c72 [term 1 FOLLOWER]: Refusing update from remote peer a46364d7cd504f8ca7fc003c59ae6d31: Log matching property violated. Preceding OpId in replica: term: 1 index: 78. Preceding OpId from leader: term: 1 index: 79. (index mismatch)
I20260810 01:56:33.507579 29142 consensus_queue.cc:1048] T 39a14ec9527d43b4a6f78b48ad4165cf P a46364d7cd504f8ca7fc003c59ae6d31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 79, Last known committed idx: 77, Time since last communication: 0.000s
I20260810 01:56:33.516412 29211 raft_consensus.cc:2955] T 39a14ec9527d43b4a6f78b48ad4165cf P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 LEADER]: Committing config change with OpId 1.79: config changed from index -1 to 79, VOTER 8be4ab1c5cca41849942448806160d19 (127.21.64.197) added. New config: { opid_index: 79 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } } }
I20260810 01:56:33.524369 26457 catalog_manager.cc:5719] T 39a14ec9527d43b4a6f78b48ad4165cf P a46364d7cd504f8ca7fc003c59ae6d31 reported cstate change: config changed from index -1 to 79, VOTER 8be4ab1c5cca41849942448806160d19 (127.21.64.197) added. New cstate: current_term: 1 leader_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" committed_config { opid_index: 79 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } } }
I20260810 01:56:33.528412 26830 raft_consensus.cc:2955] T 39a14ec9527d43b4a6f78b48ad4165cf P 60d4538b78b44201964cf440ea562c72 [term 1 FOLLOWER]: Committing config change with OpId 1.79: config changed from index -1 to 79, VOTER 8be4ab1c5cca41849942448806160d19 (127.21.64.197) added. New config: { opid_index: 79 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } } }
I20260810 01:56:33.563369 29400 tablet_copy_client.cc:323] T 059177b44a51490f9765e20391967605 P 9353b63b4d854d23b51a8103bc899aab: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.193:45781
I20260810 01:56:33.580138 26686 tablet_copy_service.cc:140] P a46364d7cd504f8ca7fc003c59ae6d31: Received BeginTabletCopySession request for tablet 059177b44a51490f9765e20391967605 from peer 9353b63b4d854d23b51a8103bc899aab ({username='slave'} at 127.21.64.198:38739)
I20260810 01:56:33.580387 26686 tablet_copy_service.cc:161] P a46364d7cd504f8ca7fc003c59ae6d31: Beginning new tablet copy session on tablet 059177b44a51490f9765e20391967605 from peer 9353b63b4d854d23b51a8103bc899aab at {username='slave'} at 127.21.64.198:38739: session id = 9353b63b4d854d23b51a8103bc899aab-059177b44a51490f9765e20391967605
I20260810 01:56:33.583549 26686 tablet_copy_source_session.cc:215] T 059177b44a51490f9765e20391967605 P a46364d7cd504f8ca7fc003c59ae6d31: Tablet Copy: opened 0 blocks and 1 log segments
W20260810 01:56:33.585278 26574 consensus_peers.cc:597] T 39a14ec9527d43b4a6f78b48ad4165cf P a46364d7cd504f8ca7fc003c59ae6d31 -> Peer 8be4ab1c5cca41849942448806160d19 (127.21.64.197:46107): Couldn't send request to peer 8be4ab1c5cca41849942448806160d19. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 39a14ec9527d43b4a6f78b48ad4165cf. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:56:33.593431 29400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 059177b44a51490f9765e20391967605. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:56:33.611356 29400 tablet_copy_client.cc:806] T 059177b44a51490f9765e20391967605 P 9353b63b4d854d23b51a8103bc899aab: tablet copy: Starting download of 0 data blocks...
I20260810 01:56:33.611897 29400 tablet_copy_client.cc:670] T 059177b44a51490f9765e20391967605 P 9353b63b4d854d23b51a8103bc899aab: tablet copy: Starting download of 1 WAL segments...
I20260810 01:56:33.624120 29400 tablet_copy_client.cc:538] T 059177b44a51490f9765e20391967605 P 9353b63b4d854d23b51a8103bc899aab: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:56:33.628693 29400 tablet_bootstrap.cc:492] T 059177b44a51490f9765e20391967605 P 9353b63b4d854d23b51a8103bc899aab: Bootstrap starting.
I20260810 01:56:33.657850 29400 log.cc:826] T 059177b44a51490f9765e20391967605 P 9353b63b4d854d23b51a8103bc899aab: Log is configured to *not* fsync() on all Append() calls
I20260810 01:56:33.733201 26830 consensus_queue.cc:237] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 78, Committed index: 78, Last appended: 1.78, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 79 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } }
I20260810 01:56:33.739902 26659 raft_consensus.cc:1275] T c72cec0deb794dac95b7a88308c56167 P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 FOLLOWER]: Refusing update from remote peer 60d4538b78b44201964cf440ea562c72: Log matching property violated. Preceding OpId in replica: term: 1 index: 78. Preceding OpId from leader: term: 1 index: 79. (index mismatch)
I20260810 01:56:33.740644 29094 consensus_queue.cc:1048] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 79, Last known committed idx: 78, Time since last communication: 0.000s
I20260810 01:56:33.743660 29088 raft_consensus.cc:2955] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72 [term 1 LEADER]: Committing config change with OpId 1.79: config changed from index -1 to 79, VOTER 07e0a39216984856b2ff8c512c4c2f93 (127.21.64.199) added. New config: { opid_index: 79 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } }
I20260810 01:56:33.747298 26659 raft_consensus.cc:2955] T c72cec0deb794dac95b7a88308c56167 P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 FOLLOWER]: Committing config change with OpId 1.79: config changed from index -1 to 79, VOTER 07e0a39216984856b2ff8c512c4c2f93 (127.21.64.199) added. New config: { opid_index: 79 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } }
I20260810 01:56:33.768522 26457 catalog_manager.cc:5719] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72 reported cstate change: config changed from index -1 to 79, VOTER 07e0a39216984856b2ff8c512c4c2f93 (127.21.64.199) added. New cstate: current_term: 1 leader_uuid: "60d4538b78b44201964cf440ea562c72" committed_config { opid_index: 79 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } }
I20260810 01:56:33.800937 29436 ts_tablet_manager.cc:933] T e8b0ab1f966840f3ade9f44232b39a5a P 28812b178f824d539cab11abfe98d77d: Initiating tablet copy from peer 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195:45355)
W20260810 01:56:33.813373 26744 consensus_peers.cc:597] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72 -> Peer 07e0a39216984856b2ff8c512c4c2f93 (127.21.64.199:42747): Couldn't send request to peer 07e0a39216984856b2ff8c512c4c2f93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c72cec0deb794dac95b7a88308c56167. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:56:33.836115 29436 tablet_copy_client.cc:323] T e8b0ab1f966840f3ade9f44232b39a5a P 28812b178f824d539cab11abfe98d77d: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.195:45355
I20260810 01:56:33.891862 27035 tablet_copy_service.cc:140] P 56388bef1a0f453cadc8b6aa9434311d: Received BeginTabletCopySession request for tablet e8b0ab1f966840f3ade9f44232b39a5a from peer 28812b178f824d539cab11abfe98d77d ({username='slave'} at 127.21.64.196:39635)
I20260810 01:56:33.892180 27035 tablet_copy_service.cc:161] P 56388bef1a0f453cadc8b6aa9434311d: Beginning new tablet copy session on tablet e8b0ab1f966840f3ade9f44232b39a5a from peer 28812b178f824d539cab11abfe98d77d at {username='slave'} at 127.21.64.196:39635: session id = 28812b178f824d539cab11abfe98d77d-e8b0ab1f966840f3ade9f44232b39a5a
I20260810 01:56:33.899174 27035 tablet_copy_source_session.cc:215] T e8b0ab1f966840f3ade9f44232b39a5a P 56388bef1a0f453cadc8b6aa9434311d: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:56:33.907208 29436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8b0ab1f966840f3ade9f44232b39a5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:56:33.938936 29436 tablet_copy_client.cc:806] T e8b0ab1f966840f3ade9f44232b39a5a P 28812b178f824d539cab11abfe98d77d: tablet copy: Starting download of 0 data blocks...
I20260810 01:56:33.939466 29436 tablet_copy_client.cc:670] T e8b0ab1f966840f3ade9f44232b39a5a P 28812b178f824d539cab11abfe98d77d: tablet copy: Starting download of 1 WAL segments...
I20260810 01:56:33.947057 29436 tablet_copy_client.cc:538] T e8b0ab1f966840f3ade9f44232b39a5a P 28812b178f824d539cab11abfe98d77d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:56:33.952193 29436 tablet_bootstrap.cc:492] T e8b0ab1f966840f3ade9f44232b39a5a P 28812b178f824d539cab11abfe98d77d: Bootstrap starting.
I20260810 01:56:34.035830 29436 log.cc:826] T e8b0ab1f966840f3ade9f44232b39a5a P 28812b178f824d539cab11abfe98d77d: Log is configured to *not* fsync() on all Append() calls
I20260810 01:56:34.038929 29447 ts_tablet_manager.cc:933] T 39a14ec9527d43b4a6f78b48ad4165cf P 8be4ab1c5cca41849942448806160d19: Initiating tablet copy from peer a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193:45781)
I20260810 01:56:34.070293 29447 tablet_copy_client.cc:323] T 39a14ec9527d43b4a6f78b48ad4165cf P 8be4ab1c5cca41849942448806160d19: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.193:45781
I20260810 01:56:34.135068 29400 tablet_bootstrap.cc:492] T 059177b44a51490f9765e20391967605 P 9353b63b4d854d23b51a8103bc899aab: Bootstrap replayed 1/1 log segments. Stats: ops{read=76 overwritten=0 applied=76 ignored=0} inserts{seen=748 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:56:34.135896 29400 tablet_bootstrap.cc:492] T 059177b44a51490f9765e20391967605 P 9353b63b4d854d23b51a8103bc899aab: Bootstrap complete.
I20260810 01:56:34.136545 29400 ts_tablet_manager.cc:1403] T 059177b44a51490f9765e20391967605 P 9353b63b4d854d23b51a8103bc899aab: Time spent bootstrapping tablet: real 0.508s user 0.190s sys 0.040s
I20260810 01:56:34.138024 26686 tablet_copy_service.cc:140] P a46364d7cd504f8ca7fc003c59ae6d31: Received BeginTabletCopySession request for tablet 39a14ec9527d43b4a6f78b48ad4165cf from peer 8be4ab1c5cca41849942448806160d19 ({username='slave'} at 127.21.64.197:48821)
I20260810 01:56:34.138200 26686 tablet_copy_service.cc:161] P a46364d7cd504f8ca7fc003c59ae6d31: Beginning new tablet copy session on tablet 39a14ec9527d43b4a6f78b48ad4165cf from peer 8be4ab1c5cca41849942448806160d19 at {username='slave'} at 127.21.64.197:48821: session id = 8be4ab1c5cca41849942448806160d19-39a14ec9527d43b4a6f78b48ad4165cf
I20260810 01:56:34.141927 26686 tablet_copy_source_session.cc:215] T 39a14ec9527d43b4a6f78b48ad4165cf P a46364d7cd504f8ca7fc003c59ae6d31: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:56:34.147294 29400 raft_consensus.cc:359] T 059177b44a51490f9765e20391967605 P 9353b63b4d854d23b51a8103bc899aab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 66 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } }
I20260810 01:56:34.148722 29447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39a14ec9527d43b4a6f78b48ad4165cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:56:34.148917 29400 raft_consensus.cc:740] T 059177b44a51490f9765e20391967605 P 9353b63b4d854d23b51a8103bc899aab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9353b63b4d854d23b51a8103bc899aab, State: Initialized, Role: FOLLOWER
I20260810 01:56:34.149819 29400 consensus_queue.cc:260] T 059177b44a51490f9765e20391967605 P 9353b63b4d854d23b51a8103bc899aab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 76, Last appended: 1.76, Last appended by leader: 76, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 66 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } }
I20260810 01:56:34.179207 29465 ts_tablet_manager.cc:933] T c72cec0deb794dac95b7a88308c56167 P 07e0a39216984856b2ff8c512c4c2f93: Initiating tablet copy from peer 60d4538b78b44201964cf440ea562c72 (127.21.64.194:36943)
I20260810 01:56:34.209594 29465 tablet_copy_client.cc:323] T c72cec0deb794dac95b7a88308c56167 P 07e0a39216984856b2ff8c512c4c2f93: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.194:36943
I20260810 01:56:34.226634 29400 ts_tablet_manager.cc:1434] T 059177b44a51490f9765e20391967605 P 9353b63b4d854d23b51a8103bc899aab: Time spent starting tablet: real 0.090s user 0.020s sys 0.009s
I20260810 01:56:34.227890 26686 tablet_copy_service.cc:342] P a46364d7cd504f8ca7fc003c59ae6d31: Request end of tablet copy session 9353b63b4d854d23b51a8103bc899aab-059177b44a51490f9765e20391967605 received from {username='slave'} at 127.21.64.198:38739
I20260810 01:56:34.228088 26686 tablet_copy_service.cc:434] P a46364d7cd504f8ca7fc003c59ae6d31: ending tablet copy session 9353b63b4d854d23b51a8103bc899aab-059177b44a51490f9765e20391967605 on tablet 059177b44a51490f9765e20391967605 with peer 9353b63b4d854d23b51a8103bc899aab
I20260810 01:56:34.238272 26660 consensus_queue.cc:237] T fdf1cc811a8349efa251d05e9b077fad P a46364d7cd504f8ca7fc003c59ae6d31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 114, Committed index: 114, Last appended: 1.115, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 116 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } }
I20260810 01:56:34.238777 29447 tablet_copy_client.cc:806] T 39a14ec9527d43b4a6f78b48ad4165cf P 8be4ab1c5cca41849942448806160d19: tablet copy: Starting download of 0 data blocks...
I20260810 01:56:34.239238 29447 tablet_copy_client.cc:670] T 39a14ec9527d43b4a6f78b48ad4165cf P 8be4ab1c5cca41849942448806160d19: tablet copy: Starting download of 1 WAL segments...
I20260810 01:56:34.241999 27005 raft_consensus.cc:1275] T fdf1cc811a8349efa251d05e9b077fad P 56388bef1a0f453cadc8b6aa9434311d [term 1 FOLLOWER]: Refusing update from remote peer a46364d7cd504f8ca7fc003c59ae6d31: Log matching property violated. Preceding OpId in replica: term: 1 index: 114. Preceding OpId from leader: term: 1 index: 116. (index mismatch)
I20260810 01:56:34.242580 29447 tablet_copy_client.cc:538] T 39a14ec9527d43b4a6f78b48ad4165cf P 8be4ab1c5cca41849942448806160d19: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:56:34.242743 29428 consensus_queue.cc:1048] T fdf1cc811a8349efa251d05e9b077fad P a46364d7cd504f8ca7fc003c59ae6d31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 116, Last known committed idx: 114, Time since last communication: 0.000s
I20260810 01:56:34.248164 29428 raft_consensus.cc:2955] T fdf1cc811a8349efa251d05e9b077fad P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 LEADER]: Committing config change with OpId 1.116: config changed from index -1 to 116, VOTER 28812b178f824d539cab11abfe98d77d (127.21.64.196) added. New config: { opid_index: 116 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } } }
I20260810 01:56:34.251590 29447 tablet_bootstrap.cc:492] T 39a14ec9527d43b4a6f78b48ad4165cf P 8be4ab1c5cca41849942448806160d19: Bootstrap starting.
I20260810 01:56:34.258554 27005 raft_consensus.cc:2955] T fdf1cc811a8349efa251d05e9b077fad P 56388bef1a0f453cadc8b6aa9434311d [term 1 FOLLOWER]: Committing config change with OpId 1.116: config changed from index -1 to 116, VOTER 28812b178f824d539cab11abfe98d77d (127.21.64.196) added. New config: { opid_index: 116 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } } }
I20260810 01:56:34.259964 26457 catalog_manager.cc:5719] T fdf1cc811a8349efa251d05e9b077fad P a46364d7cd504f8ca7fc003c59ae6d31 reported cstate change: config changed from index -1 to 116, VOTER 28812b178f824d539cab11abfe98d77d (127.21.64.196) added. New cstate: current_term: 1 leader_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" committed_config { opid_index: 116 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } } }
W20260810 01:56:34.279044 26574 consensus_peers.cc:597] T fdf1cc811a8349efa251d05e9b077fad P a46364d7cd504f8ca7fc003c59ae6d31 -> Peer 28812b178f824d539cab11abfe98d77d (127.21.64.196:41095): Couldn't send request to peer 28812b178f824d539cab11abfe98d77d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fdf1cc811a8349efa251d05e9b077fad. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:56:34.338065 29447 log.cc:826] T 39a14ec9527d43b4a6f78b48ad4165cf P 8be4ab1c5cca41849942448806160d19: Log is configured to *not* fsync() on all Append() calls
I20260810 01:56:34.442072 28769 raft_consensus.cc:1217] T 059177b44a51490f9765e20391967605 P 9353b63b4d854d23b51a8103bc899aab [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.65->[1.66-1.85] Dedup: 1.76->[1.77-1.85]
I20260810 01:56:34.608795 29436 tablet_bootstrap.cc:492] T e8b0ab1f966840f3ade9f44232b39a5a P 28812b178f824d539cab11abfe98d77d: Bootstrap replayed 1/1 log segments. Stats: ops{read=75 overwritten=0 applied=75 ignored=0} inserts{seen=760 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:56:34.612843 29436 tablet_bootstrap.cc:492] T e8b0ab1f966840f3ade9f44232b39a5a P 28812b178f824d539cab11abfe98d77d: Bootstrap complete.
I20260810 01:56:34.615847 29436 ts_tablet_manager.cc:1403] T e8b0ab1f966840f3ade9f44232b39a5a P 28812b178f824d539cab11abfe98d77d: Time spent bootstrapping tablet: real 0.664s user 0.166s sys 0.009s
I20260810 01:56:34.637791 26856 tablet_copy_service.cc:140] P 60d4538b78b44201964cf440ea562c72: Received BeginTabletCopySession request for tablet c72cec0deb794dac95b7a88308c56167 from peer 07e0a39216984856b2ff8c512c4c2f93 ({username='slave'} at 127.21.64.199:33581)
I20260810 01:56:34.638135 26856 tablet_copy_service.cc:161] P 60d4538b78b44201964cf440ea562c72: Beginning new tablet copy session on tablet c72cec0deb794dac95b7a88308c56167 from peer 07e0a39216984856b2ff8c512c4c2f93 at {username='slave'} at 127.21.64.199:33581: session id = 07e0a39216984856b2ff8c512c4c2f93-c72cec0deb794dac95b7a88308c56167
I20260810 01:56:34.643759 26856 tablet_copy_source_session.cc:215] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:56:34.645839 29465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c72cec0deb794dac95b7a88308c56167. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:56:34.656199 29465 tablet_copy_client.cc:806] T c72cec0deb794dac95b7a88308c56167 P 07e0a39216984856b2ff8c512c4c2f93: tablet copy: Starting download of 0 data blocks...
I20260810 01:56:34.656561 29465 tablet_copy_client.cc:670] T c72cec0deb794dac95b7a88308c56167 P 07e0a39216984856b2ff8c512c4c2f93: tablet copy: Starting download of 1 WAL segments...
I20260810 01:56:34.660194 29436 raft_consensus.cc:359] T e8b0ab1f966840f3ade9f44232b39a5a P 28812b178f824d539cab11abfe98d77d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 70 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } }
I20260810 01:56:34.660892 29465 tablet_copy_client.cc:538] T c72cec0deb794dac95b7a88308c56167 P 07e0a39216984856b2ff8c512c4c2f93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:56:34.666826 29465 tablet_bootstrap.cc:492] T c72cec0deb794dac95b7a88308c56167 P 07e0a39216984856b2ff8c512c4c2f93: Bootstrap starting.
I20260810 01:56:34.667091 29436 raft_consensus.cc:740] T e8b0ab1f966840f3ade9f44232b39a5a P 28812b178f824d539cab11abfe98d77d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28812b178f824d539cab11abfe98d77d, State: Initialized, Role: FOLLOWER
I20260810 01:56:34.668910 29436 consensus_queue.cc:260] T e8b0ab1f966840f3ade9f44232b39a5a P 28812b178f824d539cab11abfe98d77d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 75, Last appended: 1.75, Last appended by leader: 75, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 70 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } }
I20260810 01:56:34.680696 29436 ts_tablet_manager.cc:1434] T e8b0ab1f966840f3ade9f44232b39a5a P 28812b178f824d539cab11abfe98d77d: Time spent starting tablet: real 0.064s user 0.011s sys 0.000s
I20260810 01:56:34.693400 27035 tablet_copy_service.cc:342] P 56388bef1a0f453cadc8b6aa9434311d: Request end of tablet copy session 28812b178f824d539cab11abfe98d77d-e8b0ab1f966840f3ade9f44232b39a5a received from {username='slave'} at 127.21.64.196:39635
I20260810 01:56:34.693634 27035 tablet_copy_service.cc:434] P 56388bef1a0f453cadc8b6aa9434311d: ending tablet copy session 28812b178f824d539cab11abfe98d77d-e8b0ab1f966840f3ade9f44232b39a5a on tablet e8b0ab1f966840f3ade9f44232b39a5a with peer 28812b178f824d539cab11abfe98d77d
I20260810 01:56:34.754475 29447 tablet_bootstrap.cc:492] T 39a14ec9527d43b4a6f78b48ad4165cf P 8be4ab1c5cca41849942448806160d19: Bootstrap replayed 1/1 log segments. Stats: ops{read=88 overwritten=0 applied=87 ignored=0} inserts{seen=759 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260810 01:56:34.755373 29447 tablet_bootstrap.cc:492] T 39a14ec9527d43b4a6f78b48ad4165cf P 8be4ab1c5cca41849942448806160d19: Bootstrap complete.
I20260810 01:56:34.755993 29447 ts_tablet_manager.cc:1403] T 39a14ec9527d43b4a6f78b48ad4165cf P 8be4ab1c5cca41849942448806160d19: Time spent bootstrapping tablet: real 0.505s user 0.152s sys 0.027s
I20260810 01:56:34.761961 29447 raft_consensus.cc:359] T 39a14ec9527d43b4a6f78b48ad4165cf P 8be4ab1c5cca41849942448806160d19 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: 79 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } }
I20260810 01:56:34.775693 29447 raft_consensus.cc:740] T 39a14ec9527d43b4a6f78b48ad4165cf P 8be4ab1c5cca41849942448806160d19 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8be4ab1c5cca41849942448806160d19, State: Initialized, Role: FOLLOWER
I20260810 01:56:34.777441 29447 consensus_queue.cc:260] T 39a14ec9527d43b4a6f78b48ad4165cf P 8be4ab1c5cca41849942448806160d19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 87, Last appended: 1.88, Last appended by leader: 88, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 79 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } }
I20260810 01:56:34.786128 29447 ts_tablet_manager.cc:1434] T 39a14ec9527d43b4a6f78b48ad4165cf P 8be4ab1c5cca41849942448806160d19: Time spent starting tablet: real 0.030s user 0.007s sys 0.015s
I20260810 01:56:34.788901 26686 tablet_copy_service.cc:342] P a46364d7cd504f8ca7fc003c59ae6d31: Request end of tablet copy session 8be4ab1c5cca41849942448806160d19-39a14ec9527d43b4a6f78b48ad4165cf received from {username='slave'} at 127.21.64.197:48821
I20260810 01:56:34.789070 26686 tablet_copy_service.cc:434] P a46364d7cd504f8ca7fc003c59ae6d31: ending tablet copy session 8be4ab1c5cca41849942448806160d19-39a14ec9527d43b4a6f78b48ad4165cf on tablet 39a14ec9527d43b4a6f78b48ad4165cf with peer 8be4ab1c5cca41849942448806160d19
I20260810 01:56:34.815214 29436 ts_tablet_manager.cc:933] T fdf1cc811a8349efa251d05e9b077fad P 28812b178f824d539cab11abfe98d77d: Initiating tablet copy from peer a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193:45781)
I20260810 01:56:34.824394 29436 tablet_copy_client.cc:323] T fdf1cc811a8349efa251d05e9b077fad P 28812b178f824d539cab11abfe98d77d: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.193:45781
I20260810 01:56:34.942133 28410 raft_consensus.cc:1217] T e8b0ab1f966840f3ade9f44232b39a5a P 28812b178f824d539cab11abfe98d77d [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.69->[1.70-1.80] Dedup: 1.75->[1.76-1.80]
I20260810 01:56:34.976600 26686 tablet_copy_service.cc:140] P a46364d7cd504f8ca7fc003c59ae6d31: Received BeginTabletCopySession request for tablet fdf1cc811a8349efa251d05e9b077fad from peer 28812b178f824d539cab11abfe98d77d ({username='slave'} at 127.21.64.196:48807)
I20260810 01:56:34.976848 26686 tablet_copy_service.cc:161] P a46364d7cd504f8ca7fc003c59ae6d31: Beginning new tablet copy session on tablet fdf1cc811a8349efa251d05e9b077fad from peer 28812b178f824d539cab11abfe98d77d at {username='slave'} at 127.21.64.196:48807: session id = 28812b178f824d539cab11abfe98d77d-fdf1cc811a8349efa251d05e9b077fad
I20260810 01:56:34.980373 26686 tablet_copy_source_session.cc:215] T fdf1cc811a8349efa251d05e9b077fad P a46364d7cd504f8ca7fc003c59ae6d31: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:56:35.014403 29436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdf1cc811a8349efa251d05e9b077fad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:56:35.028442 29436 tablet_copy_client.cc:806] T fdf1cc811a8349efa251d05e9b077fad P 28812b178f824d539cab11abfe98d77d: tablet copy: Starting download of 0 data blocks...
I20260810 01:56:35.028843 29436 tablet_copy_client.cc:670] T fdf1cc811a8349efa251d05e9b077fad P 28812b178f824d539cab11abfe98d77d: tablet copy: Starting download of 1 WAL segments...
I20260810 01:56:35.033419 29436 tablet_copy_client.cc:538] T fdf1cc811a8349efa251d05e9b077fad P 28812b178f824d539cab11abfe98d77d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:56:35.058796 29436 tablet_bootstrap.cc:492] T fdf1cc811a8349efa251d05e9b077fad P 28812b178f824d539cab11abfe98d77d: Bootstrap starting.
I20260810 01:56:35.061048 26830 consensus_queue.cc:237] T d76ed7c57001495fb62e15bd9f14a162 P 60d4538b78b44201964cf440ea562c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 89, Committed index: 89, Last appended: 1.90, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 91 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } }
I20260810 01:56:35.074420 26660 raft_consensus.cc:1275] T d76ed7c57001495fb62e15bd9f14a162 P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 FOLLOWER]: Refusing update from remote peer 60d4538b78b44201964cf440ea562c72: Log matching property violated. Preceding OpId in replica: term: 1 index: 90. Preceding OpId from leader: term: 1 index: 91. (index mismatch)
I20260810 01:56:35.078379 29094 consensus_queue.cc:1048] T d76ed7c57001495fb62e15bd9f14a162 P 60d4538b78b44201964cf440ea562c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 91, Last known committed idx: 89, Time since last communication: 0.000s
I20260810 01:56:35.097604 29424 raft_consensus.cc:2955] T d76ed7c57001495fb62e15bd9f14a162 P 60d4538b78b44201964cf440ea562c72 [term 1 LEADER]: Committing config change with OpId 1.91: config changed from index -1 to 91, VOTER 9353b63b4d854d23b51a8103bc899aab (127.21.64.198) added. New config: { opid_index: 91 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } } }
I20260810 01:56:35.101177 26660 raft_consensus.cc:2955] T d76ed7c57001495fb62e15bd9f14a162 P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 FOLLOWER]: Committing config change with OpId 1.91: config changed from index -1 to 91, VOTER 9353b63b4d854d23b51a8103bc899aab (127.21.64.198) added. New config: { opid_index: 91 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } } }
I20260810 01:56:35.113458 26457 catalog_manager.cc:5719] T d76ed7c57001495fb62e15bd9f14a162 P a46364d7cd504f8ca7fc003c59ae6d31 reported cstate change: config changed from index -1 to 91, VOTER 9353b63b4d854d23b51a8103bc899aab (127.21.64.198) added. New cstate: current_term: 1 leader_uuid: "60d4538b78b44201964cf440ea562c72" committed_config { opid_index: 91 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } } }
W20260810 01:56:35.204733 26745 consensus_peers.cc:597] T d76ed7c57001495fb62e15bd9f14a162 P 60d4538b78b44201964cf440ea562c72 -> Peer 9353b63b4d854d23b51a8103bc899aab (127.21.64.198:41745): Couldn't send request to peer 9353b63b4d854d23b51a8103bc899aab. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d76ed7c57001495fb62e15bd9f14a162. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:56:35.265604 29465 tablet_bootstrap.cc:492] T c72cec0deb794dac95b7a88308c56167 P 07e0a39216984856b2ff8c512c4c2f93: Bootstrap replayed 1/1 log segments. Stats: ops{read=88 overwritten=0 applied=88 ignored=0} inserts{seen=773 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:56:35.266319 29465 tablet_bootstrap.cc:492] T c72cec0deb794dac95b7a88308c56167 P 07e0a39216984856b2ff8c512c4c2f93: Bootstrap complete.
I20260810 01:56:35.266803 29465 ts_tablet_manager.cc:1403] T c72cec0deb794dac95b7a88308c56167 P 07e0a39216984856b2ff8c512c4c2f93: Time spent bootstrapping tablet: real 0.600s user 0.141s sys 0.028s
I20260810 01:56:35.268074 29465 raft_consensus.cc:359] T c72cec0deb794dac95b7a88308c56167 P 07e0a39216984856b2ff8c512c4c2f93 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 79 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } }
I20260810 01:56:35.269017 29465 raft_consensus.cc:740] T c72cec0deb794dac95b7a88308c56167 P 07e0a39216984856b2ff8c512c4c2f93 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07e0a39216984856b2ff8c512c4c2f93, State: Initialized, Role: FOLLOWER
I20260810 01:56:35.269404 29465 consensus_queue.cc:260] T c72cec0deb794dac95b7a88308c56167 P 07e0a39216984856b2ff8c512c4c2f93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 88, Last appended: 1.88, Last appended by leader: 88, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 79 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } }
I20260810 01:56:35.284814 28586 raft_consensus.cc:1217] T 39a14ec9527d43b4a6f78b48ad4165cf P 8be4ab1c5cca41849942448806160d19 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.78->[1.79-1.103] Dedup: 1.88->[1.89-1.103]
I20260810 01:56:35.457571 29465 ts_tablet_manager.cc:1434] T c72cec0deb794dac95b7a88308c56167 P 07e0a39216984856b2ff8c512c4c2f93: Time spent starting tablet: real 0.191s user 0.022s sys 0.044s
I20260810 01:56:35.461422 26856 tablet_copy_service.cc:342] P 60d4538b78b44201964cf440ea562c72: Request end of tablet copy session 07e0a39216984856b2ff8c512c4c2f93-c72cec0deb794dac95b7a88308c56167 received from {username='slave'} at 127.21.64.199:33581
I20260810 01:56:35.461650 26856 tablet_copy_service.cc:434] P 60d4538b78b44201964cf440ea562c72: ending tablet copy session 07e0a39216984856b2ff8c512c4c2f93-c72cec0deb794dac95b7a88308c56167 on tablet c72cec0deb794dac95b7a88308c56167 with peer 07e0a39216984856b2ff8c512c4c2f93
I20260810 01:56:35.590754 28942 raft_consensus.cc:1217] T c72cec0deb794dac95b7a88308c56167 P 07e0a39216984856b2ff8c512c4c2f93 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.78->[1.79-1.104] Dedup: 1.88->[1.89-1.104]
I20260810 01:56:35.627058 29571 ts_tablet_manager.cc:933] T d76ed7c57001495fb62e15bd9f14a162 P 9353b63b4d854d23b51a8103bc899aab: Initiating tablet copy from peer 60d4538b78b44201964cf440ea562c72 (127.21.64.194:36943)
I20260810 01:56:35.646287 29571 tablet_copy_client.cc:323] T d76ed7c57001495fb62e15bd9f14a162 P 9353b63b4d854d23b51a8103bc899aab: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.194:36943
I20260810 01:56:35.832978 26832 consensus_queue.cc:237] T 059c8fa5da994e6c9f3582df4542d276 P 60d4538b78b44201964cf440ea562c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 134, Committed index: 134, Last appended: 1.134, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 135 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } }
I20260810 01:56:35.863211 27004 raft_consensus.cc:1275] T 059c8fa5da994e6c9f3582df4542d276 P 56388bef1a0f453cadc8b6aa9434311d [term 1 FOLLOWER]: Refusing update from remote peer 60d4538b78b44201964cf440ea562c72: Log matching property violated. Preceding OpId in replica: term: 1 index: 134. Preceding OpId from leader: term: 1 index: 135. (index mismatch)
I20260810 01:56:35.864470 29088 consensus_queue.cc:1048] T 059c8fa5da994e6c9f3582df4542d276 P 60d4538b78b44201964cf440ea562c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 135, Last known committed idx: 134, Time since last communication: 0.000s
I20260810 01:56:35.865577 29436 tablet_bootstrap.cc:492] T fdf1cc811a8349efa251d05e9b077fad P 28812b178f824d539cab11abfe98d77d: Bootstrap replayed 1/1 log segments. Stats: ops{read=131 overwritten=0 applied=131 ignored=0} inserts{seen=803 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:56:35.868250 29436 tablet_bootstrap.cc:492] T fdf1cc811a8349efa251d05e9b077fad P 28812b178f824d539cab11abfe98d77d: Bootstrap complete.
I20260810 01:56:35.868695 29436 ts_tablet_manager.cc:1403] T fdf1cc811a8349efa251d05e9b077fad P 28812b178f824d539cab11abfe98d77d: Time spent bootstrapping tablet: real 0.810s user 0.221s sys 0.021s
I20260810 01:56:35.869050 29088 raft_consensus.cc:2955] T 059c8fa5da994e6c9f3582df4542d276 P 60d4538b78b44201964cf440ea562c72 [term 1 LEADER]: Committing config change with OpId 1.135: config changed from index -1 to 135, VOTER 8be4ab1c5cca41849942448806160d19 (127.21.64.197) added. New config: { opid_index: 135 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } } }
W20260810 01:56:35.871738 26739 consensus_peers.cc:597] T 059c8fa5da994e6c9f3582df4542d276 P 60d4538b78b44201964cf440ea562c72 -> Peer 8be4ab1c5cca41849942448806160d19 (127.21.64.197:46107): Couldn't send request to peer 8be4ab1c5cca41849942448806160d19. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 059c8fa5da994e6c9f3582df4542d276. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:56:35.872099 29436 raft_consensus.cc:359] T fdf1cc811a8349efa251d05e9b077fad P 28812b178f824d539cab11abfe98d77d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 116 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } }
I20260810 01:56:35.876140 29436 raft_consensus.cc:740] T fdf1cc811a8349efa251d05e9b077fad P 28812b178f824d539cab11abfe98d77d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28812b178f824d539cab11abfe98d77d, State: Initialized, Role: FOLLOWER
I20260810 01:56:35.876509 29436 consensus_queue.cc:260] T fdf1cc811a8349efa251d05e9b077fad P 28812b178f824d539cab11abfe98d77d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 131, Last appended: 1.131, Last appended by leader: 131, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 116 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } }
I20260810 01:56:35.876489 27004 raft_consensus.cc:2955] T 059c8fa5da994e6c9f3582df4542d276 P 56388bef1a0f453cadc8b6aa9434311d [term 1 FOLLOWER]: Committing config change with OpId 1.135: config changed from index -1 to 135, VOTER 8be4ab1c5cca41849942448806160d19 (127.21.64.197) added. New config: { opid_index: 135 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } } }
I20260810 01:56:35.888085 29436 ts_tablet_manager.cc:1434] T fdf1cc811a8349efa251d05e9b077fad P 28812b178f824d539cab11abfe98d77d: Time spent starting tablet: real 0.017s user 0.005s sys 0.000s
I20260810 01:56:35.888212 26457 catalog_manager.cc:5719] T 059c8fa5da994e6c9f3582df4542d276 P 60d4538b78b44201964cf440ea562c72 reported cstate change: config changed from index -1 to 135, VOTER 8be4ab1c5cca41849942448806160d19 (127.21.64.197) added. New cstate: current_term: 1 leader_uuid: "60d4538b78b44201964cf440ea562c72" committed_config { opid_index: 135 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } } }
I20260810 01:56:35.892108 26686 tablet_copy_service.cc:342] P a46364d7cd504f8ca7fc003c59ae6d31: Request end of tablet copy session 28812b178f824d539cab11abfe98d77d-fdf1cc811a8349efa251d05e9b077fad received from {username='slave'} at 127.21.64.196:48807
I20260810 01:56:35.892295 26686 tablet_copy_service.cc:434] P a46364d7cd504f8ca7fc003c59ae6d31: ending tablet copy session 28812b178f824d539cab11abfe98d77d-fdf1cc811a8349efa251d05e9b077fad on tablet fdf1cc811a8349efa251d05e9b077fad with peer 28812b178f824d539cab11abfe98d77d
I20260810 01:56:35.931895 26856 tablet_copy_service.cc:140] P 60d4538b78b44201964cf440ea562c72: Received BeginTabletCopySession request for tablet d76ed7c57001495fb62e15bd9f14a162 from peer 9353b63b4d854d23b51a8103bc899aab ({username='slave'} at 127.21.64.198:48223)
I20260810 01:56:35.932152 26856 tablet_copy_service.cc:161] P 60d4538b78b44201964cf440ea562c72: Beginning new tablet copy session on tablet d76ed7c57001495fb62e15bd9f14a162 from peer 9353b63b4d854d23b51a8103bc899aab at {username='slave'} at 127.21.64.198:48223: session id = 9353b63b4d854d23b51a8103bc899aab-d76ed7c57001495fb62e15bd9f14a162
I20260810 01:56:35.932224 28410 raft_consensus.cc:1217] T fdf1cc811a8349efa251d05e9b077fad P 28812b178f824d539cab11abfe98d77d [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.115->[1.116-1.138] Dedup: 1.131->[1.132-1.138]
I20260810 01:56:35.936575 26856 tablet_copy_source_session.cc:215] T d76ed7c57001495fb62e15bd9f14a162 P 60d4538b78b44201964cf440ea562c72: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:56:35.946525 29571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d76ed7c57001495fb62e15bd9f14a162. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:56:35.953837 29571 tablet_copy_client.cc:806] T d76ed7c57001495fb62e15bd9f14a162 P 9353b63b4d854d23b51a8103bc899aab: tablet copy: Starting download of 0 data blocks...
I20260810 01:56:35.954191 29571 tablet_copy_client.cc:670] T d76ed7c57001495fb62e15bd9f14a162 P 9353b63b4d854d23b51a8103bc899aab: tablet copy: Starting download of 1 WAL segments...
I20260810 01:56:35.973796 29571 tablet_copy_client.cc:538] T d76ed7c57001495fb62e15bd9f14a162 P 9353b63b4d854d23b51a8103bc899aab: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:56:35.978415 29571 tablet_bootstrap.cc:492] T d76ed7c57001495fb62e15bd9f14a162 P 9353b63b4d854d23b51a8103bc899aab: Bootstrap starting.
W20260810 01:56:36.239380 26910 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.194:36943, user_credentials={real_user=slave}} blocked reactor thread for 130441us
I20260810 01:56:36.389133 29622 ts_tablet_manager.cc:933] T 059c8fa5da994e6c9f3582df4542d276 P 8be4ab1c5cca41849942448806160d19: Initiating tablet copy from peer 60d4538b78b44201964cf440ea562c72 (127.21.64.194:36943)
I20260810 01:56:36.400808 29622 tablet_copy_client.cc:323] T 059c8fa5da994e6c9f3582df4542d276 P 8be4ab1c5cca41849942448806160d19: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.194:36943
I20260810 01:56:36.414726 29571 tablet_bootstrap.cc:492] T d76ed7c57001495fb62e15bd9f14a162 P 9353b63b4d854d23b51a8103bc899aab: Bootstrap replayed 1/1 log segments. Stats: ops{read=96 overwritten=0 applied=96 ignored=0} inserts{seen=781 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:56:36.421938 29571 tablet_bootstrap.cc:492] T d76ed7c57001495fb62e15bd9f14a162 P 9353b63b4d854d23b51a8103bc899aab: Bootstrap complete.
I20260810 01:56:36.434226 29571 ts_tablet_manager.cc:1403] T d76ed7c57001495fb62e15bd9f14a162 P 9353b63b4d854d23b51a8103bc899aab: Time spent bootstrapping tablet: real 0.450s user 0.187s sys 0.012s
I20260810 01:56:36.441578 29571 raft_consensus.cc:359] T d76ed7c57001495fb62e15bd9f14a162 P 9353b63b4d854d23b51a8103bc899aab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 91 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } }
I20260810 01:56:36.441962 29571 raft_consensus.cc:740] T d76ed7c57001495fb62e15bd9f14a162 P 9353b63b4d854d23b51a8103bc899aab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9353b63b4d854d23b51a8103bc899aab, State: Initialized, Role: FOLLOWER
I20260810 01:56:36.442413 29571 consensus_queue.cc:260] T d76ed7c57001495fb62e15bd9f14a162 P 9353b63b4d854d23b51a8103bc899aab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 96, Last appended: 1.96, Last appended by leader: 96, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 91 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } }
I20260810 01:56:36.446902 29571 ts_tablet_manager.cc:1434] T d76ed7c57001495fb62e15bd9f14a162 P 9353b63b4d854d23b51a8103bc899aab: Time spent starting tablet: real 0.012s user 0.003s sys 0.000s
I20260810 01:56:36.459846 26856 tablet_copy_service.cc:140] P 60d4538b78b44201964cf440ea562c72: Received BeginTabletCopySession request for tablet 059c8fa5da994e6c9f3582df4542d276 from peer 8be4ab1c5cca41849942448806160d19 ({username='slave'} at 127.21.64.197:45991)
I20260810 01:56:36.460067 26856 tablet_copy_service.cc:161] P 60d4538b78b44201964cf440ea562c72: Beginning new tablet copy session on tablet 059c8fa5da994e6c9f3582df4542d276 from peer 8be4ab1c5cca41849942448806160d19 at {username='slave'} at 127.21.64.197:45991: session id = 8be4ab1c5cca41849942448806160d19-059c8fa5da994e6c9f3582df4542d276
I20260810 01:56:36.466179 26856 tablet_copy_source_session.cc:215] T 059c8fa5da994e6c9f3582df4542d276 P 60d4538b78b44201964cf440ea562c72: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:56:36.474668 29622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 059c8fa5da994e6c9f3582df4542d276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:56:36.476603 26856 tablet_copy_service.cc:342] P 60d4538b78b44201964cf440ea562c72: Request end of tablet copy session 9353b63b4d854d23b51a8103bc899aab-d76ed7c57001495fb62e15bd9f14a162 received from {username='slave'} at 127.21.64.198:48223
I20260810 01:56:36.476776 26856 tablet_copy_service.cc:434] P 60d4538b78b44201964cf440ea562c72: ending tablet copy session 9353b63b4d854d23b51a8103bc899aab-d76ed7c57001495fb62e15bd9f14a162 on tablet d76ed7c57001495fb62e15bd9f14a162 with peer 9353b63b4d854d23b51a8103bc899aab
I20260810 01:56:36.487545 29622 tablet_copy_client.cc:806] T 059c8fa5da994e6c9f3582df4542d276 P 8be4ab1c5cca41849942448806160d19: tablet copy: Starting download of 0 data blocks...
I20260810 01:56:36.487843 29622 tablet_copy_client.cc:670] T 059c8fa5da994e6c9f3582df4542d276 P 8be4ab1c5cca41849942448806160d19: tablet copy: Starting download of 1 WAL segments...
I20260810 01:56:36.499322 29622 tablet_copy_client.cc:538] T 059c8fa5da994e6c9f3582df4542d276 P 8be4ab1c5cca41849942448806160d19: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:56:36.519999 29622 tablet_bootstrap.cc:492] T 059c8fa5da994e6c9f3582df4542d276 P 8be4ab1c5cca41849942448806160d19: Bootstrap starting.
I20260810 01:56:36.520702 26830 consensus_queue.cc:237] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 96, Committed index: 96, Last appended: 1.96, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 97 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } }
I20260810 01:56:36.524840 27004 raft_consensus.cc:1275] T 4f7860cf1d8449fc9f062f3e09e4aafd P 56388bef1a0f453cadc8b6aa9434311d [term 1 FOLLOWER]: Refusing update from remote peer 60d4538b78b44201964cf440ea562c72: Log matching property violated. Preceding OpId in replica: term: 1 index: 96. Preceding OpId from leader: term: 1 index: 97. (index mismatch)
I20260810 01:56:36.525607 29538 consensus_queue.cc:1048] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 97, Last known committed idx: 96, Time since last communication: 0.000s
I20260810 01:56:36.543787 29424 raft_consensus.cc:2955] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72 [term 1 LEADER]: Committing config change with OpId 1.97: config changed from index -1 to 97, VOTER 28812b178f824d539cab11abfe98d77d (127.21.64.196) added. New config: { opid_index: 97 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } } }
I20260810 01:56:36.552139 27004 raft_consensus.cc:2955] T 4f7860cf1d8449fc9f062f3e09e4aafd P 56388bef1a0f453cadc8b6aa9434311d [term 1 FOLLOWER]: Committing config change with OpId 1.97: config changed from index -1 to 97, VOTER 28812b178f824d539cab11abfe98d77d (127.21.64.196) added. New config: { opid_index: 97 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } } }
I20260810 01:56:36.575208 26470 catalog_manager.cc:5719] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72 reported cstate change: config changed from index -1 to 97, VOTER 28812b178f824d539cab11abfe98d77d (127.21.64.196) added. New cstate: current_term: 1 leader_uuid: "60d4538b78b44201964cf440ea562c72" committed_config { opid_index: 97 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } } }
I20260810 01:56:36.628394 28768 raft_consensus.cc:1217] T d76ed7c57001495fb62e15bd9f14a162 P 9353b63b4d854d23b51a8103bc899aab [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.90->[1.91-1.100] Dedup: 1.96->[1.97-1.100]
W20260810 01:56:36.632866 26739 consensus_peers.cc:597] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72 -> Peer 28812b178f824d539cab11abfe98d77d (127.21.64.196:41095): Couldn't send request to peer 28812b178f824d539cab11abfe98d77d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4f7860cf1d8449fc9f062f3e09e4aafd. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:56:36.899453 26830 consensus_queue.cc:237] T 3c77a4e4068b4dac971c281f5819a5a9 P 60d4538b78b44201964cf440ea562c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 103, Committed index: 103, Last appended: 1.103, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 104 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } }
W20260810 01:56:36.905078 26739 consensus_peers.cc:597] T 3c77a4e4068b4dac971c281f5819a5a9 P 60d4538b78b44201964cf440ea562c72 -> Peer 8be4ab1c5cca41849942448806160d19 (127.21.64.197:46107): Couldn't send request to peer 8be4ab1c5cca41849942448806160d19. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3c77a4e4068b4dac971c281f5819a5a9. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:56:36.911226 26657 raft_consensus.cc:1275] T 3c77a4e4068b4dac971c281f5819a5a9 P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 FOLLOWER]: Refusing update from remote peer 60d4538b78b44201964cf440ea562c72: Log matching property violated. Preceding OpId in replica: term: 1 index: 103. Preceding OpId from leader: term: 1 index: 104. (index mismatch)
I20260810 01:56:36.915469 29661 consensus_queue.cc:1048] T 3c77a4e4068b4dac971c281f5819a5a9 P 60d4538b78b44201964cf440ea562c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 104, Last known committed idx: 103, Time since last communication: 0.000s
I20260810 01:56:36.944281 29424 raft_consensus.cc:2955] T 3c77a4e4068b4dac971c281f5819a5a9 P 60d4538b78b44201964cf440ea562c72 [term 1 LEADER]: Committing config change with OpId 1.104: config changed from index -1 to 104, VOTER 8be4ab1c5cca41849942448806160d19 (127.21.64.197) added. New config: { opid_index: 104 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } } }
I20260810 01:56:36.955663 26470 catalog_manager.cc:5719] T 3c77a4e4068b4dac971c281f5819a5a9 P 60d4538b78b44201964cf440ea562c72 reported cstate change: config changed from index -1 to 104, VOTER 8be4ab1c5cca41849942448806160d19 (127.21.64.197) added. New cstate: current_term: 1 leader_uuid: "60d4538b78b44201964cf440ea562c72" committed_config { opid_index: 104 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } } }
I20260810 01:56:36.977015 26660 raft_consensus.cc:2955] T 3c77a4e4068b4dac971c281f5819a5a9 P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 FOLLOWER]: Committing config change with OpId 1.104: config changed from index -1 to 104, VOTER 8be4ab1c5cca41849942448806160d19 (127.21.64.197) added. New config: { opid_index: 104 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } } }
I20260810 01:56:37.068650 29622 tablet_bootstrap.cc:492] T 059c8fa5da994e6c9f3582df4542d276 P 8be4ab1c5cca41849942448806160d19: Bootstrap replayed 1/1 log segments. Stats: ops{read=141 overwritten=0 applied=141 ignored=0} inserts{seen=772 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:56:37.069190 29622 tablet_bootstrap.cc:492] T 059c8fa5da994e6c9f3582df4542d276 P 8be4ab1c5cca41849942448806160d19: Bootstrap complete.
I20260810 01:56:37.069655 29622 ts_tablet_manager.cc:1403] T 059c8fa5da994e6c9f3582df4542d276 P 8be4ab1c5cca41849942448806160d19: Time spent bootstrapping tablet: real 0.550s user 0.231s sys 0.054s
I20260810 01:56:37.077291 29622 raft_consensus.cc:359] T 059c8fa5da994e6c9f3582df4542d276 P 8be4ab1c5cca41849942448806160d19 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 135 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } }
I20260810 01:56:37.077677 29622 raft_consensus.cc:740] T 059c8fa5da994e6c9f3582df4542d276 P 8be4ab1c5cca41849942448806160d19 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8be4ab1c5cca41849942448806160d19, State: Initialized, Role: FOLLOWER
I20260810 01:56:37.077988 29622 consensus_queue.cc:260] T 059c8fa5da994e6c9f3582df4542d276 P 8be4ab1c5cca41849942448806160d19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 141, Last appended: 1.141, Last appended by leader: 141, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 135 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } }
I20260810 01:56:37.102239 29622 ts_tablet_manager.cc:1434] T 059c8fa5da994e6c9f3582df4542d276 P 8be4ab1c5cca41849942448806160d19: Time spent starting tablet: real 0.032s user 0.009s sys 0.000s
I20260810 01:56:37.108039 26856 tablet_copy_service.cc:342] P 60d4538b78b44201964cf440ea562c72: Request end of tablet copy session 8be4ab1c5cca41849942448806160d19-059c8fa5da994e6c9f3582df4542d276 received from {username='slave'} at 127.21.64.197:45991
I20260810 01:56:37.108215 26856 tablet_copy_service.cc:434] P 60d4538b78b44201964cf440ea562c72: ending tablet copy session 8be4ab1c5cca41849942448806160d19-059c8fa5da994e6c9f3582df4542d276 on tablet 059c8fa5da994e6c9f3582df4542d276 with peer 8be4ab1c5cca41849942448806160d19
I20260810 01:56:37.121266 29688 ts_tablet_manager.cc:933] T 4f7860cf1d8449fc9f062f3e09e4aafd P 28812b178f824d539cab11abfe98d77d: Initiating tablet copy from peer 60d4538b78b44201964cf440ea562c72 (127.21.64.194:36943)
I20260810 01:56:37.126449 29688 tablet_copy_client.cc:323] T 4f7860cf1d8449fc9f062f3e09e4aafd P 28812b178f824d539cab11abfe98d77d: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.194:36943
I20260810 01:56:37.160784 26856 tablet_copy_service.cc:140] P 60d4538b78b44201964cf440ea562c72: Received BeginTabletCopySession request for tablet 4f7860cf1d8449fc9f062f3e09e4aafd from peer 28812b178f824d539cab11abfe98d77d ({username='slave'} at 127.21.64.196:46613)
I20260810 01:56:37.160992 26856 tablet_copy_service.cc:161] P 60d4538b78b44201964cf440ea562c72: Beginning new tablet copy session on tablet 4f7860cf1d8449fc9f062f3e09e4aafd from peer 28812b178f824d539cab11abfe98d77d at {username='slave'} at 127.21.64.196:46613: session id = 28812b178f824d539cab11abfe98d77d-4f7860cf1d8449fc9f062f3e09e4aafd
I20260810 01:56:37.164000 26856 tablet_copy_source_session.cc:215] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:56:37.167049 29688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f7860cf1d8449fc9f062f3e09e4aafd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:56:37.176880 29688 tablet_copy_client.cc:806] T 4f7860cf1d8449fc9f062f3e09e4aafd P 28812b178f824d539cab11abfe98d77d: tablet copy: Starting download of 0 data blocks...
I20260810 01:56:37.177183 29688 tablet_copy_client.cc:670] T 4f7860cf1d8449fc9f062f3e09e4aafd P 28812b178f824d539cab11abfe98d77d: tablet copy: Starting download of 1 WAL segments...
I20260810 01:56:37.193675 29688 tablet_copy_client.cc:538] T 4f7860cf1d8449fc9f062f3e09e4aafd P 28812b178f824d539cab11abfe98d77d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:56:37.198271 29688 tablet_bootstrap.cc:492] T 4f7860cf1d8449fc9f062f3e09e4aafd P 28812b178f824d539cab11abfe98d77d: Bootstrap starting.
I20260810 01:56:37.241801 26830 consensus_queue.cc:237] T 4403a36d26db47278a82abb5df118bbd P 60d4538b78b44201964cf440ea562c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 142, Committed index: 142, Last appended: 1.142, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 143 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } }
W20260810 01:56:37.245740 26739 consensus_peers.cc:597] T 4403a36d26db47278a82abb5df118bbd P 60d4538b78b44201964cf440ea562c72 -> Peer 28812b178f824d539cab11abfe98d77d (127.21.64.196:41095): Couldn't send request to peer 28812b178f824d539cab11abfe98d77d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4403a36d26db47278a82abb5df118bbd. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:56:37.256487 26660 raft_consensus.cc:1275] T 4403a36d26db47278a82abb5df118bbd P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 FOLLOWER]: Refusing update from remote peer 60d4538b78b44201964cf440ea562c72: Log matching property violated. Preceding OpId in replica: term: 1 index: 142. Preceding OpId from leader: term: 1 index: 143. (index mismatch)
I20260810 01:56:37.261945 29424 consensus_queue.cc:1048] T 4403a36d26db47278a82abb5df118bbd P 60d4538b78b44201964cf440ea562c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 143, Last known committed idx: 142, Time since last communication: 0.000s
I20260810 01:56:37.287411 29094 raft_consensus.cc:2955] T 4403a36d26db47278a82abb5df118bbd P 60d4538b78b44201964cf440ea562c72 [term 1 LEADER]: Committing config change with OpId 1.143: config changed from index -1 to 143, VOTER 28812b178f824d539cab11abfe98d77d (127.21.64.196) added. New config: { opid_index: 143 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } } }
I20260810 01:56:37.305007 26470 catalog_manager.cc:5719] T 4403a36d26db47278a82abb5df118bbd P 60d4538b78b44201964cf440ea562c72 reported cstate change: config changed from index -1 to 143, VOTER 28812b178f824d539cab11abfe98d77d (127.21.64.196) added. New cstate: current_term: 1 leader_uuid: "60d4538b78b44201964cf440ea562c72" committed_config { opid_index: 143 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } } }
I20260810 01:56:37.317162 26659 raft_consensus.cc:2955] T 4403a36d26db47278a82abb5df118bbd P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 FOLLOWER]: Committing config change with OpId 1.143: config changed from index -1 to 143, VOTER 28812b178f824d539cab11abfe98d77d (127.21.64.196) added. New config: { opid_index: 143 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } } }
I20260810 01:56:37.378187 29622 ts_tablet_manager.cc:933] T 3c77a4e4068b4dac971c281f5819a5a9 P 8be4ab1c5cca41849942448806160d19: Initiating tablet copy from peer 60d4538b78b44201964cf440ea562c72 (127.21.64.194:36943)
I20260810 01:56:37.423291 29622 tablet_copy_client.cc:323] T 3c77a4e4068b4dac971c281f5819a5a9 P 8be4ab1c5cca41849942448806160d19: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.194:36943
I20260810 01:56:37.467733 26856 tablet_copy_service.cc:140] P 60d4538b78b44201964cf440ea562c72: Received BeginTabletCopySession request for tablet 3c77a4e4068b4dac971c281f5819a5a9 from peer 8be4ab1c5cca41849942448806160d19 ({username='slave'} at 127.21.64.197:45991)
I20260810 01:56:37.467957 26856 tablet_copy_service.cc:161] P 60d4538b78b44201964cf440ea562c72: Beginning new tablet copy session on tablet 3c77a4e4068b4dac971c281f5819a5a9 from peer 8be4ab1c5cca41849942448806160d19 at {username='slave'} at 127.21.64.197:45991: session id = 8be4ab1c5cca41849942448806160d19-3c77a4e4068b4dac971c281f5819a5a9
I20260810 01:56:37.472810 26856 tablet_copy_source_session.cc:215] T 3c77a4e4068b4dac971c281f5819a5a9 P 60d4538b78b44201964cf440ea562c72: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:56:37.476406 29622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c77a4e4068b4dac971c281f5819a5a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:56:37.492898 29622 tablet_copy_client.cc:806] T 3c77a4e4068b4dac971c281f5819a5a9 P 8be4ab1c5cca41849942448806160d19: tablet copy: Starting download of 0 data blocks...
I20260810 01:56:37.493314 29622 tablet_copy_client.cc:670] T 3c77a4e4068b4dac971c281f5819a5a9 P 8be4ab1c5cca41849942448806160d19: tablet copy: Starting download of 1 WAL segments...
I20260810 01:56:37.498529 28586 raft_consensus.cc:1217] T 059c8fa5da994e6c9f3582df4542d276 P 8be4ab1c5cca41849942448806160d19 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.134->[1.135-1.153] Dedup: 1.141->[1.142-1.153]
I20260810 01:56:37.521695 29622 tablet_copy_client.cc:538] T 3c77a4e4068b4dac971c281f5819a5a9 P 8be4ab1c5cca41849942448806160d19: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:56:37.530253 29622 tablet_bootstrap.cc:492] T 3c77a4e4068b4dac971c281f5819a5a9 P 8be4ab1c5cca41849942448806160d19: Bootstrap starting.
I20260810 01:56:37.620172 29688 tablet_bootstrap.cc:492] T 4f7860cf1d8449fc9f062f3e09e4aafd P 28812b178f824d539cab11abfe98d77d: Bootstrap replayed 1/1 log segments. Stats: ops{read=103 overwritten=0 applied=103 ignored=0} inserts{seen=734 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:56:37.620944 29688 tablet_bootstrap.cc:492] T 4f7860cf1d8449fc9f062f3e09e4aafd P 28812b178f824d539cab11abfe98d77d: Bootstrap complete.
I20260810 01:56:37.621631 29688 ts_tablet_manager.cc:1403] T 4f7860cf1d8449fc9f062f3e09e4aafd P 28812b178f824d539cab11abfe98d77d: Time spent bootstrapping tablet: real 0.423s user 0.191s sys 0.015s
I20260810 01:56:37.622736 29688 raft_consensus.cc:359] T 4f7860cf1d8449fc9f062f3e09e4aafd P 28812b178f824d539cab11abfe98d77d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 97 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } }
I20260810 01:56:37.623097 29688 raft_consensus.cc:740] T 4f7860cf1d8449fc9f062f3e09e4aafd P 28812b178f824d539cab11abfe98d77d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28812b178f824d539cab11abfe98d77d, State: Initialized, Role: FOLLOWER
I20260810 01:56:37.623672 29688 consensus_queue.cc:260] T 4f7860cf1d8449fc9f062f3e09e4aafd P 28812b178f824d539cab11abfe98d77d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 103, Last appended: 1.103, Last appended by leader: 103, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 97 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } }
I20260810 01:56:37.642693 29688 ts_tablet_manager.cc:1434] T 4f7860cf1d8449fc9f062f3e09e4aafd P 28812b178f824d539cab11abfe98d77d: Time spent starting tablet: real 0.021s user 0.008s sys 0.000s
I20260810 01:56:37.647190 26856 tablet_copy_service.cc:342] P 60d4538b78b44201964cf440ea562c72: Request end of tablet copy session 28812b178f824d539cab11abfe98d77d-4f7860cf1d8449fc9f062f3e09e4aafd received from {username='slave'} at 127.21.64.196:46613
I20260810 01:56:37.647416 26856 tablet_copy_service.cc:434] P 60d4538b78b44201964cf440ea562c72: ending tablet copy session 28812b178f824d539cab11abfe98d77d-4f7860cf1d8449fc9f062f3e09e4aafd on tablet 4f7860cf1d8449fc9f062f3e09e4aafd with peer 28812b178f824d539cab11abfe98d77d
I20260810 01:56:37.820374 29688 ts_tablet_manager.cc:933] T 4403a36d26db47278a82abb5df118bbd P 28812b178f824d539cab11abfe98d77d: Initiating tablet copy from peer 60d4538b78b44201964cf440ea562c72 (127.21.64.194:36943)
I20260810 01:56:37.873732 27005 consensus_queue.cc:237] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 125, Committed index: 125, Last appended: 1.125, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 126 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } }
I20260810 01:56:37.882635 26660 raft_consensus.cc:1275] T b10c8ac173fc40ca9817d1b654117ca1 P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 FOLLOWER]: Refusing update from remote peer 56388bef1a0f453cadc8b6aa9434311d: Log matching property violated. Preceding OpId in replica: term: 1 index: 125. Preceding OpId from leader: term: 1 index: 126. (index mismatch)
I20260810 01:56:37.883473 29608 consensus_queue.cc:1048] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 126, Last known committed idx: 125, Time since last communication: 0.000s
I20260810 01:56:37.888669 29136 raft_consensus.cc:2955] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d [term 1 LEADER]: Committing config change with OpId 1.126: config changed from index -1 to 126, VOTER 8be4ab1c5cca41849942448806160d19 (127.21.64.197) added. New config: { opid_index: 126 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } } }
I20260810 01:56:37.892200 29688 tablet_copy_client.cc:323] T 4403a36d26db47278a82abb5df118bbd P 28812b178f824d539cab11abfe98d77d: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.194:36943
I20260810 01:56:37.893900 26856 tablet_copy_service.cc:140] P 60d4538b78b44201964cf440ea562c72: Received BeginTabletCopySession request for tablet 4403a36d26db47278a82abb5df118bbd from peer 28812b178f824d539cab11abfe98d77d ({username='slave'} at 127.21.64.196:46613)
I20260810 01:56:37.894091 26856 tablet_copy_service.cc:161] P 60d4538b78b44201964cf440ea562c72: Beginning new tablet copy session on tablet 4403a36d26db47278a82abb5df118bbd from peer 28812b178f824d539cab11abfe98d77d at {username='slave'} at 127.21.64.196:46613: session id = 28812b178f824d539cab11abfe98d77d-4403a36d26db47278a82abb5df118bbd
I20260810 01:56:37.898424 26856 tablet_copy_source_session.cc:215] T 4403a36d26db47278a82abb5df118bbd P 60d4538b78b44201964cf440ea562c72: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:56:37.899819 29688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4403a36d26db47278a82abb5df118bbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:56:37.909382 26660 raft_consensus.cc:2955] T b10c8ac173fc40ca9817d1b654117ca1 P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 FOLLOWER]: Committing config change with OpId 1.126: config changed from index -1 to 126, VOTER 8be4ab1c5cca41849942448806160d19 (127.21.64.197) added. New config: { opid_index: 126 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } } }
I20260810 01:56:37.915405 26453 catalog_manager.cc:5719] T b10c8ac173fc40ca9817d1b654117ca1 P a46364d7cd504f8ca7fc003c59ae6d31 reported cstate change: config changed from index -1 to 126, VOTER 8be4ab1c5cca41849942448806160d19 (127.21.64.197) added. New cstate: current_term: 1 leader_uuid: "56388bef1a0f453cadc8b6aa9434311d" committed_config { opid_index: 126 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } } }
I20260810 01:56:37.935745 29688 tablet_copy_client.cc:806] T 4403a36d26db47278a82abb5df118bbd P 28812b178f824d539cab11abfe98d77d: tablet copy: Starting download of 0 data blocks...
I20260810 01:56:37.937717 29688 tablet_copy_client.cc:670] T 4403a36d26db47278a82abb5df118bbd P 28812b178f824d539cab11abfe98d77d: tablet copy: Starting download of 1 WAL segments...
I20260810 01:56:37.950953 29688 tablet_copy_client.cc:538] T 4403a36d26db47278a82abb5df118bbd P 28812b178f824d539cab11abfe98d77d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:56:37.961014 29688 tablet_bootstrap.cc:492] T 4403a36d26db47278a82abb5df118bbd P 28812b178f824d539cab11abfe98d77d: Bootstrap starting.
W20260810 01:56:37.993449 26910 consensus_peers.cc:597] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d -> Peer 8be4ab1c5cca41849942448806160d19 (127.21.64.197:46107): Couldn't send request to peer 8be4ab1c5cca41849942448806160d19. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b10c8ac173fc40ca9817d1b654117ca1. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:56:38.146683 28409 raft_consensus.cc:1217] T 4f7860cf1d8449fc9f062f3e09e4aafd P 28812b178f824d539cab11abfe98d77d [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.96->[1.97-1.112] Dedup: 1.103->[1.104-1.112]
I20260810 01:56:38.455698 29622 tablet_bootstrap.cc:492] T 3c77a4e4068b4dac971c281f5819a5a9 P 8be4ab1c5cca41849942448806160d19: Bootstrap replayed 1/1 log segments. Stats: ops{read=112 overwritten=0 applied=111 ignored=0} inserts{seen=796 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260810 01:56:38.458499 29622 tablet_bootstrap.cc:492] T 3c77a4e4068b4dac971c281f5819a5a9 P 8be4ab1c5cca41849942448806160d19: Bootstrap complete.
I20260810 01:56:38.459218 29622 ts_tablet_manager.cc:1403] T 3c77a4e4068b4dac971c281f5819a5a9 P 8be4ab1c5cca41849942448806160d19: Time spent bootstrapping tablet: real 0.929s user 0.198s sys 0.008s
I20260810 01:56:38.476480 29622 raft_consensus.cc:359] T 3c77a4e4068b4dac971c281f5819a5a9 P 8be4ab1c5cca41849942448806160d19 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: 104 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } }
I20260810 01:56:38.483158 29622 raft_consensus.cc:740] T 3c77a4e4068b4dac971c281f5819a5a9 P 8be4ab1c5cca41849942448806160d19 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8be4ab1c5cca41849942448806160d19, State: Initialized, Role: FOLLOWER
I20260810 01:56:38.486162 29622 consensus_queue.cc:260] T 3c77a4e4068b4dac971c281f5819a5a9 P 8be4ab1c5cca41849942448806160d19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 111, Last appended: 1.112, Last appended by leader: 112, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 104 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } }
I20260810 01:56:38.527595 29779 ts_tablet_manager.cc:933] T b10c8ac173fc40ca9817d1b654117ca1 P 8be4ab1c5cca41849942448806160d19: Initiating tablet copy from peer 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195:45355)
I20260810 01:56:38.545023 29622 ts_tablet_manager.cc:1434] T 3c77a4e4068b4dac971c281f5819a5a9 P 8be4ab1c5cca41849942448806160d19: Time spent starting tablet: real 0.083s user 0.004s sys 0.001s
I20260810 01:56:38.548210 26856 tablet_copy_service.cc:342] P 60d4538b78b44201964cf440ea562c72: Request end of tablet copy session 8be4ab1c5cca41849942448806160d19-3c77a4e4068b4dac971c281f5819a5a9 received from {username='slave'} at 127.21.64.197:45991
I20260810 01:56:38.548370 26856 tablet_copy_service.cc:434] P 60d4538b78b44201964cf440ea562c72: ending tablet copy session 8be4ab1c5cca41849942448806160d19-3c77a4e4068b4dac971c281f5819a5a9 on tablet 3c77a4e4068b4dac971c281f5819a5a9 with peer 8be4ab1c5cca41849942448806160d19
I20260810 01:56:38.557374 29779 tablet_copy_client.cc:323] T b10c8ac173fc40ca9817d1b654117ca1 P 8be4ab1c5cca41849942448806160d19: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.195:45355
I20260810 01:56:38.694355 27035 tablet_copy_service.cc:140] P 56388bef1a0f453cadc8b6aa9434311d: Received BeginTabletCopySession request for tablet b10c8ac173fc40ca9817d1b654117ca1 from peer 8be4ab1c5cca41849942448806160d19 ({username='slave'} at 127.21.64.197:54281)
I20260810 01:56:38.694624 27035 tablet_copy_service.cc:161] P 56388bef1a0f453cadc8b6aa9434311d: Beginning new tablet copy session on tablet b10c8ac173fc40ca9817d1b654117ca1 from peer 8be4ab1c5cca41849942448806160d19 at {username='slave'} at 127.21.64.197:54281: session id = 8be4ab1c5cca41849942448806160d19-b10c8ac173fc40ca9817d1b654117ca1
I20260810 01:56:38.704365 27035 tablet_copy_source_session.cc:215] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:56:38.706167 29779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b10c8ac173fc40ca9817d1b654117ca1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:56:38.739681 29779 tablet_copy_client.cc:806] T b10c8ac173fc40ca9817d1b654117ca1 P 8be4ab1c5cca41849942448806160d19: tablet copy: Starting download of 0 data blocks...
I20260810 01:56:38.740152 29779 tablet_copy_client.cc:670] T b10c8ac173fc40ca9817d1b654117ca1 P 8be4ab1c5cca41849942448806160d19: tablet copy: Starting download of 1 WAL segments...
I20260810 01:56:38.743942 29779 tablet_copy_client.cc:538] T b10c8ac173fc40ca9817d1b654117ca1 P 8be4ab1c5cca41849942448806160d19: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:56:38.747864 29779 tablet_bootstrap.cc:492] T b10c8ac173fc40ca9817d1b654117ca1 P 8be4ab1c5cca41849942448806160d19: Bootstrap starting.
I20260810 01:56:38.765220 28586 raft_consensus.cc:1217] T 3c77a4e4068b4dac971c281f5819a5a9 P 8be4ab1c5cca41849942448806160d19 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.103->[1.104-1.128] Dedup: 1.112->[1.113-1.128]
W20260810 01:56:39.008913 29688 log.cc:927] Time spent T 4403a36d26db47278a82abb5df118bbd P 28812b178f824d539cab11abfe98d77d: Append to log took a long time: real 0.083s user 0.000s sys 0.000s
I20260810 01:56:39.316825 29779 tablet_bootstrap.cc:492] T b10c8ac173fc40ca9817d1b654117ca1 P 8be4ab1c5cca41849942448806160d19: Bootstrap replayed 1/1 log segments. Stats: ops{read=139 overwritten=0 applied=139 ignored=0} inserts{seen=824 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:56:39.321887 29779 tablet_bootstrap.cc:492] T b10c8ac173fc40ca9817d1b654117ca1 P 8be4ab1c5cca41849942448806160d19: Bootstrap complete.
I20260810 01:56:39.322288 29779 ts_tablet_manager.cc:1403] T b10c8ac173fc40ca9817d1b654117ca1 P 8be4ab1c5cca41849942448806160d19: Time spent bootstrapping tablet: real 0.575s user 0.230s sys 0.013s
I20260810 01:56:39.326622 29779 raft_consensus.cc:359] T b10c8ac173fc40ca9817d1b654117ca1 P 8be4ab1c5cca41849942448806160d19 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 126 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } }
I20260810 01:56:39.330032 26976 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:56:39.332232 29779 raft_consensus.cc:740] T b10c8ac173fc40ca9817d1b654117ca1 P 8be4ab1c5cca41849942448806160d19 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8be4ab1c5cca41849942448806160d19, State: Initialized, Role: FOLLOWER
I20260810 01:56:39.333215 29779 consensus_queue.cc:260] T b10c8ac173fc40ca9817d1b654117ca1 P 8be4ab1c5cca41849942448806160d19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 139, Last appended: 1.139, Last appended by leader: 139, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 126 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } }
I20260810 01:56:39.341866 29779 ts_tablet_manager.cc:1434] T b10c8ac173fc40ca9817d1b654117ca1 P 8be4ab1c5cca41849942448806160d19: Time spent starting tablet: real 0.019s user 0.003s sys 0.000s
I20260810 01:56:39.362080 27035 tablet_copy_service.cc:342] P 56388bef1a0f453cadc8b6aa9434311d: Request end of tablet copy session 8be4ab1c5cca41849942448806160d19-b10c8ac173fc40ca9817d1b654117ca1 received from {username='slave'} at 127.21.64.197:54281
I20260810 01:56:39.362241 27035 tablet_copy_service.cc:434] P 56388bef1a0f453cadc8b6aa9434311d: ending tablet copy session 8be4ab1c5cca41849942448806160d19-b10c8ac173fc40ca9817d1b654117ca1 on tablet b10c8ac173fc40ca9817d1b654117ca1 with peer 8be4ab1c5cca41849942448806160d19
I20260810 01:56:39.387609 28379 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:39.442714 28916 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:39.605502 26634 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:56:39.632337 28739 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:39.635085 28563 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:39.674976 28584 raft_consensus.cc:1217] T b10c8ac173fc40ca9817d1b654117ca1 P 8be4ab1c5cca41849942448806160d19 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.125->[1.126-1.152] Dedup: 1.139->[1.140-1.152]
I20260810 01:56:39.729229 26806 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
W20260810 01:56:39.740059 29688 log.cc:927] Time spent T 4403a36d26db47278a82abb5df118bbd P 28812b178f824d539cab11abfe98d77d: Append to log took a long time: real 0.067s user 0.004s sys 0.000s
I20260810 01:56:40.099155 29688 tablet_bootstrap.cc:492] T 4403a36d26db47278a82abb5df118bbd P 28812b178f824d539cab11abfe98d77d: Bootstrap replayed 1/1 log segments. Stats: ops{read=155 overwritten=0 applied=155 ignored=0} inserts{seen=827 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:56:40.099852 29688 tablet_bootstrap.cc:492] T 4403a36d26db47278a82abb5df118bbd P 28812b178f824d539cab11abfe98d77d: Bootstrap complete.
I20260810 01:56:40.100257 29688 ts_tablet_manager.cc:1403] T 4403a36d26db47278a82abb5df118bbd P 28812b178f824d539cab11abfe98d77d: Time spent bootstrapping tablet: real 2.139s user 0.289s sys 0.072s
I20260810 01:56:40.101361 29688 raft_consensus.cc:359] T 4403a36d26db47278a82abb5df118bbd P 28812b178f824d539cab11abfe98d77d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 143 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } }
I20260810 01:56:40.101641 29688 raft_consensus.cc:740] T 4403a36d26db47278a82abb5df118bbd P 28812b178f824d539cab11abfe98d77d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28812b178f824d539cab11abfe98d77d, State: Initialized, Role: FOLLOWER
I20260810 01:56:40.102044 29688 consensus_queue.cc:260] T 4403a36d26db47278a82abb5df118bbd P 28812b178f824d539cab11abfe98d77d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 155, Last appended: 1.155, Last appended by leader: 155, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 143 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } }
I20260810 01:56:40.145696 29688 ts_tablet_manager.cc:1434] T 4403a36d26db47278a82abb5df118bbd P 28812b178f824d539cab11abfe98d77d: Time spent starting tablet: real 0.045s user 0.013s sys 0.022s
I20260810 01:56:40.149068 26856 tablet_copy_service.cc:342] P 60d4538b78b44201964cf440ea562c72: Request end of tablet copy session 28812b178f824d539cab11abfe98d77d-4403a36d26db47278a82abb5df118bbd received from {username='slave'} at 127.21.64.196:46613
I20260810 01:56:40.149277 26856 tablet_copy_service.cc:434] P 60d4538b78b44201964cf440ea562c72: ending tablet copy session 28812b178f824d539cab11abfe98d77d-4403a36d26db47278a82abb5df118bbd on tablet 4403a36d26db47278a82abb5df118bbd with peer 28812b178f824d539cab11abfe98d77d
W20260810 01:56:40.276738 26745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.193:45781, user_credentials={real_user=slave}} blocked reactor thread for 43819.5us
I20260810 01:56:40.678736 28408 raft_consensus.cc:1217] T 4403a36d26db47278a82abb5df118bbd P 28812b178f824d539cab11abfe98d77d [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.142->[1.143-1.188] Dedup: 1.155->[1.156-1.188]
I20260810 01:56:41.157737 28916 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:41.274662 28379 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:41.289934 28563 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:41.302217 28739 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:41.326992 26634 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:56:41.335695 26806 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:56:41.391402 26976 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
W20260810 01:56:42.494254 26574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.197:46107, user_credentials={real_user=slave}} blocked reactor thread for 43503.2us
W20260810 01:56:42.631175 26910 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.196:41095, user_credentials={real_user=slave}} blocked reactor thread for 53291.9us
I20260810 01:56:42.736831 28916 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:42.840123 28563 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:42.896275 28379 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:42.953258 28739 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:42.995895 26806 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:56:43.023758 26976 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:56:43.061426 26634 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:56:43.965638 26832 consensus_queue.cc:237] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 181, Committed index: 181, Last appended: 1.181, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 182 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } }
I20260810 01:56:43.968220 28408 raft_consensus.cc:1275] T 4f7860cf1d8449fc9f062f3e09e4aafd P 28812b178f824d539cab11abfe98d77d [term 1 FOLLOWER]: Refusing update from remote peer 60d4538b78b44201964cf440ea562c72: Log matching property violated. Preceding OpId in replica: term: 1 index: 181. Preceding OpId from leader: term: 1 index: 182. (index mismatch)
I20260810 01:56:43.975410 29663 consensus_queue.cc:1048] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 182, Last known committed idx: 181, Time since last communication: 0.001s
I20260810 01:56:43.992715 29934 raft_consensus.cc:2955] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72 [term 1 LEADER]: Committing config change with OpId 1.182: config changed from index 97 to 182, VOTER 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195) evicted. New config: { opid_index: 182 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } } }
I20260810 01:56:43.993844 28409 raft_consensus.cc:2955] T 4f7860cf1d8449fc9f062f3e09e4aafd P 28812b178f824d539cab11abfe98d77d [term 1 FOLLOWER]: Committing config change with OpId 1.182: config changed from index 97 to 182, VOTER 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195) evicted. New config: { opid_index: 182 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } } }
I20260810 01:56:44.003711 26453 catalog_manager.cc:5719] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72 reported cstate change: config changed from index 97 to 182, VOTER 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195) evicted. New cstate: current_term: 1 leader_uuid: "60d4538b78b44201964cf440ea562c72" committed_config { opid_index: 182 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } } }
W20260810 01:56:44.085227 26574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.197:46107, user_credentials={real_user=slave}} blocked reactor thread for 45083.6us
I20260810 01:56:44.264041 26976 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f7860cf1d8449fc9f062f3e09e4aafd with delete_type TABLET_DATA_TOMBSTONED (TS 56388bef1a0f453cadc8b6aa9434311d not found in new config with opid_index 182) from {username='slave'} at 127.0.0.1:39126
I20260810 01:56:44.272711 30037 tablet_replica.cc:333] T 4f7860cf1d8449fc9f062f3e09e4aafd P 56388bef1a0f453cadc8b6aa9434311d: stopping tablet replica
I20260810 01:56:44.273675 30037 raft_consensus.cc:2243] T 4f7860cf1d8449fc9f062f3e09e4aafd P 56388bef1a0f453cadc8b6aa9434311d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:56:44.274257 30037 raft_consensus.cc:2272] T 4f7860cf1d8449fc9f062f3e09e4aafd P 56388bef1a0f453cadc8b6aa9434311d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:56:44.279312 30037 ts_tablet_manager.cc:1916] T 4f7860cf1d8449fc9f062f3e09e4aafd P 56388bef1a0f453cadc8b6aa9434311d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:56:44.291828 30037 ts_tablet_manager.cc:1929] T 4f7860cf1d8449fc9f062f3e09e4aafd P 56388bef1a0f453cadc8b6aa9434311d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.181
I20260810 01:56:44.294368 30037 log.cc:1199] T 4f7860cf1d8449fc9f062f3e09e4aafd P 56388bef1a0f453cadc8b6aa9434311d: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/wal/wals/4f7860cf1d8449fc9f062f3e09e4aafd
I20260810 01:56:44.306100 26445 catalog_manager.cc:5050] TS 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195:45355): tablet 4f7860cf1d8449fc9f062f3e09e4aafd (table rebalance_test_table_4 [id=b8ab0a3e55d1493fb5fc271a33432c29]) successfully deleted
I20260810 01:56:45.521790 28916 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:45.533812 28379 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:45.643409 26976 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:56:45.663919 28563 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:45.699797 26806 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:56:45.756453 28739 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:45.821542 26634 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
W20260810 01:56:46.041289 26574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.194:36943, user_credentials={real_user=slave}} blocked reactor thread for 50137.1us
W20260810 01:56:46.421265 26745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.193:45781, user_credentials={real_user=slave}} blocked reactor thread for 49152.4us
I20260810 01:56:46.743036 26832 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "059c8fa5da994e6c9f3582df4542d276"
dest_uuid: "60d4538b78b44201964cf440ea562c72"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:41164
I20260810 01:56:46.743412 26832 raft_consensus.cc:606] T 059c8fa5da994e6c9f3582df4542d276 P 60d4538b78b44201964cf440ea562c72 [term 1 LEADER]: Received request to transfer leadership
W20260810 01:56:46.859125 26771 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50978: Service unavailable: leader transfer in progress
W20260810 01:56:46.863991 26775 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50978: Service unavailable: leader transfer in progress
W20260810 01:56:46.870400 26775 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50978: Service unavailable: leader transfer in progress
W20260810 01:56:46.878844 26775 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50978: Service unavailable: leader transfer in progress
W20260810 01:56:46.888514 26775 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50978: Service unavailable: leader transfer in progress
W20260810 01:56:46.899443 26775 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50978: Service unavailable: leader transfer in progress
W20260810 01:56:46.914846 26775 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50978: Service unavailable: leader transfer in progress
W20260810 01:56:46.925690 26775 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50978: Service unavailable: leader transfer in progress
W20260810 01:56:46.943652 26775 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50978: Service unavailable: leader transfer in progress
W20260810 01:56:46.960404 26771 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50978: Service unavailable: leader transfer in progress
W20260810 01:56:46.976955 26775 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50978: Service unavailable: leader transfer in progress
W20260810 01:56:46.995904 26775 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50978: Service unavailable: leader transfer in progress
W20260810 01:56:47.014349 26775 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50978: Service unavailable: leader transfer in progress
W20260810 01:56:47.029316 26775 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50978: Service unavailable: leader transfer in progress
W20260810 01:56:47.046365 26775 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50978: Service unavailable: leader transfer in progress
W20260810 01:56:47.063201 26775 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50978: Service unavailable: leader transfer in progress
W20260810 01:56:47.083117 26775 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50978: Service unavailable: leader transfer in progress
W20260810 01:56:47.104421 26775 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50978: Service unavailable: leader transfer in progress
W20260810 01:56:47.129776 26775 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50978: Service unavailable: leader transfer in progress
W20260810 01:56:47.160137 26775 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50978: Service unavailable: leader transfer in progress
I20260810 01:56:47.191789 30118 raft_consensus.cc:993] T 059c8fa5da994e6c9f3582df4542d276 P 60d4538b78b44201964cf440ea562c72: : Instructing follower 8be4ab1c5cca41849942448806160d19 to start an election
I20260810 01:56:47.192417 29663 raft_consensus.cc:1081] T 059c8fa5da994e6c9f3582df4542d276 P 60d4538b78b44201964cf440ea562c72 [term 1 LEADER]: Signalling peer 8be4ab1c5cca41849942448806160d19 to start an election
I20260810 01:56:47.194398 28584 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "059c8fa5da994e6c9f3582df4542d276"
dest_uuid: "8be4ab1c5cca41849942448806160d19"
from {username='slave'} at 127.21.64.194:44903
I20260810 01:56:47.194746 28584 raft_consensus.cc:493] T 059c8fa5da994e6c9f3582df4542d276 P 8be4ab1c5cca41849942448806160d19 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260810 01:56:47.194958 28584 raft_consensus.cc:3060] T 059c8fa5da994e6c9f3582df4542d276 P 8be4ab1c5cca41849942448806160d19 [term 1 FOLLOWER]: Advancing to term 2
I20260810 01:56:47.198213 28584 raft_consensus.cc:515] T 059c8fa5da994e6c9f3582df4542d276 P 8be4ab1c5cca41849942448806160d19 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 135 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } }
W20260810 01:56:47.200094 26775 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50978: Service unavailable: leader transfer in progress
I20260810 01:56:47.200481 28584 leader_election.cc:290] T 059c8fa5da994e6c9f3582df4542d276 P 8be4ab1c5cca41849942448806160d19 [CANDIDATE]: Term 2 election: Requested vote from peers 60d4538b78b44201964cf440ea562c72 (127.21.64.194:36943), 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195:45355)
I20260810 01:56:47.200927 27004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059c8fa5da994e6c9f3582df4542d276" candidate_uuid: "8be4ab1c5cca41849942448806160d19" candidate_term: 2 candidate_status { last_received { term: 1 index: 292 } } ignore_live_leader: true dest_uuid: "56388bef1a0f453cadc8b6aa9434311d"
I20260810 01:56:47.201184 27004 raft_consensus.cc:3060] T 059c8fa5da994e6c9f3582df4542d276 P 56388bef1a0f453cadc8b6aa9434311d [term 1 FOLLOWER]: Advancing to term 2
I20260810 01:56:47.206387 26827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059c8fa5da994e6c9f3582df4542d276" candidate_uuid: "8be4ab1c5cca41849942448806160d19" candidate_term: 2 candidate_status { last_received { term: 1 index: 292 } } ignore_live_leader: true dest_uuid: "60d4538b78b44201964cf440ea562c72"
I20260810 01:56:47.206722 26827 raft_consensus.cc:3055] T 059c8fa5da994e6c9f3582df4542d276 P 60d4538b78b44201964cf440ea562c72 [term 1 LEADER]: Stepping down as leader of term 1
I20260810 01:56:47.206842 26827 raft_consensus.cc:740] T 059c8fa5da994e6c9f3582df4542d276 P 60d4538b78b44201964cf440ea562c72 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 60d4538b78b44201964cf440ea562c72, State: Running, Role: LEADER
I20260810 01:56:47.207222 26827 consensus_queue.cc:260] T 059c8fa5da994e6c9f3582df4542d276 P 60d4538b78b44201964cf440ea562c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 292, Committed index: 292, Last appended: 1.292, Last appended by leader: 292, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 135 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } }
I20260810 01:56:47.207625 26827 raft_consensus.cc:3060] T 059c8fa5da994e6c9f3582df4542d276 P 60d4538b78b44201964cf440ea562c72 [term 1 FOLLOWER]: Advancing to term 2
I20260810 01:56:47.204629 27004 raft_consensus.cc:2468] T 059c8fa5da994e6c9f3582df4542d276 P 56388bef1a0f453cadc8b6aa9434311d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8be4ab1c5cca41849942448806160d19 in term 2.
I20260810 01:56:47.213366 27006 raft_consensus.cc:1240] T 059c8fa5da994e6c9f3582df4542d276 P 56388bef1a0f453cadc8b6aa9434311d [term 2 FOLLOWER]: Rejecting Update request from peer 60d4538b78b44201964cf440ea562c72 for earlier term 1. Current term is 2. Ops: []
I20260810 01:56:47.213729 28495 leader_election.cc:304] T 059c8fa5da994e6c9f3582df4542d276 P 8be4ab1c5cca41849942448806160d19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56388bef1a0f453cadc8b6aa9434311d, 8be4ab1c5cca41849942448806160d19; no voters:
I20260810 01:56:47.214545 30144 raft_consensus.cc:2804] T 059c8fa5da994e6c9f3582df4542d276 P 8be4ab1c5cca41849942448806160d19 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 01:56:47.216612 26827 raft_consensus.cc:2468] T 059c8fa5da994e6c9f3582df4542d276 P 60d4538b78b44201964cf440ea562c72 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8be4ab1c5cca41849942448806160d19 in term 2.
W20260810 01:56:47.228104 26775 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50978: Illegal state: replica 60d4538b78b44201964cf440ea562c72 is not leader of this config: current role FOLLOWER
I20260810 01:56:47.260051 30144 raft_consensus.cc:697] T 059c8fa5da994e6c9f3582df4542d276 P 8be4ab1c5cca41849942448806160d19 [term 2 LEADER]: Becoming Leader. State: Replica: 8be4ab1c5cca41849942448806160d19, State: Running, Role: LEADER
I20260810 01:56:47.267293 30144 consensus_queue.cc:237] T 059c8fa5da994e6c9f3582df4542d276 P 8be4ab1c5cca41849942448806160d19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 292, Committed index: 292, Last appended: 1.292, Last appended by leader: 292, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 135 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } }
I20260810 01:56:47.271948 26470 catalog_manager.cc:5719] T 059c8fa5da994e6c9f3582df4542d276 P 8be4ab1c5cca41849942448806160d19 reported cstate change: term changed from 1 to 2, leader changed from 60d4538b78b44201964cf440ea562c72 (127.21.64.194) to 8be4ab1c5cca41849942448806160d19 (127.21.64.197). New cstate: current_term: 2 leader_uuid: "8be4ab1c5cca41849942448806160d19" committed_config { opid_index: 135 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } } }
W20260810 01:56:47.353696 26947 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42082: Illegal state: replica 56388bef1a0f453cadc8b6aa9434311d is not leader of this config: current role FOLLOWER
I20260810 01:56:47.467717 27006 raft_consensus.cc:1275] T 059c8fa5da994e6c9f3582df4542d276 P 56388bef1a0f453cadc8b6aa9434311d [term 2 FOLLOWER]: Refusing update from remote peer 8be4ab1c5cca41849942448806160d19: Log matching property violated. Preceding OpId in replica: term: 1 index: 292. Preceding OpId from leader: term: 2 index: 294. (index mismatch)
I20260810 01:56:47.468559 26827 raft_consensus.cc:1275] T 059c8fa5da994e6c9f3582df4542d276 P 60d4538b78b44201964cf440ea562c72 [term 2 FOLLOWER]: Refusing update from remote peer 8be4ab1c5cca41849942448806160d19: Log matching property violated. Preceding OpId in replica: term: 1 index: 292. Preceding OpId from leader: term: 2 index: 294. (index mismatch)
I20260810 01:56:47.468703 30144 consensus_queue.cc:1048] T 059c8fa5da994e6c9f3582df4542d276 P 8be4ab1c5cca41849942448806160d19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 293, Last known committed idx: 292, Time since last communication: 0.000s
I20260810 01:56:47.469419 30145 consensus_queue.cc:1048] T 059c8fa5da994e6c9f3582df4542d276 P 8be4ab1c5cca41849942448806160d19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 293, Last known committed idx: 292, Time since last communication: 0.000s
I20260810 01:56:47.475792 30060 mvcc.cc:204] Tried to move back new op lower bound from 7316795422578589696 to 7316795421774462976. Current Snapshot: MvccSnapshot[applied={T|T < 7316795422578589696}]
I20260810 01:56:47.960945 28379 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:47.967123 28916 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:47.967291 26976 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:56:48.145854 26806 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260810 01:56:48.193785 28563 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:56:48.228559 26634 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:56:48.392221 28739 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260810 01:56:48.610278 29121 log.cc:927] Time spent T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31: Append to log took a long time: real 0.094s user 0.001s sys 0.000s
I20260810 01:56:49.869789 28582 consensus_queue.cc:237] T 059c8fa5da994e6c9f3582df4542d276 P 8be4ab1c5cca41849942448806160d19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 321, Committed index: 321, Last appended: 2.321, Last appended by leader: 292, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 322 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } }
I20260810 01:56:49.873378 27005 raft_consensus.cc:1275] T 059c8fa5da994e6c9f3582df4542d276 P 56388bef1a0f453cadc8b6aa9434311d [term 2 FOLLOWER]: Refusing update from remote peer 8be4ab1c5cca41849942448806160d19: Log matching property violated. Preceding OpId in replica: term: 2 index: 321. Preceding OpId from leader: term: 2 index: 322. (index mismatch)
I20260810 01:56:49.874599 30145 consensus_queue.cc:1048] T 059c8fa5da994e6c9f3582df4542d276 P 8be4ab1c5cca41849942448806160d19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 322, Last known committed idx: 321, Time since last communication: 0.000s
I20260810 01:56:49.877111 30145 raft_consensus.cc:2955] T 059c8fa5da994e6c9f3582df4542d276 P 8be4ab1c5cca41849942448806160d19 [term 2 LEADER]: Committing config change with OpId 2.322: config changed from index 135 to 322, VOTER 60d4538b78b44201964cf440ea562c72 (127.21.64.194) evicted. New config: { opid_index: 322 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } } }
I20260810 01:56:49.881420 27006 raft_consensus.cc:2955] T 059c8fa5da994e6c9f3582df4542d276 P 56388bef1a0f453cadc8b6aa9434311d [term 2 FOLLOWER]: Committing config change with OpId 2.322: config changed from index 135 to 322, VOTER 60d4538b78b44201964cf440ea562c72 (127.21.64.194) evicted. New config: { opid_index: 322 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } } }
I20260810 01:56:49.889842 26453 catalog_manager.cc:5719] T 059c8fa5da994e6c9f3582df4542d276 P 56388bef1a0f453cadc8b6aa9434311d reported cstate change: config changed from index 135 to 322, VOTER 60d4538b78b44201964cf440ea562c72 (127.21.64.194) evicted. New cstate: current_term: 2 leader_uuid: "8be4ab1c5cca41849942448806160d19" committed_config { opid_index: 322 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } } }
I20260810 01:56:50.000830 26806 tablet_service.cc:1558] Processing DeleteTablet for tablet 059c8fa5da994e6c9f3582df4542d276 with delete_type TABLET_DATA_TOMBSTONED (TS 60d4538b78b44201964cf440ea562c72 not found in new config with opid_index 322) from {username='slave'} at 127.0.0.1:59826
I20260810 01:56:50.002733 30277 tablet_replica.cc:333] T 059c8fa5da994e6c9f3582df4542d276 P 60d4538b78b44201964cf440ea562c72: stopping tablet replica
I20260810 01:56:50.003680 30277 raft_consensus.cc:2243] T 059c8fa5da994e6c9f3582df4542d276 P 60d4538b78b44201964cf440ea562c72 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260810 01:56:50.004300 30277 raft_consensus.cc:2272] T 059c8fa5da994e6c9f3582df4542d276 P 60d4538b78b44201964cf440ea562c72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260810 01:56:50.070506 30277 ts_tablet_manager.cc:1916] T 059c8fa5da994e6c9f3582df4542d276 P 60d4538b78b44201964cf440ea562c72: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:56:50.087956 30277 ts_tablet_manager.cc:1929] T 059c8fa5da994e6c9f3582df4542d276 P 60d4538b78b44201964cf440ea562c72: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.321
I20260810 01:56:50.088270 30277 log.cc:1199] T 059c8fa5da994e6c9f3582df4542d276 P 60d4538b78b44201964cf440ea562c72: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal/wals/059c8fa5da994e6c9f3582df4542d276
I20260810 01:56:50.106709 26442 catalog_manager.cc:5050] TS 60d4538b78b44201964cf440ea562c72 (127.21.64.194:36943): tablet 059c8fa5da994e6c9f3582df4542d276 (table rebalance_test_table_0 [id=52f00827f2964d63b49607d8194867d6]) successfully deleted
W20260810 01:56:50.625943 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.195:45355, user_credentials={real_user=slave}} blocked reactor thread for 43549.7us
I20260810 01:56:51.627622 28916 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:51.661239 28379 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:51.678097 28739 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260810 01:56:51.693817 26910 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.194:36943, user_credentials={real_user=slave}} blocked reactor thread for 98261.1us
I20260810 01:56:51.710944 26806 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260810 01:56:51.712894 26634 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:56:51.793187 28563 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
W20260810 01:56:51.859728 26910 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.194:36943, user_credentials={real_user=slave}} blocked reactor thread for 51218.9us
I20260810 01:56:51.967094 26976 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
W20260810 01:56:52.700582 26745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.193:45781, user_credentials={real_user=slave}} blocked reactor thread for 94339.8us
I20260810 01:56:52.765065 27005 consensus_queue.cc:237] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 320, Committed index: 320, Last appended: 1.320, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 321 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } }
I20260810 01:56:52.768365 28586 raft_consensus.cc:1275] T b10c8ac173fc40ca9817d1b654117ca1 P 8be4ab1c5cca41849942448806160d19 [term 1 FOLLOWER]: Refusing update from remote peer 56388bef1a0f453cadc8b6aa9434311d: Log matching property violated. Preceding OpId in replica: term: 1 index: 320. Preceding OpId from leader: term: 1 index: 321. (index mismatch)
I20260810 01:56:52.769574 30130 consensus_queue.cc:1048] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 321, Last known committed idx: 320, Time since last communication: 0.000s
I20260810 01:56:52.773159 30130 raft_consensus.cc:2955] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d [term 1 LEADER]: Committing config change with OpId 1.321: config changed from index 126 to 321, VOTER a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193) evicted. New config: { opid_index: 321 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } } }
I20260810 01:56:52.776073 28586 raft_consensus.cc:2955] T b10c8ac173fc40ca9817d1b654117ca1 P 8be4ab1c5cca41849942448806160d19 [term 1 FOLLOWER]: Committing config change with OpId 1.321: config changed from index 126 to 321, VOTER a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193) evicted. New config: { opid_index: 321 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } } }
I20260810 01:56:52.792323 26453 catalog_manager.cc:5719] T b10c8ac173fc40ca9817d1b654117ca1 P 8be4ab1c5cca41849942448806160d19 reported cstate change: config changed from index 126 to 321, VOTER a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193) evicted. New cstate: current_term: 1 leader_uuid: "56388bef1a0f453cadc8b6aa9434311d" committed_config { opid_index: 321 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } } }
W20260810 01:56:52.861557 26910 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.196:41095, user_credentials={real_user=slave}} blocked reactor thread for 63264.2us
I20260810 01:56:52.937541 26634 tablet_service.cc:1558] Processing DeleteTablet for tablet b10c8ac173fc40ca9817d1b654117ca1 with delete_type TABLET_DATA_TOMBSTONED (TS a46364d7cd504f8ca7fc003c59ae6d31 not found in new config with opid_index 321) from {username='slave'} at 127.0.0.1:37082
I20260810 01:56:52.939129 30414 tablet_replica.cc:333] T b10c8ac173fc40ca9817d1b654117ca1 P a46364d7cd504f8ca7fc003c59ae6d31: stopping tablet replica
I20260810 01:56:52.939826 30414 raft_consensus.cc:2243] T b10c8ac173fc40ca9817d1b654117ca1 P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:56:52.940519 30414 raft_consensus.cc:2272] T b10c8ac173fc40ca9817d1b654117ca1 P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:56:52.942838 30414 ts_tablet_manager.cc:1916] T b10c8ac173fc40ca9817d1b654117ca1 P a46364d7cd504f8ca7fc003c59ae6d31: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:56:53.026511 30414 ts_tablet_manager.cc:1929] T b10c8ac173fc40ca9817d1b654117ca1 P a46364d7cd504f8ca7fc003c59ae6d31: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.320
I20260810 01:56:53.026928 30414 log.cc:1199] T b10c8ac173fc40ca9817d1b654117ca1 P a46364d7cd504f8ca7fc003c59ae6d31: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/wal/wals/b10c8ac173fc40ca9817d1b654117ca1
I20260810 01:56:53.031420 26446 catalog_manager.cc:5050] TS a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193:45781): tablet b10c8ac173fc40ca9817d1b654117ca1 (table rebalance_test_table_1 [id=bdbf5b2bb6b04aa9baa11723c241453d]) successfully deleted
W20260810 01:56:54.298328 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.197:46107, user_credentials={real_user=slave}} blocked reactor thread for 59276.7us
I20260810 01:56:54.477650 28916 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:54.528821 26976 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:56:54.551091 28739 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:54.557958 26634 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:56:54.624084 28563 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:56:54.625711 26806 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260810 01:56:54.631585 28379 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:55.816334 26833 consensus_queue.cc:237] T d76ed7c57001495fb62e15bd9f14a162 P 60d4538b78b44201964cf440ea562c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 309, Committed index: 309, Last appended: 1.309, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 310 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } }
I20260810 01:56:55.827994 28769 raft_consensus.cc:1275] T d76ed7c57001495fb62e15bd9f14a162 P 9353b63b4d854d23b51a8103bc899aab [term 1 FOLLOWER]: Refusing update from remote peer 60d4538b78b44201964cf440ea562c72: Log matching property violated. Preceding OpId in replica: term: 1 index: 309. Preceding OpId from leader: term: 1 index: 310. (index mismatch)
I20260810 01:56:55.829649 30191 consensus_queue.cc:1048] T d76ed7c57001495fb62e15bd9f14a162 P 60d4538b78b44201964cf440ea562c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 310, Last known committed idx: 309, Time since last communication: 0.000s
I20260810 01:56:55.854141 30392 raft_consensus.cc:2955] T d76ed7c57001495fb62e15bd9f14a162 P 60d4538b78b44201964cf440ea562c72 [term 1 LEADER]: Committing config change with OpId 1.310: config changed from index 91 to 310, VOTER a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193) evicted. New config: { opid_index: 310 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } } }
I20260810 01:56:55.862535 28768 raft_consensus.cc:2955] T d76ed7c57001495fb62e15bd9f14a162 P 9353b63b4d854d23b51a8103bc899aab [term 1 FOLLOWER]: Committing config change with OpId 1.310: config changed from index 91 to 310, VOTER a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193) evicted. New config: { opid_index: 310 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } } }
I20260810 01:56:55.875816 26453 catalog_manager.cc:5719] T d76ed7c57001495fb62e15bd9f14a162 P 60d4538b78b44201964cf440ea562c72 reported cstate change: config changed from index 91 to 310, VOTER a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193) evicted. New cstate: current_term: 1 leader_uuid: "60d4538b78b44201964cf440ea562c72" committed_config { opid_index: 310 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } } }
I20260810 01:56:56.011646 26634 tablet_service.cc:1558] Processing DeleteTablet for tablet d76ed7c57001495fb62e15bd9f14a162 with delete_type TABLET_DATA_TOMBSTONED (TS a46364d7cd504f8ca7fc003c59ae6d31 not found in new config with opid_index 310) from {username='slave'} at 127.0.0.1:37082
I20260810 01:56:56.040225 30542 tablet_replica.cc:333] T d76ed7c57001495fb62e15bd9f14a162 P a46364d7cd504f8ca7fc003c59ae6d31: stopping tablet replica
I20260810 01:56:56.040483 30542 raft_consensus.cc:2243] T d76ed7c57001495fb62e15bd9f14a162 P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:56:56.040705 30542 raft_consensus.cc:2272] T d76ed7c57001495fb62e15bd9f14a162 P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:56:56.071106 30542 ts_tablet_manager.cc:1916] T d76ed7c57001495fb62e15bd9f14a162 P a46364d7cd504f8ca7fc003c59ae6d31: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:56:56.105382 30542 ts_tablet_manager.cc:1929] T d76ed7c57001495fb62e15bd9f14a162 P a46364d7cd504f8ca7fc003c59ae6d31: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.309
I20260810 01:56:56.105634 30542 log.cc:1199] T d76ed7c57001495fb62e15bd9f14a162 P a46364d7cd504f8ca7fc003c59ae6d31: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/wal/wals/d76ed7c57001495fb62e15bd9f14a162
I20260810 01:56:56.113920 26446 catalog_manager.cc:5050] TS a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193:45781): tablet d76ed7c57001495fb62e15bd9f14a162 (table rebalance_test_table_2 [id=e4e97ceec9a145e095f04aa5c373d684]) successfully deleted
I20260810 01:56:57.522693 28916 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:57.655823 26976 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:56:57.761135 28379 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:57.770982 28739 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:56:57.818532 26634 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:56:57.855311 28563 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:56:57.883375 26806 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260810 01:56:59.252344 26656 consensus_queue.cc:237] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 387, Committed index: 387, Last appended: 1.387, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 388 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } }
I20260810 01:56:59.260882 28942 raft_consensus.cc:1275] T b59ebeb3dc294227a54a82a640c798ce P 07e0a39216984856b2ff8c512c4c2f93 [term 1 FOLLOWER]: Refusing update from remote peer a46364d7cd504f8ca7fc003c59ae6d31: Log matching property violated. Preceding OpId in replica: term: 1 index: 387. Preceding OpId from leader: term: 1 index: 388. (index mismatch)
I20260810 01:56:59.264488 30644 consensus_queue.cc:1048] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 388, Last known committed idx: 387, Time since last communication: 0.000s
I20260810 01:56:59.272341 30644 raft_consensus.cc:2955] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 LEADER]: Committing config change with OpId 1.388: config changed from index 49 to 388, VOTER 60d4538b78b44201964cf440ea562c72 (127.21.64.194) evicted. New config: { opid_index: 388 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } }
I20260810 01:56:59.294759 28943 raft_consensus.cc:2955] T b59ebeb3dc294227a54a82a640c798ce P 07e0a39216984856b2ff8c512c4c2f93 [term 1 FOLLOWER]: Committing config change with OpId 1.388: config changed from index 49 to 388, VOTER 60d4538b78b44201964cf440ea562c72 (127.21.64.194) evicted. New config: { opid_index: 388 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } }
I20260810 01:56:59.295286 26453 catalog_manager.cc:5719] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31 reported cstate change: config changed from index 49 to 388, VOTER 60d4538b78b44201964cf440ea562c72 (127.21.64.194) evicted. New cstate: current_term: 1 leader_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" committed_config { opid_index: 388 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } }
I20260810 01:56:59.419950 26806 tablet_service.cc:1558] Processing DeleteTablet for tablet b59ebeb3dc294227a54a82a640c798ce with delete_type TABLET_DATA_TOMBSTONED (TS 60d4538b78b44201964cf440ea562c72 not found in new config with opid_index 388) from {username='slave'} at 127.0.0.1:59826
I20260810 01:56:59.501216 30703 tablet_replica.cc:333] T b59ebeb3dc294227a54a82a640c798ce P 60d4538b78b44201964cf440ea562c72: stopping tablet replica
I20260810 01:56:59.501466 30703 raft_consensus.cc:2243] T b59ebeb3dc294227a54a82a640c798ce P 60d4538b78b44201964cf440ea562c72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:56:59.501674 30703 raft_consensus.cc:2272] T b59ebeb3dc294227a54a82a640c798ce P 60d4538b78b44201964cf440ea562c72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:56:59.503961 30703 ts_tablet_manager.cc:1916] T b59ebeb3dc294227a54a82a640c798ce P 60d4538b78b44201964cf440ea562c72: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:56:59.528184 30703 ts_tablet_manager.cc:1929] T b59ebeb3dc294227a54a82a640c798ce P 60d4538b78b44201964cf440ea562c72: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.387
I20260810 01:56:59.528414 30703 log.cc:1199] T b59ebeb3dc294227a54a82a640c798ce P 60d4538b78b44201964cf440ea562c72: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal/wals/b59ebeb3dc294227a54a82a640c798ce
I20260810 01:56:59.539173 26442 catalog_manager.cc:5050] TS 60d4538b78b44201964cf440ea562c72 (127.21.64.194:36943): tablet b59ebeb3dc294227a54a82a640c798ce (table rebalance_test_table_4 [id=b8ab0a3e55d1493fb5fc271a33432c29]) successfully deleted
I20260810 01:57:00.819383 28916 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:57:00.834021 28379 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:57:00.860002 26806 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260810 01:57:00.984253 28563 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:57:01.000211 26634 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:57:01.045624 26976 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:57:01.177484 28739 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260810 01:57:01.772941 26910 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.196:41095, user_credentials={real_user=slave}} blocked reactor thread for 78310.1us
I20260810 01:57:01.860262 27005 consensus_queue.cc:237] T e8b0ab1f966840f3ade9f44232b39a5a P 56388bef1a0f453cadc8b6aa9434311d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 379, Committed index: 379, Last appended: 1.379, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 380 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } }
I20260810 01:57:01.863001 28410 raft_consensus.cc:1275] T e8b0ab1f966840f3ade9f44232b39a5a P 28812b178f824d539cab11abfe98d77d [term 1 FOLLOWER]: Refusing update from remote peer 56388bef1a0f453cadc8b6aa9434311d: Log matching property violated. Preceding OpId in replica: term: 1 index: 379. Preceding OpId from leader: term: 1 index: 380. (index mismatch)
I20260810 01:57:01.865228 30681 consensus_queue.cc:1048] T e8b0ab1f966840f3ade9f44232b39a5a P 56388bef1a0f453cadc8b6aa9434311d [LEADER]: Connected to new peer: Peer: permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 380, Last known committed idx: 379, Time since last communication: 0.000s
I20260810 01:57:01.869766 30749 raft_consensus.cc:2955] T e8b0ab1f966840f3ade9f44232b39a5a P 56388bef1a0f453cadc8b6aa9434311d [term 1 LEADER]: Committing config change with OpId 1.380: config changed from index 70 to 380, VOTER a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193) evicted. New config: { opid_index: 380 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } } }
I20260810 01:57:01.871865 28410 raft_consensus.cc:2955] T e8b0ab1f966840f3ade9f44232b39a5a P 28812b178f824d539cab11abfe98d77d [term 1 FOLLOWER]: Committing config change with OpId 1.380: config changed from index 70 to 380, VOTER a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193) evicted. New config: { opid_index: 380 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } } }
I20260810 01:57:01.886783 26453 catalog_manager.cc:5719] T e8b0ab1f966840f3ade9f44232b39a5a P 56388bef1a0f453cadc8b6aa9434311d reported cstate change: config changed from index 70 to 380, VOTER a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193) evicted. New cstate: current_term: 1 leader_uuid: "56388bef1a0f453cadc8b6aa9434311d" committed_config { opid_index: 380 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } } }
I20260810 01:57:02.292578 26634 tablet_service.cc:1558] Processing DeleteTablet for tablet e8b0ab1f966840f3ade9f44232b39a5a with delete_type TABLET_DATA_TOMBSTONED (TS a46364d7cd504f8ca7fc003c59ae6d31 not found in new config with opid_index 380) from {username='slave'} at 127.0.0.1:37082
I20260810 01:57:02.334915 30840 tablet_replica.cc:333] T e8b0ab1f966840f3ade9f44232b39a5a P a46364d7cd504f8ca7fc003c59ae6d31: stopping tablet replica
I20260810 01:57:02.335286 30840 raft_consensus.cc:2243] T e8b0ab1f966840f3ade9f44232b39a5a P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:57:02.335654 30840 raft_consensus.cc:2272] T e8b0ab1f966840f3ade9f44232b39a5a P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:57:02.342900 30840 ts_tablet_manager.cc:1916] T e8b0ab1f966840f3ade9f44232b39a5a P a46364d7cd504f8ca7fc003c59ae6d31: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:57:02.385540 30840 ts_tablet_manager.cc:1929] T e8b0ab1f966840f3ade9f44232b39a5a P a46364d7cd504f8ca7fc003c59ae6d31: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.379
I20260810 01:57:02.392796 30840 log.cc:1199] T e8b0ab1f966840f3ade9f44232b39a5a P a46364d7cd504f8ca7fc003c59ae6d31: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/wal/wals/e8b0ab1f966840f3ade9f44232b39a5a
I20260810 01:57:02.396075 26446 catalog_manager.cc:5050] TS a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193:45781): tablet e8b0ab1f966840f3ade9f44232b39a5a (table rebalance_test_table_3 [id=165a82ad66824212a25d38b164e619d1]) successfully deleted
W20260810 01:57:02.488431 26910 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.194:36943, user_credentials={real_user=slave}} blocked reactor thread for 58370.4us
W20260810 01:57:02.588296 26910 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.196:41095, user_credentials={real_user=slave}} blocked reactor thread for 88962us
I20260810 01:57:03.291472 28916 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:57:03.304534 26976 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:57:03.311407 28379 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:57:03.400202 28563 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:57:03.507402 26634 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:57:03.540539 28739 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:57:03.582363 26806 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
W20260810 01:57:04.079344 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.195:45355, user_credentials={real_user=slave}} blocked reactor thread for 101312us
I20260810 01:57:04.534850 26830 consensus_queue.cc:237] T 3c77a4e4068b4dac971c281f5819a5a9 P 60d4538b78b44201964cf440ea562c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 466, Committed index: 466, Last appended: 1.467, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 468 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } }
I20260810 01:57:04.538247 28586 raft_consensus.cc:1275] T 3c77a4e4068b4dac971c281f5819a5a9 P 8be4ab1c5cca41849942448806160d19 [term 1 FOLLOWER]: Refusing update from remote peer 60d4538b78b44201964cf440ea562c72: Log matching property violated. Preceding OpId in replica: term: 1 index: 466. Preceding OpId from leader: term: 1 index: 468. (index mismatch)
I20260810 01:57:04.540213 30718 consensus_queue.cc:1048] T 3c77a4e4068b4dac971c281f5819a5a9 P 60d4538b78b44201964cf440ea562c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 468, Last known committed idx: 466, Time since last communication: 0.000s
I20260810 01:57:04.547483 30387 raft_consensus.cc:2955] T 3c77a4e4068b4dac971c281f5819a5a9 P 60d4538b78b44201964cf440ea562c72 [term 1 LEADER]: Committing config change with OpId 1.468: config changed from index 104 to 468, VOTER a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193) evicted. New config: { opid_index: 468 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } } }
I20260810 01:57:04.548478 28586 raft_consensus.cc:2955] T 3c77a4e4068b4dac971c281f5819a5a9 P 8be4ab1c5cca41849942448806160d19 [term 1 FOLLOWER]: Committing config change with OpId 1.468: config changed from index 104 to 468, VOTER a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193) evicted. New config: { opid_index: 468 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } } }
I20260810 01:57:04.554975 26456 catalog_manager.cc:5719] T 3c77a4e4068b4dac971c281f5819a5a9 P 60d4538b78b44201964cf440ea562c72 reported cstate change: config changed from index 104 to 468, VOTER a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193) evicted. New cstate: current_term: 1 leader_uuid: "60d4538b78b44201964cf440ea562c72" committed_config { opid_index: 468 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } } }
I20260810 01:57:04.887116 26634 tablet_service.cc:1558] Processing DeleteTablet for tablet 3c77a4e4068b4dac971c281f5819a5a9 with delete_type TABLET_DATA_TOMBSTONED (TS a46364d7cd504f8ca7fc003c59ae6d31 not found in new config with opid_index 468) from {username='slave'} at 127.0.0.1:37082
I20260810 01:57:05.048408 30977 tablet_replica.cc:333] T 3c77a4e4068b4dac971c281f5819a5a9 P a46364d7cd504f8ca7fc003c59ae6d31: stopping tablet replica
I20260810 01:57:05.048691 30977 raft_consensus.cc:2243] T 3c77a4e4068b4dac971c281f5819a5a9 P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:57:05.050468 30977 raft_consensus.cc:2272] T 3c77a4e4068b4dac971c281f5819a5a9 P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:57:05.054469 30977 ts_tablet_manager.cc:1916] T 3c77a4e4068b4dac971c281f5819a5a9 P a46364d7cd504f8ca7fc003c59ae6d31: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:57:05.079869 30977 ts_tablet_manager.cc:1929] T 3c77a4e4068b4dac971c281f5819a5a9 P a46364d7cd504f8ca7fc003c59ae6d31: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.466
I20260810 01:57:05.082163 30977 log.cc:1199] T 3c77a4e4068b4dac971c281f5819a5a9 P a46364d7cd504f8ca7fc003c59ae6d31: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/wal/wals/3c77a4e4068b4dac971c281f5819a5a9
I20260810 01:57:05.088303 26446 catalog_manager.cc:5050] TS a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193:45781): tablet 3c77a4e4068b4dac971c281f5819a5a9 (table rebalance_test_table_4 [id=b8ab0a3e55d1493fb5fc271a33432c29]) successfully deleted
W20260810 01:57:05.138015 26910 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.194:36943, user_credentials={real_user=slave}} blocked reactor thread for 59471.6us
W20260810 01:57:06.355016 26574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.197:46107, user_credentials={real_user=slave}} blocked reactor thread for 44274.9us
I20260810 01:57:06.419142 28916 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:57:06.430866 28379 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:57:06.475633 26976 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:57:06.550047 28739 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:57:06.653715 28563 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:57:06.682337 26806 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260810 01:57:06.777122 26634 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:57:07.773685 26658 consensus_queue.cc:237] T 39a14ec9527d43b4a6f78b48ad4165cf P a46364d7cd504f8ca7fc003c59ae6d31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 473, Committed index: 473, Last appended: 1.473, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 474 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } }
I20260810 01:57:07.779646 28582 raft_consensus.cc:1275] T 39a14ec9527d43b4a6f78b48ad4165cf P 8be4ab1c5cca41849942448806160d19 [term 1 FOLLOWER]: Refusing update from remote peer a46364d7cd504f8ca7fc003c59ae6d31: Log matching property violated. Preceding OpId in replica: term: 1 index: 473. Preceding OpId from leader: term: 1 index: 474. (index mismatch)
I20260810 01:57:07.780715 30762 consensus_queue.cc:1048] T 39a14ec9527d43b4a6f78b48ad4165cf P a46364d7cd504f8ca7fc003c59ae6d31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 474, Last known committed idx: 473, Time since last communication: 0.000s
I20260810 01:57:07.786024 31036 raft_consensus.cc:2955] T 39a14ec9527d43b4a6f78b48ad4165cf P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 LEADER]: Committing config change with OpId 1.474: config changed from index 79 to 474, VOTER 60d4538b78b44201964cf440ea562c72 (127.21.64.194) evicted. New config: { opid_index: 474 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } } }
I20260810 01:57:07.788021 28582 raft_consensus.cc:2955] T 39a14ec9527d43b4a6f78b48ad4165cf P 8be4ab1c5cca41849942448806160d19 [term 1 FOLLOWER]: Committing config change with OpId 1.474: config changed from index 79 to 474, VOTER 60d4538b78b44201964cf440ea562c72 (127.21.64.194) evicted. New config: { opid_index: 474 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } } }
I20260810 01:57:07.800416 26453 catalog_manager.cc:5719] T 39a14ec9527d43b4a6f78b48ad4165cf P 8be4ab1c5cca41849942448806160d19 reported cstate change: config changed from index 79 to 474, VOTER 60d4538b78b44201964cf440ea562c72 (127.21.64.194) evicted. New cstate: current_term: 1 leader_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" committed_config { opid_index: 474 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } } }
I20260810 01:57:07.845542 26806 tablet_service.cc:1558] Processing DeleteTablet for tablet 39a14ec9527d43b4a6f78b48ad4165cf with delete_type TABLET_DATA_TOMBSTONED (TS 60d4538b78b44201964cf440ea562c72 not found in new config with opid_index 474) from {username='slave'} at 127.0.0.1:59826
I20260810 01:57:07.868996 31108 tablet_replica.cc:333] T 39a14ec9527d43b4a6f78b48ad4165cf P 60d4538b78b44201964cf440ea562c72: stopping tablet replica
I20260810 01:57:07.869810 31108 raft_consensus.cc:2243] T 39a14ec9527d43b4a6f78b48ad4165cf P 60d4538b78b44201964cf440ea562c72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:57:07.871157 31108 raft_consensus.cc:2272] T 39a14ec9527d43b4a6f78b48ad4165cf P 60d4538b78b44201964cf440ea562c72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:57:07.873011 31108 ts_tablet_manager.cc:1916] T 39a14ec9527d43b4a6f78b48ad4165cf P 60d4538b78b44201964cf440ea562c72: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:57:07.903991 31108 ts_tablet_manager.cc:1929] T 39a14ec9527d43b4a6f78b48ad4165cf P 60d4538b78b44201964cf440ea562c72: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.473
I20260810 01:57:07.904384 31108 log.cc:1199] T 39a14ec9527d43b4a6f78b48ad4165cf P 60d4538b78b44201964cf440ea562c72: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal/wals/39a14ec9527d43b4a6f78b48ad4165cf
I20260810 01:57:07.905819 26442 catalog_manager.cc:5050] TS 60d4538b78b44201964cf440ea562c72 (127.21.64.194:36943): tablet 39a14ec9527d43b4a6f78b48ad4165cf (table rebalance_test_table_2 [id=e4e97ceec9a145e095f04aa5c373d684]) successfully deleted
W20260810 01:57:08.843134 26910 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.197:46107, user_credentials={real_user=slave}} blocked reactor thread for 70383.1us
I20260810 01:57:08.860988 28379 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:57:08.872407 26976 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:57:08.881795 28739 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:57:08.925161 26634 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
W20260810 01:57:08.935380 26910 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.194:36943, user_credentials={real_user=slave}} blocked reactor thread for 71537.2us
I20260810 01:57:09.064200 26806 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260810 01:57:09.130409 28563 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:57:09.274778 28916 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260810 01:57:09.609597 26910 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.197:46107, user_credentials={real_user=slave}} blocked reactor thread for 44980.7us
I20260810 01:57:10.251475 26833 consensus_queue.cc:237] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 690, Committed index: 690, Last appended: 1.690, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 691 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } }
I20260810 01:57:10.255452 28943 raft_consensus.cc:1275] T c72cec0deb794dac95b7a88308c56167 P 07e0a39216984856b2ff8c512c4c2f93 [term 1 FOLLOWER]: Refusing update from remote peer 60d4538b78b44201964cf440ea562c72: Log matching property violated. Preceding OpId in replica: term: 1 index: 690. Preceding OpId from leader: term: 1 index: 691. (index mismatch)
I20260810 01:57:10.257319 30506 consensus_queue.cc:1048] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 691, Last known committed idx: 690, Time since last communication: 0.000s
I20260810 01:57:10.264861 30506 raft_consensus.cc:2955] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72 [term 1 LEADER]: Committing config change with OpId 1.691: config changed from index 79 to 691, VOTER a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193) evicted. New config: { opid_index: 691 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } }
I20260810 01:57:10.265111 28943 raft_consensus.cc:2955] T c72cec0deb794dac95b7a88308c56167 P 07e0a39216984856b2ff8c512c4c2f93 [term 1 FOLLOWER]: Committing config change with OpId 1.691: config changed from index 79 to 691, VOTER a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193) evicted. New config: { opid_index: 691 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } }
I20260810 01:57:10.272320 26456 catalog_manager.cc:5719] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72 reported cstate change: config changed from index 79 to 691, VOTER a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193) evicted. New cstate: current_term: 1 leader_uuid: "60d4538b78b44201964cf440ea562c72" committed_config { opid_index: 691 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } }
I20260810 01:57:10.365954 26634 tablet_service.cc:1558] Processing DeleteTablet for tablet c72cec0deb794dac95b7a88308c56167 with delete_type TABLET_DATA_TOMBSTONED (TS a46364d7cd504f8ca7fc003c59ae6d31 not found in new config with opid_index 691) from {username='slave'} at 127.0.0.1:37082
I20260810 01:57:10.399746 31232 tablet_replica.cc:333] T c72cec0deb794dac95b7a88308c56167 P a46364d7cd504f8ca7fc003c59ae6d31: stopping tablet replica
I20260810 01:57:10.400173 31232 raft_consensus.cc:2243] T c72cec0deb794dac95b7a88308c56167 P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:57:10.400614 31232 raft_consensus.cc:2272] T c72cec0deb794dac95b7a88308c56167 P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:57:10.402328 31232 ts_tablet_manager.cc:1916] T c72cec0deb794dac95b7a88308c56167 P a46364d7cd504f8ca7fc003c59ae6d31: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:57:10.415318 31232 ts_tablet_manager.cc:1929] T c72cec0deb794dac95b7a88308c56167 P a46364d7cd504f8ca7fc003c59ae6d31: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.690
I20260810 01:57:10.415813 31232 log.cc:1199] T c72cec0deb794dac95b7a88308c56167 P a46364d7cd504f8ca7fc003c59ae6d31: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/wal/wals/c72cec0deb794dac95b7a88308c56167
I20260810 01:57:10.417248 26446 catalog_manager.cc:5050] TS a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193:45781): tablet c72cec0deb794dac95b7a88308c56167 (table rebalance_test_table_0 [id=52f00827f2964d63b49607d8194867d6]) successfully deleted
I20260810 01:57:11.114818 28916 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:57:11.142545 26976 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:57:11.148578 28379 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:57:11.166635 28563 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:57:11.174780 28739 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:57:11.189821 26806 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260810 01:57:11.203194 26634 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
W20260810 01:57:11.807472 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.195:45355, user_credentials={real_user=slave}} blocked reactor thread for 80446.1us
I20260810 01:57:12.085361 26658 consensus_queue.cc:237] T 059177b44a51490f9765e20391967605 P a46364d7cd504f8ca7fc003c59ae6d31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 553, Committed index: 553, Last appended: 1.553, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 554 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } }
I20260810 01:57:12.095027 28768 raft_consensus.cc:1275] T 059177b44a51490f9765e20391967605 P 9353b63b4d854d23b51a8103bc899aab [term 1 FOLLOWER]: Refusing update from remote peer a46364d7cd504f8ca7fc003c59ae6d31: Log matching property violated. Preceding OpId in replica: term: 1 index: 553. Preceding OpId from leader: term: 1 index: 554. (index mismatch)
I20260810 01:57:12.096287 31036 consensus_queue.cc:1048] T 059177b44a51490f9765e20391967605 P a46364d7cd504f8ca7fc003c59ae6d31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 554, Last known committed idx: 553, Time since last communication: 0.000s
I20260810 01:57:12.104640 31036 raft_consensus.cc:2955] T 059177b44a51490f9765e20391967605 P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 LEADER]: Committing config change with OpId 1.554: config changed from index 66 to 554, VOTER 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195) evicted. New config: { opid_index: 554 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } } }
I20260810 01:57:12.109845 28767 raft_consensus.cc:2955] T 059177b44a51490f9765e20391967605 P 9353b63b4d854d23b51a8103bc899aab [term 1 FOLLOWER]: Committing config change with OpId 1.554: config changed from index 66 to 554, VOTER 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195) evicted. New config: { opid_index: 554 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } } }
I20260810 01:57:12.115290 26456 catalog_manager.cc:5719] T 059177b44a51490f9765e20391967605 P a46364d7cd504f8ca7fc003c59ae6d31 reported cstate change: config changed from index 66 to 554, VOTER 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195) evicted. New cstate: current_term: 1 leader_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" committed_config { opid_index: 554 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } } }
I20260810 01:57:12.270025 26976 tablet_service.cc:1558] Processing DeleteTablet for tablet 059177b44a51490f9765e20391967605 with delete_type TABLET_DATA_TOMBSTONED (TS 56388bef1a0f453cadc8b6aa9434311d not found in new config with opid_index 554) from {username='slave'} at 127.0.0.1:39126
I20260810 01:57:12.271566 31340 tablet_replica.cc:333] T 059177b44a51490f9765e20391967605 P 56388bef1a0f453cadc8b6aa9434311d: stopping tablet replica
I20260810 01:57:12.271821 31340 raft_consensus.cc:2243] T 059177b44a51490f9765e20391967605 P 56388bef1a0f453cadc8b6aa9434311d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:57:12.272272 31340 raft_consensus.cc:2272] T 059177b44a51490f9765e20391967605 P 56388bef1a0f453cadc8b6aa9434311d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:57:12.284657 31340 ts_tablet_manager.cc:1916] T 059177b44a51490f9765e20391967605 P 56388bef1a0f453cadc8b6aa9434311d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:57:12.321420 31340 ts_tablet_manager.cc:1929] T 059177b44a51490f9765e20391967605 P 56388bef1a0f453cadc8b6aa9434311d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.553
I20260810 01:57:12.321559 31340 log.cc:1199] T 059177b44a51490f9765e20391967605 P 56388bef1a0f453cadc8b6aa9434311d: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/wal/wals/059177b44a51490f9765e20391967605
I20260810 01:57:12.322641 26445 catalog_manager.cc:5050] TS 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195:45355): tablet 059177b44a51490f9765e20391967605 (table rebalance_test_table_3 [id=165a82ad66824212a25d38b164e619d1]) successfully deleted
I20260810 01:57:13.163759 28916 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:57:13.188911 26976 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:57:13.205790 26806 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260810 01:57:13.370877 28379 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:57:13.522346 26634 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:57:13.606695 28563 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:57:13.794165 28739 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:57:14.373739 26658 consensus_queue.cc:237] T fdf1cc811a8349efa251d05e9b077fad P a46364d7cd504f8ca7fc003c59ae6d31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 597, Committed index: 597, Last appended: 1.597, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 598 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } }
I20260810 01:57:14.378508 28407 raft_consensus.cc:1275] T fdf1cc811a8349efa251d05e9b077fad P 28812b178f824d539cab11abfe98d77d [term 1 FOLLOWER]: Refusing update from remote peer a46364d7cd504f8ca7fc003c59ae6d31: Log matching property violated. Preceding OpId in replica: term: 1 index: 597. Preceding OpId from leader: term: 1 index: 598. (index mismatch)
I20260810 01:57:14.382022 31453 consensus_queue.cc:1048] T fdf1cc811a8349efa251d05e9b077fad P a46364d7cd504f8ca7fc003c59ae6d31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 598, Last known committed idx: 597, Time since last communication: 0.000s
I20260810 01:57:14.384879 31453 raft_consensus.cc:2955] T fdf1cc811a8349efa251d05e9b077fad P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 LEADER]: Committing config change with OpId 1.598: config changed from index 116 to 598, VOTER 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195) evicted. New config: { opid_index: 598 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } } }
I20260810 01:57:14.392155 28407 raft_consensus.cc:2955] T fdf1cc811a8349efa251d05e9b077fad P 28812b178f824d539cab11abfe98d77d [term 1 FOLLOWER]: Committing config change with OpId 1.598: config changed from index 116 to 598, VOTER 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195) evicted. New config: { opid_index: 598 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } } }
I20260810 01:57:14.406111 26470 catalog_manager.cc:5719] T fdf1cc811a8349efa251d05e9b077fad P a46364d7cd504f8ca7fc003c59ae6d31 reported cstate change: config changed from index 116 to 598, VOTER 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195) evicted. New cstate: current_term: 1 leader_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" committed_config { opid_index: 598 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } } }
I20260810 01:57:14.482663 26976 tablet_service.cc:1558] Processing DeleteTablet for tablet fdf1cc811a8349efa251d05e9b077fad with delete_type TABLET_DATA_TOMBSTONED (TS 56388bef1a0f453cadc8b6aa9434311d not found in new config with opid_index 598) from {username='slave'} at 127.0.0.1:39126
I20260810 01:57:14.523201 31466 tablet_replica.cc:333] T fdf1cc811a8349efa251d05e9b077fad P 56388bef1a0f453cadc8b6aa9434311d: stopping tablet replica
I20260810 01:57:14.525290 31466 raft_consensus.cc:2243] T fdf1cc811a8349efa251d05e9b077fad P 56388bef1a0f453cadc8b6aa9434311d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:57:14.525638 31466 raft_consensus.cc:2272] T fdf1cc811a8349efa251d05e9b077fad P 56388bef1a0f453cadc8b6aa9434311d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:57:14.529266 31466 ts_tablet_manager.cc:1916] T fdf1cc811a8349efa251d05e9b077fad P 56388bef1a0f453cadc8b6aa9434311d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:57:14.581449 31466 ts_tablet_manager.cc:1929] T fdf1cc811a8349efa251d05e9b077fad P 56388bef1a0f453cadc8b6aa9434311d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.597
I20260810 01:57:14.583161 31466 log.cc:1199] T fdf1cc811a8349efa251d05e9b077fad P 56388bef1a0f453cadc8b6aa9434311d: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/wal/wals/fdf1cc811a8349efa251d05e9b077fad
I20260810 01:57:14.587939 26445 catalog_manager.cc:5050] TS 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195:45355): tablet fdf1cc811a8349efa251d05e9b077fad (table rebalance_test_table_1 [id=bdbf5b2bb6b04aa9baa11723c241453d]) successfully deleted
I20260810 01:57:15.743901 28379 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:57:15.757745 28916 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:57:15.778613 26806 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260810 01:57:15.783821 28563 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:57:15.798570 28739 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:57:15.804559 26976 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:57:15.926208 26634 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:57:16.257417 26833 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4403a36d26db47278a82abb5df118bbd"
dest_uuid: "60d4538b78b44201964cf440ea562c72"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:45882
I20260810 01:57:16.257651 26833 raft_consensus.cc:606] T 4403a36d26db47278a82abb5df118bbd P 60d4538b78b44201964cf440ea562c72 [term 1 LEADER]: Received request to transfer leadership
W20260810 01:57:16.285386 26771 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50978: Service unavailable: leader transfer in progress
W20260810 01:57:16.291501 26771 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50978: Service unavailable: leader transfer in progress
W20260810 01:57:16.301270 26771 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50978: Service unavailable: leader transfer in progress
W20260810 01:57:16.308825 26771 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50978: Service unavailable: leader transfer in progress
W20260810 01:57:16.322712 26772 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50978: Service unavailable: leader transfer in progress
W20260810 01:57:16.334967 26772 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50978: Service unavailable: leader transfer in progress
W20260810 01:57:16.344852 26772 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50978: Service unavailable: leader transfer in progress
W20260810 01:57:16.373895 26772 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50978: Service unavailable: leader transfer in progress
W20260810 01:57:16.389082 26772 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50978: Service unavailable: leader transfer in progress
W20260810 01:57:16.409926 26771 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50978: Service unavailable: leader transfer in progress
W20260810 01:57:16.436401 26772 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50978: Service unavailable: leader transfer in progress
W20260810 01:57:16.453176 26772 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50978: Service unavailable: leader transfer in progress
W20260810 01:57:16.468838 26772 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50978: Service unavailable: leader transfer in progress
W20260810 01:57:16.494088 26775 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50978: Service unavailable: leader transfer in progress
W20260810 01:57:16.514259 26775 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50978: Service unavailable: leader transfer in progress
W20260810 01:57:16.536737 26775 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50978: Service unavailable: leader transfer in progress
W20260810 01:57:16.556452 26775 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50978: Service unavailable: leader transfer in progress
W20260810 01:57:16.577749 26775 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50978: Service unavailable: leader transfer in progress
W20260810 01:57:16.598821 26775 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50978: Service unavailable: leader transfer in progress
I20260810 01:57:16.620570 31053 raft_consensus.cc:993] T 4403a36d26db47278a82abb5df118bbd P 60d4538b78b44201964cf440ea562c72: : Instructing follower 28812b178f824d539cab11abfe98d77d to start an election
I20260810 01:57:16.620752 31053 raft_consensus.cc:1081] T 4403a36d26db47278a82abb5df118bbd P 60d4538b78b44201964cf440ea562c72 [term 1 LEADER]: Signalling peer 28812b178f824d539cab11abfe98d77d to start an election
W20260810 01:57:16.624179 26775 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50978: Service unavailable: leader transfer in progress
I20260810 01:57:16.625613 28410 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4403a36d26db47278a82abb5df118bbd"
dest_uuid: "28812b178f824d539cab11abfe98d77d"
from {username='slave'} at 127.21.64.194:42003
W20260810 01:57:16.650177 26775 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50978: Service unavailable: leader transfer in progress
I20260810 01:57:16.651851 28410 raft_consensus.cc:493] T 4403a36d26db47278a82abb5df118bbd P 28812b178f824d539cab11abfe98d77d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260810 01:57:16.652971 28410 raft_consensus.cc:3060] T 4403a36d26db47278a82abb5df118bbd P 28812b178f824d539cab11abfe98d77d [term 1 FOLLOWER]: Advancing to term 2
W20260810 01:57:16.674341 26775 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50978: Service unavailable: leader transfer in progress
I20260810 01:57:16.694802 28410 raft_consensus.cc:515] T 4403a36d26db47278a82abb5df118bbd P 28812b178f824d539cab11abfe98d77d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 143 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } }
W20260810 01:57:16.703779 26775 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50978: Service unavailable: leader transfer in progress
W20260810 01:57:16.734661 26775 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50978: Service unavailable: leader transfer in progress
W20260810 01:57:16.764034 26775 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50978: Service unavailable: leader transfer in progress
I20260810 01:57:16.764745 28410 leader_election.cc:290] T 4403a36d26db47278a82abb5df118bbd P 28812b178f824d539cab11abfe98d77d [CANDIDATE]: Term 2 election: Requested vote from peers 60d4538b78b44201964cf440ea562c72 (127.21.64.194:36943), a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193:45781)
I20260810 01:57:16.774762 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4403a36d26db47278a82abb5df118bbd" candidate_uuid: "28812b178f824d539cab11abfe98d77d" candidate_term: 2 candidate_status { last_received { term: 1 index: 829 } } ignore_live_leader: true dest_uuid: "a46364d7cd504f8ca7fc003c59ae6d31"
I20260810 01:57:16.774987 26658 raft_consensus.cc:3060] T 4403a36d26db47278a82abb5df118bbd P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 FOLLOWER]: Advancing to term 2
I20260810 01:57:16.777757 26828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4403a36d26db47278a82abb5df118bbd" candidate_uuid: "28812b178f824d539cab11abfe98d77d" candidate_term: 2 candidate_status { last_received { term: 1 index: 829 } } ignore_live_leader: true dest_uuid: "60d4538b78b44201964cf440ea562c72"
I20260810 01:57:16.777971 26828 raft_consensus.cc:3055] T 4403a36d26db47278a82abb5df118bbd P 60d4538b78b44201964cf440ea562c72 [term 1 LEADER]: Stepping down as leader of term 1
I20260810 01:57:16.778049 26828 raft_consensus.cc:740] T 4403a36d26db47278a82abb5df118bbd P 60d4538b78b44201964cf440ea562c72 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 60d4538b78b44201964cf440ea562c72, State: Running, Role: LEADER
I20260810 01:57:16.778380 26828 consensus_queue.cc:260] T 4403a36d26db47278a82abb5df118bbd P 60d4538b78b44201964cf440ea562c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 829, Committed index: 829, Last appended: 1.829, Last appended by leader: 829, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 143 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } }
I20260810 01:57:16.778803 26828 raft_consensus.cc:3060] T 4403a36d26db47278a82abb5df118bbd P 60d4538b78b44201964cf440ea562c72 [term 1 FOLLOWER]: Advancing to term 2
I20260810 01:57:16.779199 26658 raft_consensus.cc:2468] T 4403a36d26db47278a82abb5df118bbd P a46364d7cd504f8ca7fc003c59ae6d31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28812b178f824d539cab11abfe98d77d in term 2.
I20260810 01:57:16.782358 28317 leader_election.cc:304] T 4403a36d26db47278a82abb5df118bbd P 28812b178f824d539cab11abfe98d77d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28812b178f824d539cab11abfe98d77d, a46364d7cd504f8ca7fc003c59ae6d31; no voters:
I20260810 01:57:16.785141 26828 raft_consensus.cc:2468] T 4403a36d26db47278a82abb5df118bbd P 60d4538b78b44201964cf440ea562c72 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28812b178f824d539cab11abfe98d77d in term 2.
W20260810 01:57:16.791960 26775 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50978: Illegal state: replica 60d4538b78b44201964cf440ea562c72 is not leader of this config: current role FOLLOWER
W20260810 01:57:16.827188 28317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.64.193:45781, user_credentials={real_user=slave}} blocked reactor thread for 45023.7us
I20260810 01:57:16.837203 31599 raft_consensus.cc:2804] T 4403a36d26db47278a82abb5df118bbd P 28812b178f824d539cab11abfe98d77d [term 2 FOLLOWER]: Leader election won for term 2
I20260810 01:57:16.958873 31599 raft_consensus.cc:697] T 4403a36d26db47278a82abb5df118bbd P 28812b178f824d539cab11abfe98d77d [term 2 LEADER]: Becoming Leader. State: Replica: 28812b178f824d539cab11abfe98d77d, State: Running, Role: LEADER
I20260810 01:57:16.960673 31599 consensus_queue.cc:237] T 4403a36d26db47278a82abb5df118bbd P 28812b178f824d539cab11abfe98d77d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 829, Committed index: 829, Last appended: 1.829, Last appended by leader: 829, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 143 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } }
I20260810 01:57:16.966835 26470 catalog_manager.cc:5719] T 4403a36d26db47278a82abb5df118bbd P 28812b178f824d539cab11abfe98d77d reported cstate change: term changed from 1 to 2, leader changed from 60d4538b78b44201964cf440ea562c72 (127.21.64.194) to 28812b178f824d539cab11abfe98d77d (127.21.64.196). New cstate: current_term: 2 leader_uuid: "28812b178f824d539cab11abfe98d77d" committed_config { opid_index: 143 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } } }
W20260810 01:57:16.979025 26607 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35566: Illegal state: replica a46364d7cd504f8ca7fc003c59ae6d31 is not leader of this config: current role FOLLOWER
I20260810 01:57:17.065059 26658 raft_consensus.cc:1275] T 4403a36d26db47278a82abb5df118bbd P a46364d7cd504f8ca7fc003c59ae6d31 [term 2 FOLLOWER]: Refusing update from remote peer 28812b178f824d539cab11abfe98d77d: Log matching property violated. Preceding OpId in replica: term: 1 index: 829. Preceding OpId from leader: term: 2 index: 831. (index mismatch)
I20260810 01:57:17.066160 31605 consensus_queue.cc:1048] T 4403a36d26db47278a82abb5df118bbd P 28812b178f824d539cab11abfe98d77d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 830, Last known committed idx: 829, Time since last communication: 0.001s
I20260810 01:57:17.067111 26833 raft_consensus.cc:1275] T 4403a36d26db47278a82abb5df118bbd P 60d4538b78b44201964cf440ea562c72 [term 2 FOLLOWER]: Refusing update from remote peer 28812b178f824d539cab11abfe98d77d: Log matching property violated. Preceding OpId in replica: term: 1 index: 829. Preceding OpId from leader: term: 2 index: 831. (index mismatch)
I20260810 01:57:17.068011 31605 consensus_queue.cc:1048] T 4403a36d26db47278a82abb5df118bbd P 28812b178f824d539cab11abfe98d77d [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 830, Last known committed idx: 829, Time since last communication: 0.000s
I20260810 01:57:17.079697 31561 mvcc.cc:204] Tried to move back new op lower bound from 7316795543800958976 to 7316795543402029056. Current Snapshot: MvccSnapshot[applied={T|T < 7316795543800958976}]
I20260810 01:57:17.081529 31451 mvcc.cc:204] Tried to move back new op lower bound from 7316795543800958976 to 7316795543402029056. Current Snapshot: MvccSnapshot[applied={T|T < 7316795543800958976}]
I20260810 01:57:17.179196 28916 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:57:17.227069 26976 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:57:17.253728 26634 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:57:17.313189 28739 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:57:17.478338 28379 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:57:17.505801 28563 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:57:17.578609 26806 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:57:21.147095 28916 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:57:21.185781 28379 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:57:21.225178 26976 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:57:21.262106 28563 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:57:21.267838 26634 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:57:21.389710 26806 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:57:21.455323 28739 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260810 01:57:21.609293 26744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.199:42747, user_credentials={real_user=slave}} blocked reactor thread for 88420us
W20260810 01:57:21.625793 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.197:46107, user_credentials={real_user=slave}} blocked reactor thread for 99556.6us
I20260810 01:57:22.051684 28407 consensus_queue.cc:237] T 4403a36d26db47278a82abb5df118bbd P 28812b178f824d539cab11abfe98d77d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 907, Committed index: 907, Last appended: 2.907, Last appended by leader: 829, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 908 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } }
I20260810 01:57:22.054103 26658 raft_consensus.cc:1275] T 4403a36d26db47278a82abb5df118bbd P a46364d7cd504f8ca7fc003c59ae6d31 [term 2 FOLLOWER]: Refusing update from remote peer 28812b178f824d539cab11abfe98d77d: Log matching property violated. Preceding OpId in replica: term: 2 index: 907. Preceding OpId from leader: term: 2 index: 908. (index mismatch)
I20260810 01:57:22.055231 31762 consensus_queue.cc:1048] T 4403a36d26db47278a82abb5df118bbd P 28812b178f824d539cab11abfe98d77d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 908, Last known committed idx: 907, Time since last communication: 0.000s
I20260810 01:57:22.112828 31899 raft_consensus.cc:2955] T 4403a36d26db47278a82abb5df118bbd P 28812b178f824d539cab11abfe98d77d [term 2 LEADER]: Committing config change with OpId 2.908: config changed from index 143 to 908, VOTER 60d4538b78b44201964cf440ea562c72 (127.21.64.194) evicted. New config: { opid_index: 908 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } } }
I20260810 01:57:22.115386 26658 raft_consensus.cc:2955] T 4403a36d26db47278a82abb5df118bbd P a46364d7cd504f8ca7fc003c59ae6d31 [term 2 FOLLOWER]: Committing config change with OpId 2.908: config changed from index 143 to 908, VOTER 60d4538b78b44201964cf440ea562c72 (127.21.64.194) evicted. New config: { opid_index: 908 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } } }
I20260810 01:57:22.130475 26453 catalog_manager.cc:5719] T 4403a36d26db47278a82abb5df118bbd P a46364d7cd504f8ca7fc003c59ae6d31 reported cstate change: config changed from index 143 to 908, VOTER 60d4538b78b44201964cf440ea562c72 (127.21.64.194) evicted. New cstate: current_term: 2 leader_uuid: "28812b178f824d539cab11abfe98d77d" committed_config { opid_index: 908 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } } }
I20260810 01:57:22.186373 26806 tablet_service.cc:1558] Processing DeleteTablet for tablet 4403a36d26db47278a82abb5df118bbd with delete_type TABLET_DATA_TOMBSTONED (TS 60d4538b78b44201964cf440ea562c72 not found in new config with opid_index 908) from {username='slave'} at 127.0.0.1:59826
I20260810 01:57:22.188311 31908 tablet_replica.cc:333] T 4403a36d26db47278a82abb5df118bbd P 60d4538b78b44201964cf440ea562c72: stopping tablet replica
I20260810 01:57:22.188741 31908 raft_consensus.cc:2243] T 4403a36d26db47278a82abb5df118bbd P 60d4538b78b44201964cf440ea562c72 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260810 01:57:22.189560 31908 raft_consensus.cc:2272] T 4403a36d26db47278a82abb5df118bbd P 60d4538b78b44201964cf440ea562c72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260810 01:57:22.199563 31908 ts_tablet_manager.cc:1916] T 4403a36d26db47278a82abb5df118bbd P 60d4538b78b44201964cf440ea562c72: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:57:22.218641 31908 ts_tablet_manager.cc:1929] T 4403a36d26db47278a82abb5df118bbd P 60d4538b78b44201964cf440ea562c72: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.907
I20260810 01:57:22.219003 31908 log.cc:1199] T 4403a36d26db47278a82abb5df118bbd P 60d4538b78b44201964cf440ea562c72: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal/wals/4403a36d26db47278a82abb5df118bbd
I20260810 01:57:22.224692 26442 catalog_manager.cc:5050] TS 60d4538b78b44201964cf440ea562c72 (127.21.64.194:36943): tablet 4403a36d26db47278a82abb5df118bbd (table rebalance_test_table_0 [id=52f00827f2964d63b49607d8194867d6]) successfully deleted
I20260810 01:57:23.538175 28916 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:57:23.548065 26976 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:57:23.562875 26806 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:57:23.574035 28379 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
W20260810 01:57:23.614923 26910 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.194:36943, user_credentials={real_user=slave}} blocked reactor thread for 76882.7us
I20260810 01:57:23.675218 28563 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:57:23.762080 28739 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:57:23.991709 26634 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:57:24.823511 26828 consensus_queue.cc:237] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 794, Committed index: 794, Last appended: 1.794, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 795 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } }
I20260810 01:57:24.827709 28409 raft_consensus.cc:1275] T 4f7860cf1d8449fc9f062f3e09e4aafd P 28812b178f824d539cab11abfe98d77d [term 1 FOLLOWER]: Refusing update from remote peer 60d4538b78b44201964cf440ea562c72: Log matching property violated. Preceding OpId in replica: term: 1 index: 794. Preceding OpId from leader: term: 1 index: 795. (index mismatch)
I20260810 01:57:24.828914 31674 consensus_queue.cc:1048] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 795, Last known committed idx: 794, Time since last communication: 0.000s
I20260810 01:57:24.832078 31674 raft_consensus.cc:2955] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72 [term 1 LEADER]: Committing config change with OpId 1.795: config changed from index 182 to 795, VOTER 9353b63b4d854d23b51a8103bc899aab (127.21.64.198) added. New config: { opid_index: 795 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } } }
I20260810 01:57:24.836423 28409 raft_consensus.cc:2955] T 4f7860cf1d8449fc9f062f3e09e4aafd P 28812b178f824d539cab11abfe98d77d [term 1 FOLLOWER]: Committing config change with OpId 1.795: config changed from index 182 to 795, VOTER 9353b63b4d854d23b51a8103bc899aab (127.21.64.198) added. New config: { opid_index: 795 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } } }
W20260810 01:57:24.838446 26745 consensus_peers.cc:597] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72 -> Peer 9353b63b4d854d23b51a8103bc899aab (127.21.64.198:41745): Couldn't send request to peer 9353b63b4d854d23b51a8103bc899aab. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4f7860cf1d8449fc9f062f3e09e4aafd. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:57:24.850315 26456 catalog_manager.cc:5719] T 4f7860cf1d8449fc9f062f3e09e4aafd P 28812b178f824d539cab11abfe98d77d reported cstate change: config changed from index 182 to 795, VOTER 9353b63b4d854d23b51a8103bc899aab (127.21.64.198) added. New cstate: current_term: 1 leader_uuid: "60d4538b78b44201964cf440ea562c72" committed_config { opid_index: 795 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } } }
I20260810 01:57:25.201047 27004 consensus_queue.cc:237] T d771b2d03cb940018a706ecc38f68a9e P 56388bef1a0f453cadc8b6aa9434311d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 701, Committed index: 701, Last appended: 1.701, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 702 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } }
I20260810 01:57:25.208700 26828 raft_consensus.cc:1275] T d771b2d03cb940018a706ecc38f68a9e P 60d4538b78b44201964cf440ea562c72 [term 1 FOLLOWER]: Refusing update from remote peer 56388bef1a0f453cadc8b6aa9434311d: Log matching property violated. Preceding OpId in replica: term: 1 index: 701. Preceding OpId from leader: term: 1 index: 702. (index mismatch)
I20260810 01:57:25.217871 31855 consensus_queue.cc:1048] T d771b2d03cb940018a706ecc38f68a9e P 56388bef1a0f453cadc8b6aa9434311d [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 702, Last known committed idx: 701, Time since last communication: 0.000s
I20260810 01:57:25.227217 31718 raft_consensus.cc:2955] T d771b2d03cb940018a706ecc38f68a9e P 56388bef1a0f453cadc8b6aa9434311d [term 1 LEADER]: Committing config change with OpId 1.702: config changed from index -1 to 702, VOTER 07e0a39216984856b2ff8c512c4c2f93 (127.21.64.199) added. New config: { opid_index: 702 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } }
I20260810 01:57:25.234436 26830 raft_consensus.cc:2955] T d771b2d03cb940018a706ecc38f68a9e P 60d4538b78b44201964cf440ea562c72 [term 1 FOLLOWER]: Committing config change with OpId 1.702: config changed from index -1 to 702, VOTER 07e0a39216984856b2ff8c512c4c2f93 (127.21.64.199) added. New config: { opid_index: 702 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } }
I20260810 01:57:25.243913 26453 catalog_manager.cc:5719] T d771b2d03cb940018a706ecc38f68a9e P 56388bef1a0f453cadc8b6aa9434311d reported cstate change: config changed from index -1 to 702, VOTER 07e0a39216984856b2ff8c512c4c2f93 (127.21.64.199) added. New cstate: current_term: 1 leader_uuid: "56388bef1a0f453cadc8b6aa9434311d" committed_config { opid_index: 702 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } }
W20260810 01:57:25.299993 26913 consensus_peers.cc:597] T d771b2d03cb940018a706ecc38f68a9e P 56388bef1a0f453cadc8b6aa9434311d -> Peer 07e0a39216984856b2ff8c512c4c2f93 (127.21.64.199:42747): Couldn't send request to peer 07e0a39216984856b2ff8c512c4c2f93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d771b2d03cb940018a706ecc38f68a9e. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:57:25.361850 32062 ts_tablet_manager.cc:933] T 4f7860cf1d8449fc9f062f3e09e4aafd P 9353b63b4d854d23b51a8103bc899aab: Initiating tablet copy from peer 60d4538b78b44201964cf440ea562c72 (127.21.64.194:36943)
I20260810 01:57:25.381624 32062 tablet_copy_client.cc:323] T 4f7860cf1d8449fc9f062f3e09e4aafd P 9353b63b4d854d23b51a8103bc899aab: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.194:36943
I20260810 01:57:25.384212 26856 tablet_copy_service.cc:140] P 60d4538b78b44201964cf440ea562c72: Received BeginTabletCopySession request for tablet 4f7860cf1d8449fc9f062f3e09e4aafd from peer 9353b63b4d854d23b51a8103bc899aab ({username='slave'} at 127.21.64.198:48223)
I20260810 01:57:25.384485 26856 tablet_copy_service.cc:161] P 60d4538b78b44201964cf440ea562c72: Beginning new tablet copy session on tablet 4f7860cf1d8449fc9f062f3e09e4aafd from peer 9353b63b4d854d23b51a8103bc899aab at {username='slave'} at 127.21.64.198:48223: session id = 9353b63b4d854d23b51a8103bc899aab-4f7860cf1d8449fc9f062f3e09e4aafd
I20260810 01:57:25.388121 26856 tablet_copy_source_session.cc:215] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:57:25.407277 32062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f7860cf1d8449fc9f062f3e09e4aafd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:57:25.480588 32062 tablet_copy_client.cc:806] T 4f7860cf1d8449fc9f062f3e09e4aafd P 9353b63b4d854d23b51a8103bc899aab: tablet copy: Starting download of 0 data blocks...
I20260810 01:57:25.481432 32062 tablet_copy_client.cc:670] T 4f7860cf1d8449fc9f062f3e09e4aafd P 9353b63b4d854d23b51a8103bc899aab: tablet copy: Starting download of 1 WAL segments...
W20260810 01:57:25.583348 26910 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.197:46107, user_credentials={real_user=slave}} blocked reactor thread for 73005.4us
I20260810 01:57:25.612124 32062 tablet_copy_client.cc:538] T 4f7860cf1d8449fc9f062f3e09e4aafd P 9353b63b4d854d23b51a8103bc899aab: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:57:25.618276 32062 tablet_bootstrap.cc:492] T 4f7860cf1d8449fc9f062f3e09e4aafd P 9353b63b4d854d23b51a8103bc899aab: Bootstrap starting.
W20260810 01:57:25.671100 26910 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.196:41095, user_credentials={real_user=slave}} blocked reactor thread for 43871us
I20260810 01:57:25.730197 32069 ts_tablet_manager.cc:933] T d771b2d03cb940018a706ecc38f68a9e P 07e0a39216984856b2ff8c512c4c2f93: Initiating tablet copy from peer 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195:45355)
I20260810 01:57:25.742940 32069 tablet_copy_client.cc:323] T d771b2d03cb940018a706ecc38f68a9e P 07e0a39216984856b2ff8c512c4c2f93: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.195:45355
I20260810 01:57:25.839953 28410 consensus_queue.cc:237] T 4403a36d26db47278a82abb5df118bbd P 28812b178f824d539cab11abfe98d77d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 977, Committed index: 977, Last appended: 2.977, Last appended by leader: 829, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 978 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } }
I20260810 01:57:25.863909 26658 raft_consensus.cc:1275] T 4403a36d26db47278a82abb5df118bbd P a46364d7cd504f8ca7fc003c59ae6d31 [term 2 FOLLOWER]: Refusing update from remote peer 28812b178f824d539cab11abfe98d77d: Log matching property violated. Preceding OpId in replica: term: 2 index: 977. Preceding OpId from leader: term: 2 index: 978. (index mismatch)
I20260810 01:57:25.872900 31762 consensus_queue.cc:1048] T 4403a36d26db47278a82abb5df118bbd P 28812b178f824d539cab11abfe98d77d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 978, Last known committed idx: 977, Time since last communication: 0.000s
W20260810 01:57:25.876446 28317 consensus_peers.cc:597] T 4403a36d26db47278a82abb5df118bbd P 28812b178f824d539cab11abfe98d77d -> Peer 9353b63b4d854d23b51a8103bc899aab (127.21.64.198:41745): Couldn't send request to peer 9353b63b4d854d23b51a8103bc899aab. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4403a36d26db47278a82abb5df118bbd. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:57:25.890679 32042 raft_consensus.cc:2955] T 4403a36d26db47278a82abb5df118bbd P 28812b178f824d539cab11abfe98d77d [term 2 LEADER]: Committing config change with OpId 2.978: config changed from index 908 to 978, VOTER 9353b63b4d854d23b51a8103bc899aab (127.21.64.198) added. New config: { opid_index: 978 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } } }
I20260810 01:57:25.900679 26453 catalog_manager.cc:5719] T 4403a36d26db47278a82abb5df118bbd P 28812b178f824d539cab11abfe98d77d reported cstate change: config changed from index 908 to 978, VOTER 9353b63b4d854d23b51a8103bc899aab (127.21.64.198) added. New cstate: current_term: 2 leader_uuid: "28812b178f824d539cab11abfe98d77d" committed_config { opid_index: 978 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } } }
I20260810 01:57:25.902391 26658 raft_consensus.cc:2955] T 4403a36d26db47278a82abb5df118bbd P a46364d7cd504f8ca7fc003c59ae6d31 [term 2 FOLLOWER]: Committing config change with OpId 2.978: config changed from index 908 to 978, VOTER 9353b63b4d854d23b51a8103bc899aab (127.21.64.198) added. New config: { opid_index: 978 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } } }
I20260810 01:57:25.971429 27035 tablet_copy_service.cc:140] P 56388bef1a0f453cadc8b6aa9434311d: Received BeginTabletCopySession request for tablet d771b2d03cb940018a706ecc38f68a9e from peer 07e0a39216984856b2ff8c512c4c2f93 ({username='slave'} at 127.21.64.199:43465)
I20260810 01:57:25.971632 27035 tablet_copy_service.cc:161] P 56388bef1a0f453cadc8b6aa9434311d: Beginning new tablet copy session on tablet d771b2d03cb940018a706ecc38f68a9e from peer 07e0a39216984856b2ff8c512c4c2f93 at {username='slave'} at 127.21.64.199:43465: session id = 07e0a39216984856b2ff8c512c4c2f93-d771b2d03cb940018a706ecc38f68a9e
I20260810 01:57:25.975606 27035 tablet_copy_source_session.cc:215] T d771b2d03cb940018a706ecc38f68a9e P 56388bef1a0f453cadc8b6aa9434311d: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:57:25.978315 32069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d771b2d03cb940018a706ecc38f68a9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:57:25.993848 32069 tablet_copy_client.cc:806] T d771b2d03cb940018a706ecc38f68a9e P 07e0a39216984856b2ff8c512c4c2f93: tablet copy: Starting download of 0 data blocks...
I20260810 01:57:25.994334 32069 tablet_copy_client.cc:670] T d771b2d03cb940018a706ecc38f68a9e P 07e0a39216984856b2ff8c512c4c2f93: tablet copy: Starting download of 1 WAL segments...
I20260810 01:57:26.031319 32069 tablet_copy_client.cc:538] T d771b2d03cb940018a706ecc38f68a9e P 07e0a39216984856b2ff8c512c4c2f93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:57:26.038360 32069 tablet_bootstrap.cc:492] T d771b2d03cb940018a706ecc38f68a9e P 07e0a39216984856b2ff8c512c4c2f93: Bootstrap starting.
I20260810 01:57:26.306172 32106 ts_tablet_manager.cc:933] T 4403a36d26db47278a82abb5df118bbd P 9353b63b4d854d23b51a8103bc899aab: Initiating tablet copy from peer 28812b178f824d539cab11abfe98d77d (127.21.64.196:41095)
I20260810 01:57:26.392488 32106 tablet_copy_client.cc:323] T 4403a36d26db47278a82abb5df118bbd P 9353b63b4d854d23b51a8103bc899aab: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.196:41095
I20260810 01:57:26.788203 26830 consensus_queue.cc:237] T 40f41d25879b4c58ade48978afadf2ef P 60d4538b78b44201964cf440ea562c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 680, Committed index: 680, Last appended: 1.680, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 681 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } }
W20260810 01:57:26.793426 26744 consensus_peers.cc:597] T 40f41d25879b4c58ade48978afadf2ef P 60d4538b78b44201964cf440ea562c72 -> Peer 07e0a39216984856b2ff8c512c4c2f93 (127.21.64.199:42747): Couldn't send request to peer 07e0a39216984856b2ff8c512c4c2f93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 40f41d25879b4c58ade48978afadf2ef. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:57:26.794652 27004 raft_consensus.cc:1275] T 40f41d25879b4c58ade48978afadf2ef P 56388bef1a0f453cadc8b6aa9434311d [term 1 FOLLOWER]: Refusing update from remote peer 60d4538b78b44201964cf440ea562c72: Log matching property violated. Preceding OpId in replica: term: 1 index: 680. Preceding OpId from leader: term: 1 index: 682. (index mismatch)
I20260810 01:57:26.804307 31674 consensus_queue.cc:1048] T 40f41d25879b4c58ade48978afadf2ef P 60d4538b78b44201964cf440ea562c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 681, Last known committed idx: 680, Time since last communication: 0.000s
I20260810 01:57:26.809191 31865 raft_consensus.cc:2955] T 40f41d25879b4c58ade48978afadf2ef P 60d4538b78b44201964cf440ea562c72 [term 1 LEADER]: Committing config change with OpId 1.681: config changed from index -1 to 681, VOTER 07e0a39216984856b2ff8c512c4c2f93 (127.21.64.199) added. New config: { opid_index: 681 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } }
I20260810 01:57:26.816483 27003 raft_consensus.cc:2955] T 40f41d25879b4c58ade48978afadf2ef P 56388bef1a0f453cadc8b6aa9434311d [term 1 FOLLOWER]: Committing config change with OpId 1.681: config changed from index -1 to 681, VOTER 07e0a39216984856b2ff8c512c4c2f93 (127.21.64.199) added. New config: { opid_index: 681 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } }
I20260810 01:57:26.817725 26453 catalog_manager.cc:5719] T 40f41d25879b4c58ade48978afadf2ef P 60d4538b78b44201964cf440ea562c72 reported cstate change: config changed from index -1 to 681, VOTER 07e0a39216984856b2ff8c512c4c2f93 (127.21.64.199) added. New cstate: current_term: 1 leader_uuid: "60d4538b78b44201964cf440ea562c72" committed_config { opid_index: 681 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } }
I20260810 01:57:26.868952 28433 tablet_copy_service.cc:140] P 28812b178f824d539cab11abfe98d77d: Received BeginTabletCopySession request for tablet 4403a36d26db47278a82abb5df118bbd from peer 9353b63b4d854d23b51a8103bc899aab ({username='slave'} at 127.21.64.198:49589)
I20260810 01:57:26.869304 28433 tablet_copy_service.cc:161] P 28812b178f824d539cab11abfe98d77d: Beginning new tablet copy session on tablet 4403a36d26db47278a82abb5df118bbd from peer 9353b63b4d854d23b51a8103bc899aab at {username='slave'} at 127.21.64.198:49589: session id = 9353b63b4d854d23b51a8103bc899aab-4403a36d26db47278a82abb5df118bbd
I20260810 01:57:26.874599 28433 tablet_copy_source_session.cc:215] T 4403a36d26db47278a82abb5df118bbd P 28812b178f824d539cab11abfe98d77d: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:57:26.876952 32106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4403a36d26db47278a82abb5df118bbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:57:26.902711 32106 tablet_copy_client.cc:806] T 4403a36d26db47278a82abb5df118bbd P 9353b63b4d854d23b51a8103bc899aab: tablet copy: Starting download of 0 data blocks...
I20260810 01:57:26.903119 32106 tablet_copy_client.cc:670] T 4403a36d26db47278a82abb5df118bbd P 9353b63b4d854d23b51a8103bc899aab: tablet copy: Starting download of 1 WAL segments...
I20260810 01:57:26.951891 32106 tablet_copy_client.cc:538] T 4403a36d26db47278a82abb5df118bbd P 9353b63b4d854d23b51a8103bc899aab: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:57:26.996622 32106 tablet_bootstrap.cc:492] T 4403a36d26db47278a82abb5df118bbd P 9353b63b4d854d23b51a8103bc899aab: Bootstrap starting.
I20260810 01:57:27.307520 32156 ts_tablet_manager.cc:933] T 40f41d25879b4c58ade48978afadf2ef P 07e0a39216984856b2ff8c512c4c2f93: Initiating tablet copy from peer 60d4538b78b44201964cf440ea562c72 (127.21.64.194:36943)
I20260810 01:57:27.414923 32156 tablet_copy_client.cc:323] T 40f41d25879b4c58ade48978afadf2ef P 07e0a39216984856b2ff8c512c4c2f93: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.194:36943
I20260810 01:57:27.415737 26856 tablet_copy_service.cc:140] P 60d4538b78b44201964cf440ea562c72: Received BeginTabletCopySession request for tablet 40f41d25879b4c58ade48978afadf2ef from peer 07e0a39216984856b2ff8c512c4c2f93 ({username='slave'} at 127.21.64.199:33581)
I20260810 01:57:27.415894 26856 tablet_copy_service.cc:161] P 60d4538b78b44201964cf440ea562c72: Beginning new tablet copy session on tablet 40f41d25879b4c58ade48978afadf2ef from peer 07e0a39216984856b2ff8c512c4c2f93 at {username='slave'} at 127.21.64.199:33581: session id = 07e0a39216984856b2ff8c512c4c2f93-40f41d25879b4c58ade48978afadf2ef
I20260810 01:57:27.419050 26856 tablet_copy_source_session.cc:215] T 40f41d25879b4c58ade48978afadf2ef P 60d4538b78b44201964cf440ea562c72: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:57:27.420821 32156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40f41d25879b4c58ade48978afadf2ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:57:27.443074 32156 tablet_copy_client.cc:806] T 40f41d25879b4c58ade48978afadf2ef P 07e0a39216984856b2ff8c512c4c2f93: tablet copy: Starting download of 0 data blocks...
I20260810 01:57:27.443477 32156 tablet_copy_client.cc:670] T 40f41d25879b4c58ade48978afadf2ef P 07e0a39216984856b2ff8c512c4c2f93: tablet copy: Starting download of 1 WAL segments...
I20260810 01:57:27.448253 32156 tablet_copy_client.cc:538] T 40f41d25879b4c58ade48978afadf2ef P 07e0a39216984856b2ff8c512c4c2f93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:57:27.452076 32156 tablet_bootstrap.cc:492] T 40f41d25879b4c58ade48978afadf2ef P 07e0a39216984856b2ff8c512c4c2f93: Bootstrap starting.
I20260810 01:57:27.727206 27006 consensus_queue.cc:237] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 751, Committed index: 751, Last appended: 1.751, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 752 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } }
I20260810 01:57:27.748740 28581 raft_consensus.cc:1275] T b10c8ac173fc40ca9817d1b654117ca1 P 8be4ab1c5cca41849942448806160d19 [term 1 FOLLOWER]: Refusing update from remote peer 56388bef1a0f453cadc8b6aa9434311d: Log matching property violated. Preceding OpId in replica: term: 1 index: 751. Preceding OpId from leader: term: 1 index: 752. (index mismatch)
I20260810 01:57:27.755836 32090 consensus_queue.cc:1048] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 752, Last known committed idx: 751, Time since last communication: 0.000s
I20260810 01:57:27.768272 31855 raft_consensus.cc:2955] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d [term 1 LEADER]: Committing config change with OpId 1.752: config changed from index 321 to 752, VOTER 9353b63b4d854d23b51a8103bc899aab (127.21.64.198) added. New config: { opid_index: 752 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } } }
I20260810 01:57:27.775985 26456 catalog_manager.cc:5719] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d reported cstate change: config changed from index 321 to 752, VOTER 9353b63b4d854d23b51a8103bc899aab (127.21.64.198) added. New cstate: current_term: 1 leader_uuid: "56388bef1a0f453cadc8b6aa9434311d" committed_config { opid_index: 752 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } } }
I20260810 01:57:27.783325 28581 raft_consensus.cc:2955] T b10c8ac173fc40ca9817d1b654117ca1 P 8be4ab1c5cca41849942448806160d19 [term 1 FOLLOWER]: Committing config change with OpId 1.752: config changed from index 321 to 752, VOTER 9353b63b4d854d23b51a8103bc899aab (127.21.64.198) added. New config: { opid_index: 752 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } } }
W20260810 01:57:27.809830 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.199:42747, user_credentials={real_user=slave}} blocked reactor thread for 112875us
W20260810 01:57:27.830976 26914 consensus_peers.cc:597] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d -> Peer 9353b63b4d854d23b51a8103bc899aab (127.21.64.198:41745): Couldn't send request to peer 9353b63b4d854d23b51a8103bc899aab. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b10c8ac173fc40ca9817d1b654117ca1. This is attempt 1: this message will repeat every 5th retry.
W20260810 01:57:27.916244 32069 log.cc:927] Time spent T d771b2d03cb940018a706ecc38f68a9e P 07e0a39216984856b2ff8c512c4c2f93: Append to log took a long time: real 0.061s user 0.001s sys 0.000s
W20260810 01:57:27.969555 26745 consensus_peers.cc:597] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72 -> Peer 9353b63b4d854d23b51a8103bc899aab (127.21.64.198:41745): Couldn't send request to peer 9353b63b4d854d23b51a8103bc899aab. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20260810 01:57:28.253393 26913 consensus_peers.cc:597] T d771b2d03cb940018a706ecc38f68a9e P 56388bef1a0f453cadc8b6aa9434311d -> Peer 07e0a39216984856b2ff8c512c4c2f93 (127.21.64.199:42747): Couldn't send request to peer 07e0a39216984856b2ff8c512c4c2f93. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260810 01:57:28.434895 32204 ts_tablet_manager.cc:933] T b10c8ac173fc40ca9817d1b654117ca1 P 9353b63b4d854d23b51a8103bc899aab: Initiating tablet copy from peer 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195:45355)
I20260810 01:57:28.484123 32204 tablet_copy_client.cc:323] T b10c8ac173fc40ca9817d1b654117ca1 P 9353b63b4d854d23b51a8103bc899aab: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.195:45355
I20260810 01:57:28.546569 27035 tablet_copy_service.cc:140] P 56388bef1a0f453cadc8b6aa9434311d: Received BeginTabletCopySession request for tablet b10c8ac173fc40ca9817d1b654117ca1 from peer 9353b63b4d854d23b51a8103bc899aab ({username='slave'} at 127.21.64.198:33125)
I20260810 01:57:28.546824 27035 tablet_copy_service.cc:161] P 56388bef1a0f453cadc8b6aa9434311d: Beginning new tablet copy session on tablet b10c8ac173fc40ca9817d1b654117ca1 from peer 9353b63b4d854d23b51a8103bc899aab at {username='slave'} at 127.21.64.198:33125: session id = 9353b63b4d854d23b51a8103bc899aab-b10c8ac173fc40ca9817d1b654117ca1
I20260810 01:57:28.551222 27035 tablet_copy_source_session.cc:215] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:57:28.554706 32204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b10c8ac173fc40ca9817d1b654117ca1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:57:28.619462 32204 tablet_copy_client.cc:806] T b10c8ac173fc40ca9817d1b654117ca1 P 9353b63b4d854d23b51a8103bc899aab: tablet copy: Starting download of 0 data blocks...
I20260810 01:57:28.620968 32204 tablet_copy_client.cc:670] T b10c8ac173fc40ca9817d1b654117ca1 P 9353b63b4d854d23b51a8103bc899aab: tablet copy: Starting download of 1 WAL segments...
I20260810 01:57:28.653538 32204 tablet_copy_client.cc:538] T b10c8ac173fc40ca9817d1b654117ca1 P 9353b63b4d854d23b51a8103bc899aab: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:57:28.683024 32204 tablet_bootstrap.cc:492] T b10c8ac173fc40ca9817d1b654117ca1 P 9353b63b4d854d23b51a8103bc899aab: Bootstrap starting.
W20260810 01:57:29.305521 28317 consensus_peers.cc:597] T 4403a36d26db47278a82abb5df118bbd P 28812b178f824d539cab11abfe98d77d -> Peer 9353b63b4d854d23b51a8103bc899aab (127.21.64.198:41745): Couldn't send request to peer 9353b63b4d854d23b51a8103bc899aab. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260810 01:57:29.386348 32069 tablet_bootstrap.cc:492] T d771b2d03cb940018a706ecc38f68a9e P 07e0a39216984856b2ff8c512c4c2f93: Bootstrap replayed 1/1 log segments. Stats: ops{read=712 overwritten=0 applied=711 ignored=0} inserts{seen=1342 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260810 01:57:29.387635 32069 tablet_bootstrap.cc:492] T d771b2d03cb940018a706ecc38f68a9e P 07e0a39216984856b2ff8c512c4c2f93: Bootstrap complete.
I20260810 01:57:29.388164 32069 ts_tablet_manager.cc:1403] T d771b2d03cb940018a706ecc38f68a9e P 07e0a39216984856b2ff8c512c4c2f93: Time spent bootstrapping tablet: real 3.350s user 0.967s sys 0.155s
I20260810 01:57:29.389205 32069 raft_consensus.cc:359] T d771b2d03cb940018a706ecc38f68a9e P 07e0a39216984856b2ff8c512c4c2f93 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: 702 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } }
I20260810 01:57:29.394269 32069 raft_consensus.cc:740] T d771b2d03cb940018a706ecc38f68a9e P 07e0a39216984856b2ff8c512c4c2f93 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07e0a39216984856b2ff8c512c4c2f93, State: Initialized, Role: FOLLOWER
I20260810 01:57:29.394871 32069 consensus_queue.cc:260] T d771b2d03cb940018a706ecc38f68a9e P 07e0a39216984856b2ff8c512c4c2f93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 711, Last appended: 1.712, Last appended by leader: 712, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 702 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } }
I20260810 01:57:29.409623 32069 ts_tablet_manager.cc:1434] T d771b2d03cb940018a706ecc38f68a9e P 07e0a39216984856b2ff8c512c4c2f93: Time spent starting tablet: real 0.021s user 0.007s sys 0.000s
I20260810 01:57:29.412022 27035 tablet_copy_service.cc:342] P 56388bef1a0f453cadc8b6aa9434311d: Request end of tablet copy session 07e0a39216984856b2ff8c512c4c2f93-d771b2d03cb940018a706ecc38f68a9e received from {username='slave'} at 127.21.64.199:43465
I20260810 01:57:29.412290 27035 tablet_copy_service.cc:434] P 56388bef1a0f453cadc8b6aa9434311d: ending tablet copy session 07e0a39216984856b2ff8c512c4c2f93-d771b2d03cb940018a706ecc38f68a9e on tablet d771b2d03cb940018a706ecc38f68a9e with peer 07e0a39216984856b2ff8c512c4c2f93
I20260810 01:57:29.767936 28942 raft_consensus.cc:1217] T d771b2d03cb940018a706ecc38f68a9e P 07e0a39216984856b2ff8c512c4c2f93 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.701->[1.702-1.752] Dedup: 1.712->[1.713-1.752]
W20260810 01:57:29.829792 26744 consensus_peers.cc:597] T 40f41d25879b4c58ade48978afadf2ef P 60d4538b78b44201964cf440ea562c72 -> Peer 07e0a39216984856b2ff8c512c4c2f93 (127.21.64.199:42747): Couldn't send request to peer 07e0a39216984856b2ff8c512c4c2f93. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260810 01:57:29.915267 28379 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
W20260810 01:57:29.968508 32156 log.cc:927] Time spent T 40f41d25879b4c58ade48978afadf2ef P 07e0a39216984856b2ff8c512c4c2f93: Append to log took a long time: real 0.095s user 0.000s sys 0.000s
I20260810 01:57:29.992151 28563 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:57:29.994277 28916 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:57:29.998968 28739 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:57:30.014432 26976 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:57:30.053151 26806 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
W20260810 01:57:30.063526 26574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.196:41095, user_credentials={real_user=slave}} blocked reactor thread for 114902us
W20260810 01:57:30.137491 30357 log.cc:927] Time spent T 059177b44a51490f9765e20391967605 P 9353b63b4d854d23b51a8103bc899aab: Append to log took a long time: real 0.058s user 0.001s sys 0.000s
I20260810 01:57:30.235532 26634 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
W20260810 01:57:30.472271 26745 consensus_peers.cc:597] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72 -> Peer 9353b63b4d854d23b51a8103bc899aab (127.21.64.198:41745): Couldn't send request to peer 9353b63b4d854d23b51a8103bc899aab. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
W20260810 01:57:30.533066 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.197:46107, user_credentials={real_user=slave}} blocked reactor thread for 58770.9us
W20260810 01:57:30.545472 32106 log.cc:927] Time spent T 4403a36d26db47278a82abb5df118bbd P 9353b63b4d854d23b51a8103bc899aab: Append to log took a long time: real 0.088s user 0.000s sys 0.000s
W20260810 01:57:31.036253 26914 consensus_peers.cc:597] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d -> Peer 9353b63b4d854d23b51a8103bc899aab (127.21.64.198:41745): Couldn't send request to peer 9353b63b4d854d23b51a8103bc899aab. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260810 01:57:31.095935 32062 tablet_bootstrap.cc:492] T 4f7860cf1d8449fc9f062f3e09e4aafd P 9353b63b4d854d23b51a8103bc899aab: Bootstrap replaying log segment 1/1 (263.2K/324.5K this segment, stats: ops{read=646 overwritten=0 applied=645 ignored=0} inserts{seen=1275 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0)
W20260810 01:57:31.626688 32156 log.cc:927] Time spent T 40f41d25879b4c58ade48978afadf2ef P 07e0a39216984856b2ff8c512c4c2f93: Append to log took a long time: real 0.105s user 0.000s sys 0.000s
W20260810 01:57:31.737291 26574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.196:41095, user_credentials={real_user=slave}} blocked reactor thread for 99232.6us
I20260810 01:57:31.889478 32062 tablet_bootstrap.cc:492] T 4f7860cf1d8449fc9f062f3e09e4aafd P 9353b63b4d854d23b51a8103bc899aab: Bootstrap replayed 1/1 log segments. Stats: ops{read=800 overwritten=0 applied=800 ignored=0} inserts{seen=1429 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:57:31.904460 32062 tablet_bootstrap.cc:492] T 4f7860cf1d8449fc9f062f3e09e4aafd P 9353b63b4d854d23b51a8103bc899aab: Bootstrap complete.
I20260810 01:57:31.905087 32062 ts_tablet_manager.cc:1403] T 4f7860cf1d8449fc9f062f3e09e4aafd P 9353b63b4d854d23b51a8103bc899aab: Time spent bootstrapping tablet: real 6.287s user 1.083s sys 0.168s
I20260810 01:57:31.906623 32062 raft_consensus.cc:359] T 4f7860cf1d8449fc9f062f3e09e4aafd P 9353b63b4d854d23b51a8103bc899aab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 795 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } }
I20260810 01:57:31.910817 32062 raft_consensus.cc:740] T 4f7860cf1d8449fc9f062f3e09e4aafd P 9353b63b4d854d23b51a8103bc899aab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9353b63b4d854d23b51a8103bc899aab, State: Initialized, Role: FOLLOWER
I20260810 01:57:31.911242 32062 consensus_queue.cc:260] T 4f7860cf1d8449fc9f062f3e09e4aafd P 9353b63b4d854d23b51a8103bc899aab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 800, Last appended: 1.800, Last appended by leader: 800, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 795 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } }
I20260810 01:57:31.929499 32062 ts_tablet_manager.cc:1434] T 4f7860cf1d8449fc9f062f3e09e4aafd P 9353b63b4d854d23b51a8103bc899aab: Time spent starting tablet: real 0.024s user 0.003s sys 0.000s
I20260810 01:57:31.933324 26856 tablet_copy_service.cc:342] P 60d4538b78b44201964cf440ea562c72: Request end of tablet copy session 9353b63b4d854d23b51a8103bc899aab-4f7860cf1d8449fc9f062f3e09e4aafd received from {username='slave'} at 127.21.64.198:48223
I20260810 01:57:31.933640 26856 tablet_copy_service.cc:434] P 60d4538b78b44201964cf440ea562c72: ending tablet copy session 9353b63b4d854d23b51a8103bc899aab-4f7860cf1d8449fc9f062f3e09e4aafd on tablet 4f7860cf1d8449fc9f062f3e09e4aafd with peer 9353b63b4d854d23b51a8103bc899aab
W20260810 01:57:31.940361 28317 consensus_peers.cc:597] T 4403a36d26db47278a82abb5df118bbd P 28812b178f824d539cab11abfe98d77d -> Peer 9353b63b4d854d23b51a8103bc899aab (127.21.64.198:41745): Couldn't send request to peer 9353b63b4d854d23b51a8103bc899aab. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
I20260810 01:57:32.365053 28768 raft_consensus.cc:1217] T 4f7860cf1d8449fc9f062f3e09e4aafd P 9353b63b4d854d23b51a8103bc899aab [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.794->[1.795-1.882] Dedup: 1.800->[1.801-1.882]
W20260810 01:57:32.474392 26744 consensus_peers.cc:597] T 40f41d25879b4c58ade48978afadf2ef P 60d4538b78b44201964cf440ea562c72 -> Peer 07e0a39216984856b2ff8c512c4c2f93 (127.21.64.199:42747): Couldn't send request to peer 07e0a39216984856b2ff8c512c4c2f93. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
W20260810 01:57:32.929894 32356 log.cc:927] Time spent T 4f7860cf1d8449fc9f062f3e09e4aafd P 9353b63b4d854d23b51a8103bc899aab: Append to log took a long time: real 0.082s user 0.000s sys 0.001s
I20260810 01:57:33.140758 28916 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:57:33.173328 28379 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:57:33.209008 26976 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:57:33.253022 26806 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:57:33.284580 26634 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:57:33.340780 28739 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:57:33.398653 28563 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
W20260810 01:57:33.638878 26914 consensus_peers.cc:597] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d -> Peer 9353b63b4d854d23b51a8103bc899aab (127.21.64.198:41745): Couldn't send request to peer 9353b63b4d854d23b51a8103bc899aab. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
W20260810 01:57:33.886246 29011 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.21.64.196:41095, user_credentials={real_user=slave}} blocked reactor thread for 87872us
I20260810 01:57:33.935073 32156 tablet_bootstrap.cc:492] T 40f41d25879b4c58ade48978afadf2ef P 07e0a39216984856b2ff8c512c4c2f93: Bootstrap replayed 1/1 log segments. Stats: ops{read=696 overwritten=0 applied=696 ignored=0} inserts{seen=1327 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:57:33.935794 32156 tablet_bootstrap.cc:492] T 40f41d25879b4c58ade48978afadf2ef P 07e0a39216984856b2ff8c512c4c2f93: Bootstrap complete.
I20260810 01:57:33.936316 32156 ts_tablet_manager.cc:1403] T 40f41d25879b4c58ade48978afadf2ef P 07e0a39216984856b2ff8c512c4c2f93: Time spent bootstrapping tablet: real 6.484s user 1.037s sys 0.171s
I20260810 01:57:33.937515 32156 raft_consensus.cc:359] T 40f41d25879b4c58ade48978afadf2ef P 07e0a39216984856b2ff8c512c4c2f93 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 681 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } }
I20260810 01:57:33.942481 32156 raft_consensus.cc:740] T 40f41d25879b4c58ade48978afadf2ef P 07e0a39216984856b2ff8c512c4c2f93 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07e0a39216984856b2ff8c512c4c2f93, State: Initialized, Role: FOLLOWER
I20260810 01:57:33.942870 32156 consensus_queue.cc:260] T 40f41d25879b4c58ade48978afadf2ef P 07e0a39216984856b2ff8c512c4c2f93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 696, Last appended: 1.696, Last appended by leader: 696, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 681 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } }
I20260810 01:57:33.968600 32156 ts_tablet_manager.cc:1434] T 40f41d25879b4c58ade48978afadf2ef P 07e0a39216984856b2ff8c512c4c2f93: Time spent starting tablet: real 0.032s user 0.002s sys 0.003s
I20260810 01:57:33.976528 26856 tablet_copy_service.cc:342] P 60d4538b78b44201964cf440ea562c72: Request end of tablet copy session 07e0a39216984856b2ff8c512c4c2f93-40f41d25879b4c58ade48978afadf2ef received from {username='slave'} at 127.21.64.199:33581
I20260810 01:57:33.976734 26856 tablet_copy_service.cc:434] P 60d4538b78b44201964cf440ea562c72: ending tablet copy session 07e0a39216984856b2ff8c512c4c2f93-40f41d25879b4c58ade48978afadf2ef on tablet 40f41d25879b4c58ade48978afadf2ef with peer 07e0a39216984856b2ff8c512c4c2f93
I20260810 01:57:34.003793 32106 tablet_bootstrap.cc:492] T 4403a36d26db47278a82abb5df118bbd P 9353b63b4d854d23b51a8103bc899aab: Bootstrap replaying log segment 1/1 (257.7K/385.0K this segment, stats: ops{read=661 overwritten=0 applied=660 ignored=0} inserts{seen=1332 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0)
I20260810 01:57:34.055289 28940 raft_consensus.cc:1217] T 40f41d25879b4c58ade48978afadf2ef P 07e0a39216984856b2ff8c512c4c2f93 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.680->[1.681-1.770] Dedup: 1.696->[1.697-1.770]
W20260810 01:57:34.647360 28317 consensus_peers.cc:597] T 4403a36d26db47278a82abb5df118bbd P 28812b178f824d539cab11abfe98d77d -> Peer 9353b63b4d854d23b51a8103bc899aab (127.21.64.198:41745): Couldn't send request to peer 9353b63b4d854d23b51a8103bc899aab. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 16: this message will repeat every 5th retry.
W20260810 01:57:34.681474 26744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.195:45355, user_credentials={real_user=slave}} blocked reactor thread for 63752.9us
I20260810 01:57:35.226471 32204 tablet_bootstrap.cc:492] T b10c8ac173fc40ca9817d1b654117ca1 P 9353b63b4d854d23b51a8103bc899aab: Bootstrap replaying log segment 1/1 (242.2K/308.2K this segment, stats: ops{read=592 overwritten=0 applied=591 ignored=0} inserts{seen=1275 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0)
W20260810 01:57:35.334456 26745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.198:41745, user_credentials={real_user=slave}} blocked reactor thread for 46917.9us
I20260810 01:57:35.778088 32106 tablet_bootstrap.cc:492] T 4403a36d26db47278a82abb5df118bbd P 9353b63b4d854d23b51a8103bc899aab: Bootstrap replayed 1/1 log segments. Stats: ops{read=996 overwritten=0 applied=996 ignored=0} inserts{seen=1665 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:57:35.783182 32106 tablet_bootstrap.cc:492] T 4403a36d26db47278a82abb5df118bbd P 9353b63b4d854d23b51a8103bc899aab: Bootstrap complete.
I20260810 01:57:35.783839 32106 ts_tablet_manager.cc:1403] T 4403a36d26db47278a82abb5df118bbd P 9353b63b4d854d23b51a8103bc899aab: Time spent bootstrapping tablet: real 8.787s user 1.329s sys 0.214s
I20260810 01:57:35.785564 32106 raft_consensus.cc:359] T 4403a36d26db47278a82abb5df118bbd P 9353b63b4d854d23b51a8103bc899aab [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 978 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } }
I20260810 01:57:35.787012 32106 raft_consensus.cc:740] T 4403a36d26db47278a82abb5df118bbd P 9353b63b4d854d23b51a8103bc899aab [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9353b63b4d854d23b51a8103bc899aab, State: Initialized, Role: FOLLOWER
I20260810 01:57:35.787550 32106 consensus_queue.cc:260] T 4403a36d26db47278a82abb5df118bbd P 9353b63b4d854d23b51a8103bc899aab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 996, Last appended: 2.996, Last appended by leader: 996, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 978 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } }
I20260810 01:57:35.795858 32106 ts_tablet_manager.cc:1434] T 4403a36d26db47278a82abb5df118bbd P 9353b63b4d854d23b51a8103bc899aab: Time spent starting tablet: real 0.011s user 0.002s sys 0.002s
I20260810 01:57:35.798030 28433 tablet_copy_service.cc:342] P 28812b178f824d539cab11abfe98d77d: Request end of tablet copy session 9353b63b4d854d23b51a8103bc899aab-4403a36d26db47278a82abb5df118bbd received from {username='slave'} at 127.21.64.198:49589
I20260810 01:57:35.798206 28433 tablet_copy_service.cc:434] P 28812b178f824d539cab11abfe98d77d: ending tablet copy session 9353b63b4d854d23b51a8103bc899aab-4403a36d26db47278a82abb5df118bbd on tablet 4403a36d26db47278a82abb5df118bbd with peer 9353b63b4d854d23b51a8103bc899aab
I20260810 01:57:36.172138 28769 raft_consensus.cc:1217] T 4403a36d26db47278a82abb5df118bbd P 9353b63b4d854d23b51a8103bc899aab [term 2 FOLLOWER]: Deduplicated request from leader. Original: 2.977->[2.978-2.1158] Dedup: 2.996->[2.997-2.1158]
W20260810 01:57:36.203703 26914 consensus_peers.cc:597] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d -> Peer 9353b63b4d854d23b51a8103bc899aab (127.21.64.198:41745): Couldn't send request to peer 9353b63b4d854d23b51a8103bc899aab. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 16: this message will repeat every 5th retry.
I20260810 01:57:36.225289 28916 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:57:36.268990 28563 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:57:36.293291 28379 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:57:36.331838 26976 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:57:36.366700 26806 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
W20260810 01:57:36.690286 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.198:41745, user_credentials={real_user=slave}} blocked reactor thread for 70494.9us
I20260810 01:57:36.762054 26634 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:57:36.925814 32204 tablet_bootstrap.cc:492] T b10c8ac173fc40ca9817d1b654117ca1 P 9353b63b4d854d23b51a8103bc899aab: Bootstrap replayed 1/1 log segments. Stats: ops{read=758 overwritten=0 applied=758 ignored=0} inserts{seen=1441 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:57:36.926409 32204 tablet_bootstrap.cc:492] T b10c8ac173fc40ca9817d1b654117ca1 P 9353b63b4d854d23b51a8103bc899aab: Bootstrap complete.
I20260810 01:57:36.927003 32204 ts_tablet_manager.cc:1403] T b10c8ac173fc40ca9817d1b654117ca1 P 9353b63b4d854d23b51a8103bc899aab: Time spent bootstrapping tablet: real 8.244s user 1.031s sys 0.184s
I20260810 01:57:36.928196 32204 raft_consensus.cc:359] T b10c8ac173fc40ca9817d1b654117ca1 P 9353b63b4d854d23b51a8103bc899aab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 752 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } }
I20260810 01:57:36.928498 32204 raft_consensus.cc:740] T b10c8ac173fc40ca9817d1b654117ca1 P 9353b63b4d854d23b51a8103bc899aab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9353b63b4d854d23b51a8103bc899aab, State: Initialized, Role: FOLLOWER
I20260810 01:57:36.928911 32204 consensus_queue.cc:260] T b10c8ac173fc40ca9817d1b654117ca1 P 9353b63b4d854d23b51a8103bc899aab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 758, Last appended: 1.758, Last appended by leader: 758, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 752 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } }
I20260810 01:57:36.937398 32204 ts_tablet_manager.cc:1434] T b10c8ac173fc40ca9817d1b654117ca1 P 9353b63b4d854d23b51a8103bc899aab: Time spent starting tablet: real 0.010s user 0.002s sys 0.006s
I20260810 01:57:36.938170 27035 tablet_copy_service.cc:342] P 56388bef1a0f453cadc8b6aa9434311d: Request end of tablet copy session 9353b63b4d854d23b51a8103bc899aab-b10c8ac173fc40ca9817d1b654117ca1 received from {username='slave'} at 127.21.64.198:33125
I20260810 01:57:36.938301 27035 tablet_copy_service.cc:434] P 56388bef1a0f453cadc8b6aa9434311d: ending tablet copy session 9353b63b4d854d23b51a8103bc899aab-b10c8ac173fc40ca9817d1b654117ca1 on tablet b10c8ac173fc40ca9817d1b654117ca1 with peer 9353b63b4d854d23b51a8103bc899aab
I20260810 01:57:36.969584 28739 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:57:37.149231 28768 raft_consensus.cc:1217] T b10c8ac173fc40ca9817d1b654117ca1 P 9353b63b4d854d23b51a8103bc899aab [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.751->[1.752-1.865] Dedup: 1.758->[1.759-1.865]
W20260810 01:57:37.327236 26745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.198:41745, user_credentials={real_user=slave}} blocked reactor thread for 196095us
I20260810 01:57:37.818352 26830 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40f41d25879b4c58ade48978afadf2ef"
dest_uuid: "60d4538b78b44201964cf440ea562c72"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:52320
I20260810 01:57:37.818599 26830 raft_consensus.cc:606] T 40f41d25879b4c58ade48978afadf2ef P 60d4538b78b44201964cf440ea562c72 [term 1 LEADER]: Received request to transfer leadership
I20260810 01:57:37.824427 32547 raft_consensus.cc:993] T 40f41d25879b4c58ade48978afadf2ef P 60d4538b78b44201964cf440ea562c72: : Instructing follower 07e0a39216984856b2ff8c512c4c2f93 to start an election
I20260810 01:57:37.824589 32547 raft_consensus.cc:1081] T 40f41d25879b4c58ade48978afadf2ef P 60d4538b78b44201964cf440ea562c72 [term 1 LEADER]: Signalling peer 07e0a39216984856b2ff8c512c4c2f93 to start an election
I20260810 01:57:37.826412 28941 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40f41d25879b4c58ade48978afadf2ef"
dest_uuid: "07e0a39216984856b2ff8c512c4c2f93"
from {username='slave'} at 127.21.64.194:33663
I20260810 01:57:37.826793 28941 raft_consensus.cc:493] T 40f41d25879b4c58ade48978afadf2ef P 07e0a39216984856b2ff8c512c4c2f93 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260810 01:57:37.827044 28941 raft_consensus.cc:3060] T 40f41d25879b4c58ade48978afadf2ef P 07e0a39216984856b2ff8c512c4c2f93 [term 1 FOLLOWER]: Advancing to term 2
W20260810 01:57:37.853049 26771 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50994: Service unavailable: leader transfer in progress
I20260810 01:57:37.854562 28941 raft_consensus.cc:515] T 40f41d25879b4c58ade48978afadf2ef P 07e0a39216984856b2ff8c512c4c2f93 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 681 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } }
W20260810 01:57:37.866832 26771 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50994: Service unavailable: leader transfer in progress
I20260810 01:57:37.872954 26830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f41d25879b4c58ade48978afadf2ef" candidate_uuid: "07e0a39216984856b2ff8c512c4c2f93" candidate_term: 2 candidate_status { last_received { term: 1 index: 818 } } ignore_live_leader: true dest_uuid: "60d4538b78b44201964cf440ea562c72"
I20260810 01:57:37.873191 26830 raft_consensus.cc:3055] T 40f41d25879b4c58ade48978afadf2ef P 60d4538b78b44201964cf440ea562c72 [term 1 LEADER]: Stepping down as leader of term 1
I20260810 01:57:37.873288 26830 raft_consensus.cc:740] T 40f41d25879b4c58ade48978afadf2ef P 60d4538b78b44201964cf440ea562c72 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 60d4538b78b44201964cf440ea562c72, State: Running, Role: LEADER
I20260810 01:57:37.873591 26830 consensus_queue.cc:260] T 40f41d25879b4c58ade48978afadf2ef P 60d4538b78b44201964cf440ea562c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 818, Committed index: 818, Last appended: 1.818, Last appended by leader: 818, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 681 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } }
I20260810 01:57:37.873896 26830 raft_consensus.cc:3060] T 40f41d25879b4c58ade48978afadf2ef P 60d4538b78b44201964cf440ea562c72 [term 1 FOLLOWER]: Advancing to term 2
W20260810 01:57:37.876698 26771 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50994: Illegal state: replica 60d4538b78b44201964cf440ea562c72 is not leader of this config: current role FOLLOWER
I20260810 01:57:37.876982 28941 leader_election.cc:290] T 40f41d25879b4c58ade48978afadf2ef P 07e0a39216984856b2ff8c512c4c2f93 [CANDIDATE]: Term 2 election: Requested vote from peers 60d4538b78b44201964cf440ea562c72 (127.21.64.194:36943), 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195:45355)
I20260810 01:57:37.877220 26830 raft_consensus.cc:2468] T 40f41d25879b4c58ade48978afadf2ef P 60d4538b78b44201964cf440ea562c72 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07e0a39216984856b2ff8c512c4c2f93 in term 2.
I20260810 01:57:37.878209 28850 leader_election.cc:304] T 40f41d25879b4c58ade48978afadf2ef P 07e0a39216984856b2ff8c512c4c2f93 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07e0a39216984856b2ff8c512c4c2f93, 60d4538b78b44201964cf440ea562c72; no voters:
I20260810 01:57:37.885004 27003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f41d25879b4c58ade48978afadf2ef" candidate_uuid: "07e0a39216984856b2ff8c512c4c2f93" candidate_term: 2 candidate_status { last_received { term: 1 index: 818 } } ignore_live_leader: true dest_uuid: "56388bef1a0f453cadc8b6aa9434311d"
I20260810 01:57:37.885849 27003 raft_consensus.cc:3060] T 40f41d25879b4c58ade48978afadf2ef P 56388bef1a0f453cadc8b6aa9434311d [term 1 FOLLOWER]: Advancing to term 2
I20260810 01:57:37.911361 27003 raft_consensus.cc:2468] T 40f41d25879b4c58ade48978afadf2ef P 56388bef1a0f453cadc8b6aa9434311d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07e0a39216984856b2ff8c512c4c2f93 in term 2.
I20260810 01:57:37.945145 32578 raft_consensus.cc:2804] T 40f41d25879b4c58ade48978afadf2ef P 07e0a39216984856b2ff8c512c4c2f93 [term 2 FOLLOWER]: Leader election won for term 2
W20260810 01:57:37.945863 28850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.64.194:36943, user_credentials={real_user=slave}} blocked reactor thread for 67787us
I20260810 01:57:37.963511 32578 raft_consensus.cc:697] T 40f41d25879b4c58ade48978afadf2ef P 07e0a39216984856b2ff8c512c4c2f93 [term 2 LEADER]: Becoming Leader. State: Replica: 07e0a39216984856b2ff8c512c4c2f93, State: Running, Role: LEADER
I20260810 01:57:37.964928 32578 consensus_queue.cc:237] T 40f41d25879b4c58ade48978afadf2ef P 07e0a39216984856b2ff8c512c4c2f93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 818, Committed index: 818, Last appended: 1.818, Last appended by leader: 818, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 681 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } }
I20260810 01:57:38.087394 26456 catalog_manager.cc:5719] T 40f41d25879b4c58ade48978afadf2ef P 07e0a39216984856b2ff8c512c4c2f93 reported cstate change: term changed from 1 to 2, leader changed from 60d4538b78b44201964cf440ea562c72 (127.21.64.194) to 07e0a39216984856b2ff8c512c4c2f93 (127.21.64.199). New cstate: current_term: 2 leader_uuid: "07e0a39216984856b2ff8c512c4c2f93" committed_config { opid_index: 681 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } }
W20260810 01:57:38.154171 26941 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37368: Illegal state: replica 56388bef1a0f453cadc8b6aa9434311d is not leader of this config: current role FOLLOWER
I20260810 01:57:38.338497 27006 raft_consensus.cc:1275] T 40f41d25879b4c58ade48978afadf2ef P 56388bef1a0f453cadc8b6aa9434311d [term 2 FOLLOWER]: Refusing update from remote peer 07e0a39216984856b2ff8c512c4c2f93: Log matching property violated. Preceding OpId in replica: term: 1 index: 818. Preceding OpId from leader: term: 2 index: 820. (index mismatch)
I20260810 01:57:38.339211 26830 raft_consensus.cc:1275] T 40f41d25879b4c58ade48978afadf2ef P 60d4538b78b44201964cf440ea562c72 [term 2 FOLLOWER]: Refusing update from remote peer 07e0a39216984856b2ff8c512c4c2f93: Log matching property violated. Preceding OpId in replica: term: 1 index: 818. Preceding OpId from leader: term: 2 index: 820. (index mismatch)
I20260810 01:57:38.341006 32578 consensus_queue.cc:1048] T 40f41d25879b4c58ade48978afadf2ef P 07e0a39216984856b2ff8c512c4c2f93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 819, Last known committed idx: 818, Time since last communication: 0.000s
I20260810 01:57:38.342216 32578 consensus_queue.cc:1048] T 40f41d25879b4c58ade48978afadf2ef P 07e0a39216984856b2ff8c512c4c2f93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 819, Last known committed idx: 818, Time since last communication: 0.000s
I20260810 01:57:38.373992 32572 mvcc.cc:204] Tried to move back new op lower bound from 7316795630936334336 to 7316795629583437824. Current Snapshot: MvccSnapshot[applied={T|T < 7316795630936334336 or (T in {7316795630936334336})}]
I20260810 01:57:39.413024 28916 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:57:39.502377 28563 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:57:39.608575 26634 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:57:39.681726 28379 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:57:39.699076 26806 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:57:39.713907 26976 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:57:39.756109 28739 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260810 01:57:40.016157 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.198:41745, user_credentials={real_user=slave}} blocked reactor thread for 43546.4us
I20260810 01:57:40.531369 28943 consensus_queue.cc:237] T 40f41d25879b4c58ade48978afadf2ef P 07e0a39216984856b2ff8c512c4c2f93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 855, Committed index: 855, Last appended: 2.855, Last appended by leader: 818, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 856 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } }
I20260810 01:57:40.548626 27006 raft_consensus.cc:1275] T 40f41d25879b4c58ade48978afadf2ef P 56388bef1a0f453cadc8b6aa9434311d [term 2 FOLLOWER]: Refusing update from remote peer 07e0a39216984856b2ff8c512c4c2f93: Log matching property violated. Preceding OpId in replica: term: 2 index: 854. Preceding OpId from leader: term: 2 index: 856. (index mismatch)
I20260810 01:57:40.549750 32582 consensus_queue.cc:1048] T 40f41d25879b4c58ade48978afadf2ef P 07e0a39216984856b2ff8c512c4c2f93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 856, Last known committed idx: 854, Time since last communication: 0.000s
I20260810 01:57:40.554107 32578 raft_consensus.cc:2955] T 40f41d25879b4c58ade48978afadf2ef P 07e0a39216984856b2ff8c512c4c2f93 [term 2 LEADER]: Committing config change with OpId 2.856: config changed from index 681 to 856, VOTER 60d4538b78b44201964cf440ea562c72 (127.21.64.194) evicted. New config: { opid_index: 856 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } }
I20260810 01:57:40.554718 27006 raft_consensus.cc:2955] T 40f41d25879b4c58ade48978afadf2ef P 56388bef1a0f453cadc8b6aa9434311d [term 2 FOLLOWER]: Committing config change with OpId 2.856: config changed from index 681 to 856, VOTER 60d4538b78b44201964cf440ea562c72 (127.21.64.194) evicted. New config: { opid_index: 856 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } }
I20260810 01:57:40.577553 26456 catalog_manager.cc:5719] T 40f41d25879b4c58ade48978afadf2ef P 56388bef1a0f453cadc8b6aa9434311d reported cstate change: config changed from index 681 to 856, VOTER 60d4538b78b44201964cf440ea562c72 (127.21.64.194) evicted. New cstate: current_term: 2 leader_uuid: "07e0a39216984856b2ff8c512c4c2f93" committed_config { opid_index: 856 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } }
I20260810 01:57:40.580185 27004 raft_consensus.cc:1217] T 40f41d25879b4c58ade48978afadf2ef P 56388bef1a0f453cadc8b6aa9434311d [term 2 FOLLOWER]: Deduplicated request from leader. Original: 2.854->[2.855-2.855] Dedup: 2.855->[]
I20260810 01:57:40.788551 26806 tablet_service.cc:1558] Processing DeleteTablet for tablet 40f41d25879b4c58ade48978afadf2ef with delete_type TABLET_DATA_TOMBSTONED (TS 60d4538b78b44201964cf440ea562c72 not found in new config with opid_index 856) from {username='slave'} at 127.0.0.1:59826
I20260810 01:57:40.868307 32735 tablet_replica.cc:333] T 40f41d25879b4c58ade48978afadf2ef P 60d4538b78b44201964cf440ea562c72: stopping tablet replica
I20260810 01:57:40.868744 32735 raft_consensus.cc:2243] T 40f41d25879b4c58ade48978afadf2ef P 60d4538b78b44201964cf440ea562c72 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260810 01:57:40.869091 32735 raft_consensus.cc:2272] T 40f41d25879b4c58ade48978afadf2ef P 60d4538b78b44201964cf440ea562c72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260810 01:57:40.872165 32735 ts_tablet_manager.cc:1916] T 40f41d25879b4c58ade48978afadf2ef P 60d4538b78b44201964cf440ea562c72: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:57:40.895088 32735 ts_tablet_manager.cc:1929] T 40f41d25879b4c58ade48978afadf2ef P 60d4538b78b44201964cf440ea562c72: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.855
I20260810 01:57:40.897900 32735 log.cc:1199] T 40f41d25879b4c58ade48978afadf2ef P 60d4538b78b44201964cf440ea562c72: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal/wals/40f41d25879b4c58ade48978afadf2ef
I20260810 01:57:40.900987 26442 catalog_manager.cc:5050] TS 60d4538b78b44201964cf440ea562c72 (127.21.64.194:36943): tablet 40f41d25879b4c58ade48978afadf2ef (table rebalance_test_table_2 [id=e4e97ceec9a145e095f04aa5c373d684]) successfully deleted
I20260810 01:57:42.024550 28916 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:57:42.096053 26806 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:57:42.107193 28379 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:57:42.108033 26976 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:57:42.160138 28739 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:57:42.181579 26634 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:57:42.463970 28563 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:57:43.275420 28407 consensus_queue.cc:237] T 4403a36d26db47278a82abb5df118bbd P 28812b178f824d539cab11abfe98d77d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1288, Committed index: 1288, Last appended: 2.1288, Last appended by leader: 829, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1289 OBSOLETE_local: false peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } }
I20260810 01:57:43.277855 28763 raft_consensus.cc:1275] T 4403a36d26db47278a82abb5df118bbd P 9353b63b4d854d23b51a8103bc899aab [term 2 FOLLOWER]: Refusing update from remote peer 28812b178f824d539cab11abfe98d77d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1287. Preceding OpId from leader: term: 2 index: 1289. (index mismatch)
I20260810 01:57:43.279284 372 consensus_queue.cc:1048] T 4403a36d26db47278a82abb5df118bbd P 28812b178f824d539cab11abfe98d77d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1289, Last known committed idx: 1287, Time since last communication: 0.000s
I20260810 01:57:43.284698 372 raft_consensus.cc:2955] T 4403a36d26db47278a82abb5df118bbd P 28812b178f824d539cab11abfe98d77d [term 2 LEADER]: Committing config change with OpId 2.1289: config changed from index 978 to 1289, VOTER a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193) evicted. New config: { opid_index: 1289 OBSOLETE_local: false peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } } }
I20260810 01:57:43.285403 28769 raft_consensus.cc:2955] T 4403a36d26db47278a82abb5df118bbd P 9353b63b4d854d23b51a8103bc899aab [term 2 FOLLOWER]: Committing config change with OpId 2.1289: config changed from index 978 to 1289, VOTER a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193) evicted. New config: { opid_index: 1289 OBSOLETE_local: false peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } } }
I20260810 01:57:43.294137 26453 catalog_manager.cc:5719] T 4403a36d26db47278a82abb5df118bbd P 28812b178f824d539cab11abfe98d77d reported cstate change: config changed from index 978 to 1289, VOTER a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193) evicted. New cstate: current_term: 2 leader_uuid: "28812b178f824d539cab11abfe98d77d" committed_config { opid_index: 1289 OBSOLETE_local: false peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } } }
I20260810 01:57:43.387507 26634 tablet_service.cc:1558] Processing DeleteTablet for tablet 4403a36d26db47278a82abb5df118bbd with delete_type TABLET_DATA_TOMBSTONED (TS a46364d7cd504f8ca7fc003c59ae6d31 not found in new config with opid_index 1289) from {username='slave'} at 127.0.0.1:37082
I20260810 01:57:43.399897 28768 raft_consensus.cc:1217] T 4403a36d26db47278a82abb5df118bbd P 9353b63b4d854d23b51a8103bc899aab [term 2 FOLLOWER]: Deduplicated request from leader. Original: 2.1287->[2.1288-2.1288] Dedup: 2.1288->[]
I20260810 01:57:43.409433 400 tablet_replica.cc:333] T 4403a36d26db47278a82abb5df118bbd P a46364d7cd504f8ca7fc003c59ae6d31: stopping tablet replica
I20260810 01:57:43.409781 400 raft_consensus.cc:2243] T 4403a36d26db47278a82abb5df118bbd P a46364d7cd504f8ca7fc003c59ae6d31 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260810 01:57:43.410248 400 raft_consensus.cc:2272] T 4403a36d26db47278a82abb5df118bbd P a46364d7cd504f8ca7fc003c59ae6d31 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260810 01:57:43.411501 400 ts_tablet_manager.cc:1916] T 4403a36d26db47278a82abb5df118bbd P a46364d7cd504f8ca7fc003c59ae6d31: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:57:43.438519 400 ts_tablet_manager.cc:1929] T 4403a36d26db47278a82abb5df118bbd P a46364d7cd504f8ca7fc003c59ae6d31: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.1288
I20260810 01:57:43.462178 400 log.cc:1199] T 4403a36d26db47278a82abb5df118bbd P a46364d7cd504f8ca7fc003c59ae6d31: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/wal/wals/4403a36d26db47278a82abb5df118bbd
I20260810 01:57:43.465569 26446 catalog_manager.cc:5050] TS a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193:45781): tablet 4403a36d26db47278a82abb5df118bbd (table rebalance_test_table_0 [id=52f00827f2964d63b49607d8194867d6]) successfully deleted
I20260810 01:57:44.523444 28916 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:57:44.563593 26976 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:57:44.564523 28563 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:57:44.744853 26634 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:57:44.769025 28379 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:57:44.777660 26806 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
W20260810 01:57:44.830444 26910 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.194:36943, user_credentials={real_user=slave}} blocked reactor thread for 113950us
W20260810 01:57:44.854001 26913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.199:42747, user_credentials={real_user=slave}} blocked reactor thread for 149363us
I20260810 01:57:44.865906 28739 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260810 01:57:45.206429 26910 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.194:36943, user_credentials={real_user=slave}} blocked reactor thread for 44708.1us
W20260810 01:57:45.374598 26574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.197:46107, user_credentials={real_user=slave}} blocked reactor thread for 62730.1us
I20260810 01:57:45.454304 27006 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d771b2d03cb940018a706ecc38f68a9e"
dest_uuid: "56388bef1a0f453cadc8b6aa9434311d"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:38944
I20260810 01:57:45.454636 27006 raft_consensus.cc:606] T d771b2d03cb940018a706ecc38f68a9e P 56388bef1a0f453cadc8b6aa9434311d [term 1 LEADER]: Received request to transfer leadership
W20260810 01:57:45.459730 26941 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59534: Service unavailable: leader transfer in progress
W20260810 01:57:45.466709 26941 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59534: Service unavailable: leader transfer in progress
W20260810 01:57:45.474815 26941 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59534: Service unavailable: leader transfer in progress
W20260810 01:57:45.483703 26941 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59534: Service unavailable: leader transfer in progress
W20260810 01:57:45.489295 26941 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59534: Service unavailable: leader transfer in progress
W20260810 01:57:45.500278 26941 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59534: Service unavailable: leader transfer in progress
W20260810 01:57:45.510358 26941 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59534: Service unavailable: leader transfer in progress
W20260810 01:57:45.519476 26941 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59534: Service unavailable: leader transfer in progress
W20260810 01:57:45.534751 26941 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59534: Service unavailable: leader transfer in progress
W20260810 01:57:45.548419 26941 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59534: Service unavailable: leader transfer in progress
W20260810 01:57:45.561059 26941 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59534: Service unavailable: leader transfer in progress
W20260810 01:57:45.576148 26941 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59534: Service unavailable: leader transfer in progress
W20260810 01:57:45.592545 26941 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59534: Service unavailable: leader transfer in progress
W20260810 01:57:45.611575 26941 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59534: Service unavailable: leader transfer in progress
W20260810 01:57:45.629565 26941 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59534: Service unavailable: leader transfer in progress
W20260810 01:57:45.660969 26941 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59534: Service unavailable: leader transfer in progress
I20260810 01:57:45.674757 469 raft_consensus.cc:993] T d771b2d03cb940018a706ecc38f68a9e P 56388bef1a0f453cadc8b6aa9434311d: : Instructing follower 07e0a39216984856b2ff8c512c4c2f93 to start an election
I20260810 01:57:45.674924 469 raft_consensus.cc:1081] T d771b2d03cb940018a706ecc38f68a9e P 56388bef1a0f453cadc8b6aa9434311d [term 1 LEADER]: Signalling peer 07e0a39216984856b2ff8c512c4c2f93 to start an election
I20260810 01:57:45.676944 28940 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d771b2d03cb940018a706ecc38f68a9e"
dest_uuid: "07e0a39216984856b2ff8c512c4c2f93"
from {username='slave'} at 127.21.64.195:41307
I20260810 01:57:45.677192 28940 raft_consensus.cc:493] T d771b2d03cb940018a706ecc38f68a9e P 07e0a39216984856b2ff8c512c4c2f93 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260810 01:57:45.677274 28940 raft_consensus.cc:3060] T d771b2d03cb940018a706ecc38f68a9e P 07e0a39216984856b2ff8c512c4c2f93 [term 1 FOLLOWER]: Advancing to term 2
I20260810 01:57:45.685096 28940 raft_consensus.cc:515] T d771b2d03cb940018a706ecc38f68a9e P 07e0a39216984856b2ff8c512c4c2f93 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 702 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } }
I20260810 01:57:45.686218 28940 leader_election.cc:290] T d771b2d03cb940018a706ecc38f68a9e P 07e0a39216984856b2ff8c512c4c2f93 [CANDIDATE]: Term 2 election: Requested vote from peers 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195:45355), 60d4538b78b44201964cf440ea562c72 (127.21.64.194:36943)
I20260810 01:57:45.686640 26830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d771b2d03cb940018a706ecc38f68a9e" candidate_uuid: "07e0a39216984856b2ff8c512c4c2f93" candidate_term: 2 candidate_status { last_received { term: 1 index: 934 } } ignore_live_leader: true dest_uuid: "60d4538b78b44201964cf440ea562c72"
I20260810 01:57:45.686975 26830 raft_consensus.cc:3060] T d771b2d03cb940018a706ecc38f68a9e P 60d4538b78b44201964cf440ea562c72 [term 1 FOLLOWER]: Advancing to term 2
I20260810 01:57:45.689533 26830 raft_consensus.cc:2468] T d771b2d03cb940018a706ecc38f68a9e P 60d4538b78b44201964cf440ea562c72 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07e0a39216984856b2ff8c512c4c2f93 in term 2.
I20260810 01:57:45.690177 28850 leader_election.cc:304] T d771b2d03cb940018a706ecc38f68a9e P 07e0a39216984856b2ff8c512c4c2f93 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07e0a39216984856b2ff8c512c4c2f93, 60d4538b78b44201964cf440ea562c72; no voters:
I20260810 01:57:45.690451 447 raft_consensus.cc:2804] T d771b2d03cb940018a706ecc38f68a9e P 07e0a39216984856b2ff8c512c4c2f93 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 01:57:45.690567 447 raft_consensus.cc:697] T d771b2d03cb940018a706ecc38f68a9e P 07e0a39216984856b2ff8c512c4c2f93 [term 2 LEADER]: Becoming Leader. State: Replica: 07e0a39216984856b2ff8c512c4c2f93, State: Running, Role: LEADER
I20260810 01:57:45.690791 447 consensus_queue.cc:237] T d771b2d03cb940018a706ecc38f68a9e P 07e0a39216984856b2ff8c512c4c2f93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 934, Committed index: 934, Last appended: 1.934, Last appended by leader: 934, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 702 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } }
W20260810 01:57:45.692425 26941 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59534: Service unavailable: leader transfer in progress
I20260810 01:57:45.695544 27006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d771b2d03cb940018a706ecc38f68a9e" candidate_uuid: "07e0a39216984856b2ff8c512c4c2f93" candidate_term: 2 candidate_status { last_received { term: 1 index: 934 } } ignore_live_leader: true dest_uuid: "56388bef1a0f453cadc8b6aa9434311d"
I20260810 01:57:45.695727 27006 raft_consensus.cc:3055] T d771b2d03cb940018a706ecc38f68a9e P 56388bef1a0f453cadc8b6aa9434311d [term 1 LEADER]: Stepping down as leader of term 1
I20260810 01:57:45.695878 27006 raft_consensus.cc:740] T d771b2d03cb940018a706ecc38f68a9e P 56388bef1a0f453cadc8b6aa9434311d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56388bef1a0f453cadc8b6aa9434311d, State: Running, Role: LEADER
I20260810 01:57:45.696439 27006 consensus_queue.cc:260] T d771b2d03cb940018a706ecc38f68a9e P 56388bef1a0f453cadc8b6aa9434311d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 934, Committed index: 934, Last appended: 1.934, Last appended by leader: 934, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 702 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } }
I20260810 01:57:45.697026 27006 raft_consensus.cc:3060] T d771b2d03cb940018a706ecc38f68a9e P 56388bef1a0f453cadc8b6aa9434311d [term 1 FOLLOWER]: Advancing to term 2
I20260810 01:57:45.710602 26453 catalog_manager.cc:5719] T d771b2d03cb940018a706ecc38f68a9e P 07e0a39216984856b2ff8c512c4c2f93 reported cstate change: term changed from 1 to 2, leader changed from 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195) to 07e0a39216984856b2ff8c512c4c2f93 (127.21.64.199). New cstate: current_term: 2 leader_uuid: "07e0a39216984856b2ff8c512c4c2f93" committed_config { opid_index: 702 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } }
W20260810 01:57:45.711843 26941 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59534: Illegal state: replica 56388bef1a0f453cadc8b6aa9434311d is not leader of this config: current role FOLLOWER
I20260810 01:57:45.712688 27006 raft_consensus.cc:2468] T d771b2d03cb940018a706ecc38f68a9e P 56388bef1a0f453cadc8b6aa9434311d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07e0a39216984856b2ff8c512c4c2f93 in term 2.
W20260810 01:57:45.909765 26772 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46490: Illegal state: replica 60d4538b78b44201964cf440ea562c72 is not leader of this config: current role FOLLOWER
W20260810 01:57:45.947271 26941 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59534: Illegal state: replica 56388bef1a0f453cadc8b6aa9434311d is not leader of this config: current role FOLLOWER
W20260810 01:57:45.977268 26772 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46490: Illegal state: replica 60d4538b78b44201964cf440ea562c72 is not leader of this config: current role FOLLOWER
I20260810 01:57:46.044462 26830 raft_consensus.cc:1275] T d771b2d03cb940018a706ecc38f68a9e P 60d4538b78b44201964cf440ea562c72 [term 2 FOLLOWER]: Refusing update from remote peer 07e0a39216984856b2ff8c512c4c2f93: Log matching property violated. Preceding OpId in replica: term: 1 index: 934. Preceding OpId from leader: term: 2 index: 936. (index mismatch)
I20260810 01:57:46.045199 504 consensus_queue.cc:1048] T d771b2d03cb940018a706ecc38f68a9e P 07e0a39216984856b2ff8c512c4c2f93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 935, Last known committed idx: 934, Time since last communication: 0.000s
I20260810 01:57:46.053169 27003 raft_consensus.cc:1275] T d771b2d03cb940018a706ecc38f68a9e P 56388bef1a0f453cadc8b6aa9434311d [term 2 FOLLOWER]: Refusing update from remote peer 07e0a39216984856b2ff8c512c4c2f93: Log matching property violated. Preceding OpId in replica: term: 1 index: 934. Preceding OpId from leader: term: 2 index: 936. (index mismatch)
I20260810 01:57:46.054081 504 consensus_queue.cc:1048] T d771b2d03cb940018a706ecc38f68a9e P 07e0a39216984856b2ff8c512c4c2f93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 935, Last known committed idx: 934, Time since last communication: 0.000s
I20260810 01:57:46.437362 26806 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:57:46.440384 28916 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:57:46.491268 28739 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:57:46.516403 28379 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:57:46.545308 26634 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:57:46.579308 26976 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 01:57:46.787343 28563 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
W20260810 01:57:46.787711 26914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.198:41745, user_credentials={real_user=slave}} blocked reactor thread for 148487us
I20260810 01:57:48.059384 28941 consensus_queue.cc:237] T d771b2d03cb940018a706ecc38f68a9e P 07e0a39216984856b2ff8c512c4c2f93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 947, Committed index: 947, Last appended: 2.947, Last appended by leader: 934, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 948 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } }
I20260810 01:57:48.061591 26830 raft_consensus.cc:1275] T d771b2d03cb940018a706ecc38f68a9e P 60d4538b78b44201964cf440ea562c72 [term 2 FOLLOWER]: Refusing update from remote peer 07e0a39216984856b2ff8c512c4c2f93: Log matching property violated. Preceding OpId in replica: term: 2 index: 947. Preceding OpId from leader: term: 2 index: 948. (index mismatch)
I20260810 01:57:48.062259 583 consensus_queue.cc:1048] T d771b2d03cb940018a706ecc38f68a9e P 07e0a39216984856b2ff8c512c4c2f93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 948, Last known committed idx: 947, Time since last communication: 0.000s
I20260810 01:57:48.065496 583 raft_consensus.cc:2955] T d771b2d03cb940018a706ecc38f68a9e P 07e0a39216984856b2ff8c512c4c2f93 [term 2 LEADER]: Committing config change with OpId 2.948: config changed from index 702 to 948, VOTER 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195) evicted. New config: { opid_index: 948 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } }
I20260810 01:57:48.070187 26833 raft_consensus.cc:2955] T d771b2d03cb940018a706ecc38f68a9e P 60d4538b78b44201964cf440ea562c72 [term 2 FOLLOWER]: Committing config change with OpId 2.948: config changed from index 702 to 948, VOTER 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195) evicted. New config: { opid_index: 948 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } }
I20260810 01:57:48.081955 26470 catalog_manager.cc:5719] T d771b2d03cb940018a706ecc38f68a9e P 60d4538b78b44201964cf440ea562c72 reported cstate change: config changed from index 702 to 948, VOTER 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195) evicted. New cstate: current_term: 2 leader_uuid: "07e0a39216984856b2ff8c512c4c2f93" committed_config { opid_index: 948 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } }
I20260810 01:57:48.309248 26976 tablet_service.cc:1558] Processing DeleteTablet for tablet d771b2d03cb940018a706ecc38f68a9e with delete_type TABLET_DATA_TOMBSTONED (TS 56388bef1a0f453cadc8b6aa9434311d not found in new config with opid_index 948) from {username='slave'} at 127.0.0.1:39126
I20260810 01:57:48.551367 641 tablet_replica.cc:333] T d771b2d03cb940018a706ecc38f68a9e P 56388bef1a0f453cadc8b6aa9434311d: stopping tablet replica
I20260810 01:57:48.551641 641 raft_consensus.cc:2243] T d771b2d03cb940018a706ecc38f68a9e P 56388bef1a0f453cadc8b6aa9434311d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260810 01:57:48.551836 641 pending_rounds.cc:70] T d771b2d03cb940018a706ecc38f68a9e P 56388bef1a0f453cadc8b6aa9434311d: Trying to abort 1 pending ops.
I20260810 01:57:48.552165 641 pending_rounds.cc:77] T d771b2d03cb940018a706ecc38f68a9e P 56388bef1a0f453cadc8b6aa9434311d: Aborting op as it isn't in flight: id { term: 2 index: 947 } timestamp: 7316795670656843776 op_type: WRITE_OP write_request { tablet_id: "d771b2d03cb940018a706ecc38f68a9e" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\007\000\364GM/\256\330>v\000\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000" indirect_data: "<redacted>""8fa19534f2956387" } external_consistency_mode: CLIENT_PROPAGATED propagated_timestamp: 7316795670411001856 authz_token { token_data: "\010\371\341\344\323\006\"3\n\005slave\022*\n 165a82ad66824212a25d38b164e619d1\020\001\030\001 \001(\001" signature: "<redacted>""O\217\356\275h\332\240^.\004\003\316)\274U\303\232\276\026[\223\360\347I\023i\363\225\302\003y\333jIO&b\'\203\373\000\354\005A\202\355\263&\001\3469\310K\n\r\000^\331\372\222\363\025T\233" signing_key_seq_num: 0 } } request_id { client_id: "7cb02dc5ab1c401a870cbc3d50f91860" seq_no: 2847 first_incomplete_seq_no: 2847 attempt_no: 0 }
I20260810 01:57:48.552820 641 raft_consensus.cc:2272] T d771b2d03cb940018a706ecc38f68a9e P 56388bef1a0f453cadc8b6aa9434311d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260810 01:57:48.582090 641 ts_tablet_manager.cc:1916] T d771b2d03cb940018a706ecc38f68a9e P 56388bef1a0f453cadc8b6aa9434311d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:57:48.671655 641 ts_tablet_manager.cc:1929] T d771b2d03cb940018a706ecc38f68a9e P 56388bef1a0f453cadc8b6aa9434311d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.947
I20260810 01:57:48.671833 641 log.cc:1199] T d771b2d03cb940018a706ecc38f68a9e P 56388bef1a0f453cadc8b6aa9434311d: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/wal/wals/d771b2d03cb940018a706ecc38f68a9e
I20260810 01:57:48.675732 26445 catalog_manager.cc:5050] TS 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195:45355): tablet d771b2d03cb940018a706ecc38f68a9e (table rebalance_test_table_3 [id=165a82ad66824212a25d38b164e619d1]) successfully deleted
W20260810 01:57:48.996507 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.197:46107, user_credentials={real_user=slave}} blocked reactor thread for 44428.9us
I20260810 01:57:49.721614 28379 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:57:49.750998 28916 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:57:49.763291 28739 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:57:49.790238 26976 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 01:57:49.808032 26806 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:57:49.863718 26634 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:57:49.871034 28563 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
W20260810 01:57:49.879956 26744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.199:42747, user_credentials={real_user=slave}} blocked reactor thread for 44582.8us
I20260810 01:57:50.552868 26833 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f7860cf1d8449fc9f062f3e09e4aafd"
dest_uuid: "60d4538b78b44201964cf440ea562c72"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:46524
I20260810 01:57:50.553138 26833 raft_consensus.cc:606] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72 [term 1 LEADER]: Received request to transfer leadership
W20260810 01:57:50.726351 26776 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50998: Service unavailable: leader transfer in progress
W20260810 01:57:50.729791 26776 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50998: Service unavailable: leader transfer in progress
W20260810 01:57:50.735495 26776 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50998: Service unavailable: leader transfer in progress
W20260810 01:57:50.744620 26776 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50998: Service unavailable: leader transfer in progress
W20260810 01:57:50.754460 26776 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50998: Service unavailable: leader transfer in progress
W20260810 01:57:50.762871 26776 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50998: Service unavailable: leader transfer in progress
W20260810 01:57:50.771844 26776 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50998: Service unavailable: leader transfer in progress
W20260810 01:57:50.780632 29041 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.21.64.199:42747, user_credentials={real_user=slave}} blocked reactor thread for 43809.8us
W20260810 01:57:50.790886 26776 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50998: Service unavailable: leader transfer in progress
W20260810 01:57:50.806197 26776 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50998: Service unavailable: leader transfer in progress
W20260810 01:57:50.819572 26776 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50998: Service unavailable: leader transfer in progress
W20260810 01:57:50.844486 26776 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50998: Service unavailable: leader transfer in progress
W20260810 01:57:50.860391 26772 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50998: Service unavailable: leader transfer in progress
W20260810 01:57:50.877080 26776 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50998: Service unavailable: leader transfer in progress
W20260810 01:57:50.896036 26776 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50998: Service unavailable: leader transfer in progress
W20260810 01:57:50.912672 26776 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50998: Service unavailable: leader transfer in progress
W20260810 01:57:50.934429 26776 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50998: Service unavailable: leader transfer in progress
I20260810 01:57:50.939935 584 raft_consensus.cc:993] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72: : Instructing follower 28812b178f824d539cab11abfe98d77d to start an election
I20260810 01:57:50.940171 584 raft_consensus.cc:1081] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72 [term 1 LEADER]: Signalling peer 28812b178f824d539cab11abfe98d77d to start an election
I20260810 01:57:50.941191 28410 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4f7860cf1d8449fc9f062f3e09e4aafd"
dest_uuid: "28812b178f824d539cab11abfe98d77d"
from {username='slave'} at 127.21.64.194:42003
I20260810 01:57:50.941496 28410 raft_consensus.cc:493] T 4f7860cf1d8449fc9f062f3e09e4aafd P 28812b178f824d539cab11abfe98d77d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260810 01:57:50.941640 28410 raft_consensus.cc:3060] T 4f7860cf1d8449fc9f062f3e09e4aafd P 28812b178f824d539cab11abfe98d77d [term 1 FOLLOWER]: Advancing to term 2
I20260810 01:57:50.947491 28410 raft_consensus.cc:515] T 4f7860cf1d8449fc9f062f3e09e4aafd P 28812b178f824d539cab11abfe98d77d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 795 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } }
W20260810 01:57:50.952858 26776 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50998: Service unavailable: leader transfer in progress
I20260810 01:57:50.960980 28769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7860cf1d8449fc9f062f3e09e4aafd" candidate_uuid: "28812b178f824d539cab11abfe98d77d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1146 } } ignore_live_leader: true dest_uuid: "9353b63b4d854d23b51a8103bc899aab"
I20260810 01:57:50.961406 28769 raft_consensus.cc:3060] T 4f7860cf1d8449fc9f062f3e09e4aafd P 9353b63b4d854d23b51a8103bc899aab [term 1 FOLLOWER]: Advancing to term 2
I20260810 01:57:50.963042 26833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7860cf1d8449fc9f062f3e09e4aafd" candidate_uuid: "28812b178f824d539cab11abfe98d77d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1146 } } ignore_live_leader: true dest_uuid: "60d4538b78b44201964cf440ea562c72"
I20260810 01:57:50.963295 26833 raft_consensus.cc:3055] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72 [term 1 LEADER]: Stepping down as leader of term 1
I20260810 01:57:50.963395 26833 raft_consensus.cc:740] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 60d4538b78b44201964cf440ea562c72, State: Running, Role: LEADER
I20260810 01:57:50.964521 26833 consensus_queue.cc:260] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1146, Committed index: 1146, Last appended: 1.1146, Last appended by leader: 1146, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 795 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } }
I20260810 01:57:50.964982 26833 raft_consensus.cc:3060] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72 [term 1 FOLLOWER]: Advancing to term 2
I20260810 01:57:50.965679 28769 raft_consensus.cc:2468] T 4f7860cf1d8449fc9f062f3e09e4aafd P 9353b63b4d854d23b51a8103bc899aab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28812b178f824d539cab11abfe98d77d in term 2.
I20260810 01:57:50.966701 28317 leader_election.cc:304] T 4f7860cf1d8449fc9f062f3e09e4aafd P 28812b178f824d539cab11abfe98d77d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28812b178f824d539cab11abfe98d77d, 9353b63b4d854d23b51a8103bc899aab; no voters:
I20260810 01:57:50.967056 503 raft_consensus.cc:2804] T 4f7860cf1d8449fc9f062f3e09e4aafd P 28812b178f824d539cab11abfe98d77d [term 2 FOLLOWER]: Leader election won for term 2
I20260810 01:57:50.967211 503 raft_consensus.cc:697] T 4f7860cf1d8449fc9f062f3e09e4aafd P 28812b178f824d539cab11abfe98d77d [term 2 LEADER]: Becoming Leader. State: Replica: 28812b178f824d539cab11abfe98d77d, State: Running, Role: LEADER
I20260810 01:57:50.967499 503 consensus_queue.cc:237] T 4f7860cf1d8449fc9f062f3e09e4aafd P 28812b178f824d539cab11abfe98d77d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1146, Committed index: 1146, Last appended: 1.1146, Last appended by leader: 1146, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 795 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } }
I20260810 01:57:50.971109 26466 catalog_manager.cc:5719] T 4f7860cf1d8449fc9f062f3e09e4aafd P 28812b178f824d539cab11abfe98d77d reported cstate change: term changed from 1 to 2, leader changed from 60d4538b78b44201964cf440ea562c72 (127.21.64.194) to 28812b178f824d539cab11abfe98d77d (127.21.64.196). New cstate: current_term: 2 leader_uuid: "28812b178f824d539cab11abfe98d77d" committed_config { opid_index: 795 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } } }
I20260810 01:57:50.971903 28410 leader_election.cc:290] T 4f7860cf1d8449fc9f062f3e09e4aafd P 28812b178f824d539cab11abfe98d77d [CANDIDATE]: Term 2 election: Requested vote from peers 60d4538b78b44201964cf440ea562c72 (127.21.64.194:36943), 9353b63b4d854d23b51a8103bc899aab (127.21.64.198:41745)
W20260810 01:57:50.975483 26772 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50998: Illegal state: replica 60d4538b78b44201964cf440ea562c72 is not leader of this config: current role FOLLOWER
I20260810 01:57:50.992095 26833 raft_consensus.cc:2468] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28812b178f824d539cab11abfe98d77d in term 2.
I20260810 01:57:51.175122 26833 raft_consensus.cc:1275] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72 [term 2 FOLLOWER]: Refusing update from remote peer 28812b178f824d539cab11abfe98d77d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1146. Preceding OpId from leader: term: 2 index: 1148. (index mismatch)
I20260810 01:57:51.175876 372 consensus_queue.cc:1048] T 4f7860cf1d8449fc9f062f3e09e4aafd P 28812b178f824d539cab11abfe98d77d [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1147, Last known committed idx: 1146, Time since last communication: 0.000s
I20260810 01:57:51.191426 28768 raft_consensus.cc:1275] T 4f7860cf1d8449fc9f062f3e09e4aafd P 9353b63b4d854d23b51a8103bc899aab [term 2 FOLLOWER]: Refusing update from remote peer 28812b178f824d539cab11abfe98d77d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1146. Preceding OpId from leader: term: 2 index: 1148. (index mismatch)
I20260810 01:57:51.192149 372 consensus_queue.cc:1048] T 4f7860cf1d8449fc9f062f3e09e4aafd P 28812b178f824d539cab11abfe98d77d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1147, Last known committed idx: 1146, Time since last communication: 0.000s
I20260810 01:57:51.462430 28916 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:57:51.495339 28379 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:57:51.615104 26976 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 01:57:51.616971 26806 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 01:57:51.681524 28563 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:57:51.757771 28739 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:57:51.803156 26634 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:57:52.583973 28407 consensus_queue.cc:237] T 4f7860cf1d8449fc9f062f3e09e4aafd P 28812b178f824d539cab11abfe98d77d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1173, Committed index: 1173, Last appended: 2.1173, Last appended by leader: 1146, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1174 OBSOLETE_local: false peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } }
I20260810 01:57:52.597820 28766 raft_consensus.cc:1275] T 4f7860cf1d8449fc9f062f3e09e4aafd P 9353b63b4d854d23b51a8103bc899aab [term 2 FOLLOWER]: Refusing update from remote peer 28812b178f824d539cab11abfe98d77d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1172. Preceding OpId from leader: term: 2 index: 1174. (index mismatch)
I20260810 01:57:52.601104 808 consensus_queue.cc:1048] T 4f7860cf1d8449fc9f062f3e09e4aafd P 28812b178f824d539cab11abfe98d77d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1174, Last known committed idx: 1171, Time since last communication: 0.000s
I20260810 01:57:52.608309 503 raft_consensus.cc:2955] T 4f7860cf1d8449fc9f062f3e09e4aafd P 28812b178f824d539cab11abfe98d77d [term 2 LEADER]: Committing config change with OpId 2.1174: config changed from index 795 to 1174, VOTER 60d4538b78b44201964cf440ea562c72 (127.21.64.194) evicted. New config: { opid_index: 1174 OBSOLETE_local: false peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } } }
I20260810 01:57:52.608971 28769 raft_consensus.cc:2955] T 4f7860cf1d8449fc9f062f3e09e4aafd P 9353b63b4d854d23b51a8103bc899aab [term 2 FOLLOWER]: Committing config change with OpId 2.1174: config changed from index 795 to 1174, VOTER 60d4538b78b44201964cf440ea562c72 (127.21.64.194) evicted. New config: { opid_index: 1174 OBSOLETE_local: false peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } } }
I20260810 01:57:52.614363 26470 catalog_manager.cc:5719] T 4f7860cf1d8449fc9f062f3e09e4aafd P 28812b178f824d539cab11abfe98d77d reported cstate change: config changed from index 795 to 1174, VOTER 60d4538b78b44201964cf440ea562c72 (127.21.64.194) evicted. New cstate: current_term: 2 leader_uuid: "28812b178f824d539cab11abfe98d77d" committed_config { opid_index: 1174 OBSOLETE_local: false peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } } }
I20260810 01:57:52.708910 26806 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f7860cf1d8449fc9f062f3e09e4aafd with delete_type TABLET_DATA_TOMBSTONED (TS 60d4538b78b44201964cf440ea562c72 not found in new config with opid_index 1174) from {username='slave'} at 127.0.0.1:59826
I20260810 01:57:52.728499 884 tablet_replica.cc:333] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72: stopping tablet replica
I20260810 01:57:52.728817 884 raft_consensus.cc:2243] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260810 01:57:52.729946 884 raft_consensus.cc:2272] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260810 01:57:52.762463 884 ts_tablet_manager.cc:1916] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:57:52.795907 884 ts_tablet_manager.cc:1929] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.1173
I20260810 01:57:52.796103 884 log.cc:1199] T 4f7860cf1d8449fc9f062f3e09e4aafd P 60d4538b78b44201964cf440ea562c72: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal/wals/4f7860cf1d8449fc9f062f3e09e4aafd
I20260810 01:57:52.802847 26442 catalog_manager.cc:5050] TS 60d4538b78b44201964cf440ea562c72 (127.21.64.194:36943): tablet 4f7860cf1d8449fc9f062f3e09e4aafd (table rebalance_test_table_4 [id=b8ab0a3e55d1493fb5fc271a33432c29]) successfully deleted
I20260810 01:57:53.716789 28379 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:57:53.728009 26976 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 01:57:53.813632 28916 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:57:53.884454 28563 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:57:53.914369 28739 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260810 01:57:53.934134 26745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.198:41745, user_credentials={real_user=slave}} blocked reactor thread for 73215.8us
I20260810 01:57:53.959534 26806 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 01:57:54.001909 26634 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:57:54.476382 27004 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b10c8ac173fc40ca9817d1b654117ca1"
dest_uuid: "56388bef1a0f453cadc8b6aa9434311d"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:45980
I20260810 01:57:54.476641 27004 raft_consensus.cc:606] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d [term 1 LEADER]: Received request to transfer leadership
W20260810 01:57:54.489756 26943 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59518: Service unavailable: leader transfer in progress
W20260810 01:57:54.492835 26943 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59518: Service unavailable: leader transfer in progress
W20260810 01:57:54.499744 26943 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59518: Service unavailable: leader transfer in progress
W20260810 01:57:54.505883 26943 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59518: Service unavailable: leader transfer in progress
W20260810 01:57:54.518285 26943 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59518: Service unavailable: leader transfer in progress
W20260810 01:57:54.533859 26943 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59518: Service unavailable: leader transfer in progress
W20260810 01:57:54.550222 26943 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59518: Service unavailable: leader transfer in progress
W20260810 01:57:54.580535 26943 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59518: Service unavailable: leader transfer in progress
W20260810 01:57:54.595844 26943 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59518: Service unavailable: leader transfer in progress
W20260810 01:57:54.619534 26943 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59518: Service unavailable: leader transfer in progress
W20260810 01:57:54.652103 26943 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59518: Service unavailable: leader transfer in progress
W20260810 01:57:54.669515 26943 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59518: Service unavailable: leader transfer in progress
W20260810 01:57:54.701017 26943 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59518: Service unavailable: leader transfer in progress
W20260810 01:57:54.729290 26943 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59518: Service unavailable: leader transfer in progress
W20260810 01:57:54.752731 26943 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59518: Service unavailable: leader transfer in progress
W20260810 01:57:54.777901 26943 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59518: Service unavailable: leader transfer in progress
W20260810 01:57:54.812387 26943 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59518: Service unavailable: leader transfer in progress
I20260810 01:57:54.824266 652 raft_consensus.cc:993] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d: : Instructing follower 9353b63b4d854d23b51a8103bc899aab to start an election
I20260810 01:57:54.824522 652 raft_consensus.cc:1081] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d [term 1 LEADER]: Signalling peer 9353b63b4d854d23b51a8103bc899aab to start an election
I20260810 01:57:54.826658 28769 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b10c8ac173fc40ca9817d1b654117ca1"
dest_uuid: "9353b63b4d854d23b51a8103bc899aab"
from {username='slave'} at 127.21.64.195:57109
I20260810 01:57:54.827080 28769 raft_consensus.cc:493] T b10c8ac173fc40ca9817d1b654117ca1 P 9353b63b4d854d23b51a8103bc899aab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260810 01:57:54.827908 28769 raft_consensus.cc:3060] T b10c8ac173fc40ca9817d1b654117ca1 P 9353b63b4d854d23b51a8103bc899aab [term 1 FOLLOWER]: Advancing to term 2
W20260810 01:57:54.836228 26941 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59518: Service unavailable: leader transfer in progress
I20260810 01:57:54.862003 28769 raft_consensus.cc:515] T b10c8ac173fc40ca9817d1b654117ca1 P 9353b63b4d854d23b51a8103bc899aab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 752 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } }
W20260810 01:57:54.877458 26943 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59518: Service unavailable: leader transfer in progress
W20260810 01:57:54.902951 26941 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59518: Service unavailable: leader transfer in progress
I20260810 01:57:54.915484 28769 leader_election.cc:290] T b10c8ac173fc40ca9817d1b654117ca1 P 9353b63b4d854d23b51a8103bc899aab [CANDIDATE]: Term 2 election: Requested vote from peers 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195:45355), 8be4ab1c5cca41849942448806160d19 (127.21.64.197:46107)
I20260810 01:57:54.915764 27003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b10c8ac173fc40ca9817d1b654117ca1" candidate_uuid: "9353b63b4d854d23b51a8103bc899aab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1094 } } ignore_live_leader: true dest_uuid: "56388bef1a0f453cadc8b6aa9434311d"
I20260810 01:57:54.916055 27003 raft_consensus.cc:3055] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d [term 1 LEADER]: Stepping down as leader of term 1
I20260810 01:57:54.916203 27003 raft_consensus.cc:740] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56388bef1a0f453cadc8b6aa9434311d, State: Running, Role: LEADER
I20260810 01:57:54.916632 27003 consensus_queue.cc:260] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1094, Committed index: 1094, Last appended: 1.1094, Last appended by leader: 1094, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 752 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } }
I20260810 01:57:54.917021 27003 raft_consensus.cc:3060] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d [term 1 FOLLOWER]: Advancing to term 2
I20260810 01:57:54.926182 27003 raft_consensus.cc:2468] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9353b63b4d854d23b51a8103bc899aab in term 2.
W20260810 01:57:54.929899 26941 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59518: Illegal state: replica 56388bef1a0f453cadc8b6aa9434311d is not leader of this config: current role FOLLOWER
I20260810 01:57:54.954346 28677 leader_election.cc:304] T b10c8ac173fc40ca9817d1b654117ca1 P 9353b63b4d854d23b51a8103bc899aab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56388bef1a0f453cadc8b6aa9434311d, 9353b63b4d854d23b51a8103bc899aab; no voters:
I20260810 01:57:54.988315 1002 raft_consensus.cc:2804] T b10c8ac173fc40ca9817d1b654117ca1 P 9353b63b4d854d23b51a8103bc899aab [term 2 FOLLOWER]: Leader election won for term 2
W20260810 01:57:55.019315 28677 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.64.195:45355, user_credentials={real_user=slave}} blocked reactor thread for 65049us
I20260810 01:57:55.022102 1002 raft_consensus.cc:697] T b10c8ac173fc40ca9817d1b654117ca1 P 9353b63b4d854d23b51a8103bc899aab [term 2 LEADER]: Becoming Leader. State: Replica: 9353b63b4d854d23b51a8103bc899aab, State: Running, Role: LEADER
I20260810 01:57:55.023985 1002 consensus_queue.cc:237] T b10c8ac173fc40ca9817d1b654117ca1 P 9353b63b4d854d23b51a8103bc899aab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1094, Committed index: 1094, Last appended: 1.1094, Last appended by leader: 1094, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 752 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } }
I20260810 01:57:55.046888 26470 catalog_manager.cc:5719] T b10c8ac173fc40ca9817d1b654117ca1 P 9353b63b4d854d23b51a8103bc899aab reported cstate change: term changed from 1 to 2, leader changed from 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195) to 9353b63b4d854d23b51a8103bc899aab (127.21.64.198). New cstate: current_term: 2 leader_uuid: "9353b63b4d854d23b51a8103bc899aab" committed_config { opid_index: 752 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } } }
I20260810 01:57:55.049549 28586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b10c8ac173fc40ca9817d1b654117ca1" candidate_uuid: "9353b63b4d854d23b51a8103bc899aab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1094 } } ignore_live_leader: true dest_uuid: "8be4ab1c5cca41849942448806160d19"
I20260810 01:57:55.050016 28586 raft_consensus.cc:3060] T b10c8ac173fc40ca9817d1b654117ca1 P 8be4ab1c5cca41849942448806160d19 [term 1 FOLLOWER]: Advancing to term 2
I20260810 01:57:55.099716 28586 raft_consensus.cc:2468] T b10c8ac173fc40ca9817d1b654117ca1 P 8be4ab1c5cca41849942448806160d19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9353b63b4d854d23b51a8103bc899aab in term 2.
W20260810 01:57:55.198850 26941 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59518: Illegal state: replica 56388bef1a0f453cadc8b6aa9434311d is not leader of this config: current role FOLLOWER
W20260810 01:57:55.260188 28528 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:52594: Illegal state: replica 8be4ab1c5cca41849942448806160d19 is not leader of this config: current role FOLLOWER
I20260810 01:57:55.411809 28586 raft_consensus.cc:1275] T b10c8ac173fc40ca9817d1b654117ca1 P 8be4ab1c5cca41849942448806160d19 [term 2 FOLLOWER]: Refusing update from remote peer 9353b63b4d854d23b51a8103bc899aab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1094. Preceding OpId from leader: term: 2 index: 1096. (index mismatch)
I20260810 01:57:55.412974 1009 consensus_queue.cc:1048] T b10c8ac173fc40ca9817d1b654117ca1 P 9353b63b4d854d23b51a8103bc899aab [LEADER]: Connected to new peer: Peer: permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1095, Last known committed idx: 1094, Time since last communication: 0.000s
I20260810 01:57:55.413883 27004 raft_consensus.cc:1275] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d [term 2 FOLLOWER]: Refusing update from remote peer 9353b63b4d854d23b51a8103bc899aab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1094. Preceding OpId from leader: term: 2 index: 1096. (index mismatch)
I20260810 01:57:55.433419 1009 consensus_queue.cc:1048] T b10c8ac173fc40ca9817d1b654117ca1 P 9353b63b4d854d23b51a8103bc899aab [LEADER]: Connected to new peer: Peer: permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1095, Last known committed idx: 1094, Time since last communication: 0.000s
I20260810 01:57:55.746032 28916 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:57:55.788791 28379 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:57:55.846946 26806 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 01:57:55.853906 26976 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:57:55.920328 28739 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:57:55.964609 28563 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:57:56.037263 26634 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:57:57.076896 28769 consensus_queue.cc:237] T b10c8ac173fc40ca9817d1b654117ca1 P 9353b63b4d854d23b51a8103bc899aab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1113, Committed index: 1113, Last appended: 2.1113, Last appended by leader: 1094, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1114 OBSOLETE_local: false peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } }
I20260810 01:57:57.092327 28582 raft_consensus.cc:1275] T b10c8ac173fc40ca9817d1b654117ca1 P 8be4ab1c5cca41849942448806160d19 [term 2 FOLLOWER]: Refusing update from remote peer 9353b63b4d854d23b51a8103bc899aab: Log matching property violated. Preceding OpId in replica: term: 2 index: 1113. Preceding OpId from leader: term: 2 index: 1114. (index mismatch)
I20260810 01:57:57.099184 1009 consensus_queue.cc:1048] T b10c8ac173fc40ca9817d1b654117ca1 P 9353b63b4d854d23b51a8103bc899aab [LEADER]: Connected to new peer: Peer: permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1114, Last known committed idx: 1113, Time since last communication: 0.000s
I20260810 01:57:57.105116 1032 raft_consensus.cc:2955] T b10c8ac173fc40ca9817d1b654117ca1 P 9353b63b4d854d23b51a8103bc899aab [term 2 LEADER]: Committing config change with OpId 2.1114: config changed from index 752 to 1114, VOTER 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195) evicted. New config: { opid_index: 1114 OBSOLETE_local: false peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } } }
I20260810 01:57:57.114032 28584 raft_consensus.cc:2955] T b10c8ac173fc40ca9817d1b654117ca1 P 8be4ab1c5cca41849942448806160d19 [term 2 FOLLOWER]: Committing config change with OpId 2.1114: config changed from index 752 to 1114, VOTER 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195) evicted. New config: { opid_index: 1114 OBSOLETE_local: false peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } } }
I20260810 01:57:57.117704 26466 catalog_manager.cc:5719] T b10c8ac173fc40ca9817d1b654117ca1 P 9353b63b4d854d23b51a8103bc899aab reported cstate change: config changed from index 752 to 1114, VOTER 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195) evicted. New cstate: current_term: 2 leader_uuid: "9353b63b4d854d23b51a8103bc899aab" committed_config { opid_index: 1114 OBSOLETE_local: false peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } } }
I20260810 01:57:57.278472 26976 tablet_service.cc:1558] Processing DeleteTablet for tablet b10c8ac173fc40ca9817d1b654117ca1 with delete_type TABLET_DATA_TOMBSTONED (TS 56388bef1a0f453cadc8b6aa9434311d not found in new config with opid_index 1114) from {username='slave'} at 127.0.0.1:39126
I20260810 01:57:57.300948 1157 tablet_replica.cc:333] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d: stopping tablet replica
I20260810 01:57:57.301975 1157 raft_consensus.cc:2243] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260810 01:57:57.302888 1157 raft_consensus.cc:2272] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260810 01:57:57.305253 1157 ts_tablet_manager.cc:1916] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:57:57.354897 1157 ts_tablet_manager.cc:1929] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.1113
I20260810 01:57:57.355928 1157 log.cc:1199] T b10c8ac173fc40ca9817d1b654117ca1 P 56388bef1a0f453cadc8b6aa9434311d: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/wal/wals/b10c8ac173fc40ca9817d1b654117ca1
I20260810 01:57:57.358357 26445 catalog_manager.cc:5050] TS 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195:45355): tablet b10c8ac173fc40ca9817d1b654117ca1 (table rebalance_test_table_1 [id=bdbf5b2bb6b04aa9baa11723c241453d]) successfully deleted
W20260810 01:57:57.493427 28850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.194:36943, user_credentials={real_user=slave}} blocked reactor thread for 67023.5us
I20260810 01:57:59.091995 28916 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:57:59.176604 28563 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:57:59.214252 26976 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:57:59.320365 28379 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:57:59.320801 26806 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 01:57:59.328624 28739 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:57:59.397424 26634 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
W20260810 01:58:00.609484 26574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.197:46107, user_credentials={real_user=slave}} blocked reactor thread for 59575.6us
W20260810 01:58:00.610831 26577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.198:41745, user_credentials={real_user=slave}} blocked reactor thread for 53573.2us
I20260810 01:58:00.693583 28916 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:00.822705 26976 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:00.852741 28379 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:00.909179 28739 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:58:00.925596 26806 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 01:58:00.955731 28563 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:58:00.956225 26634 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
W20260810 01:58:01.304045 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.197:46107, user_credentials={real_user=slave}} blocked reactor thread for 45141.5us
I20260810 01:58:03.964689 28916 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:03.970386 28379 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:04.004601 26806 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 01:58:04.009915 26976 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:04.045660 26634 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:58:04.067436 28563 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:58:04.280634 28739 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
W20260810 01:58:04.921583 28495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.195:45355, user_credentials={real_user=slave}} blocked reactor thread for 103792us
I20260810 01:58:06.170218 28916 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:06.204195 28379 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:06.291021 26976 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
W20260810 01:58:06.346551 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.197:46107, user_credentials={real_user=slave}} blocked reactor thread for 296007us
I20260810 01:58:06.372891 26806 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 01:58:06.690069 28563 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:58:06.749967 28739 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:58:06.751082 26634 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
W20260810 01:58:06.899072 28852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.195:45355, user_credentials={real_user=slave}} blocked reactor thread for 57118.7us
W20260810 01:58:07.099113 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.199:42747, user_credentials={real_user=slave}} blocked reactor thread for 64664.3us
I20260810 01:58:07.944063 26976 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:07.956674 28379 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:07.957254 26634 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:58:07.957840 26806 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 01:58:07.959791 28916 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:07.982486 28563 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:58:07.987222 28739 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+---------------------+---------
c7a6ab8e5a4c4f8a98fa2c3426f0ed8f | 127.21.64.254:38173 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------+-------------------------
allow_unsafe_replication_factor | true | runtime,unsafe | all 1 server(s) checked
ipki_ca_key_size | 768 | experimental | all 1 server(s) checked
ipki_server_key_size | 768 | experimental | all 1 server(s) checked
never_fsync | true | unsafe,advanced | all 1 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 1 server(s) checked
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 1 server(s) checked
rpc_reuseport | true | experimental | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
server_dump_info_format | pb | hidden | all 1 server(s) checked
server_dump_info_path | /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/data/info.pb | hidden | all 1 server(s) checked
tsk_num_rsa_bits | 512 | experimental | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+---------------------+-------------------------
builtin_ntp_servers | 127.21.64.212:42671 | all 1 server(s) checked
time_source | builtin | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+---------------------+---------+----------+----------------+-----------------
07e0a39216984856b2ff8c512c4c2f93 | 127.21.64.199:42747 | HEALTHY | <none> | 2 | 0
28812b178f824d539cab11abfe98d77d | 127.21.64.196:41095 | HEALTHY | <none> | 2 | 0
56388bef1a0f453cadc8b6aa9434311d | 127.21.64.195:45355 | HEALTHY | <none> | 2 | 0
60d4538b78b44201964cf440ea562c72 | 127.21.64.194:36943 | HEALTHY | <none> | 3 | 0
8be4ab1c5cca41849942448806160d19 | 127.21.64.197:46107 | HEALTHY | <none> | 1 | 0
9353b63b4d854d23b51a8103bc899aab | 127.21.64.198:41745 | HEALTHY | <none> | 1 | 0
a46364d7cd504f8ca7fc003c59ae6d31 | 127.21.64.193:45781 | HEALTHY | <none> | 5 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 7
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------+-------------------------
ipki_server_key_size | 768 | experimental | all 7 server(s) checked
local_ip_for_outbound_sockets | 127.21.64.193 | experimental | 127.21.64.193:45781
local_ip_for_outbound_sockets | 127.21.64.194 | experimental | 127.21.64.194:36943
local_ip_for_outbound_sockets | 127.21.64.195 | experimental | 127.21.64.195:45355
local_ip_for_outbound_sockets | 127.21.64.196 | experimental | 127.21.64.196:41095
local_ip_for_outbound_sockets | 127.21.64.197 | experimental | 127.21.64.197:46107
local_ip_for_outbound_sockets | 127.21.64.198 | experimental | 127.21.64.198:41745
local_ip_for_outbound_sockets | 127.21.64.199 | experimental | 127.21.64.199:42747
never_fsync | true | unsafe,advanced | all 7 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 7 server(s) checked
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 7 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 7 server(s) checked
server_dump_info_format | pb | hidden | all 7 server(s) checked
server_dump_info_path | /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/data/info.pb | hidden | 127.21.64.193:45781
server_dump_info_path | /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/data/info.pb | hidden | 127.21.64.194:36943
server_dump_info_path | /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/data/info.pb | hidden | 127.21.64.195:45355
server_dump_info_path | /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/data/info.pb | hidden | 127.21.64.196:41095
server_dump_info_path | /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data/info.pb | hidden | 127.21.64.197:46107
server_dump_info_path | /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/data/info.pb | hidden | 127.21.64.198:41745
server_dump_info_path | /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/data/info.pb | hidden | 127.21.64.199:42747
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+---------------------+-------------------------
builtin_ntp_servers | 127.21.64.212:42671 | all 7 server(s) checked
time_source | builtin | all 7 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 8 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
------------------------+----+---------+---------------+---------+------------+------------------+-------------
TestTable | 2 | HEALTHY | 1 | 1 | 0 | 0 | 0
rebalance_test_table_0 | 2 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_1 | 2 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_2 | 2 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_3 | 2 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_4 | 2 | HEALTHY | 3 | 3 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 4
First Quartile | 4
Median | 5
Third Quartile | 5
Maximum | 5
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 7
Tables | 6
Tablets | 16
Replicas | 32
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20260810 01:58:08.111860 21763 log_verifier.cc:126] Checking tablet 059177b44a51490f9765e20391967605
I20260810 01:58:08.571144 21763 log_verifier.cc:177] Verified matching terms for 1312 ops in tablet 059177b44a51490f9765e20391967605
I20260810 01:58:08.572613 21763 log_verifier.cc:126] Checking tablet 059c8fa5da994e6c9f3582df4542d276
I20260810 01:58:09.143924 21763 log_verifier.cc:177] Verified matching terms for 1617 ops in tablet 059c8fa5da994e6c9f3582df4542d276
I20260810 01:58:09.145789 21763 log_verifier.cc:126] Checking tablet 127b90e3636b4715b441964a1c43afc1
I20260810 01:58:09.573592 21763 log_verifier.cc:177] Verified matching terms for 1266 ops in tablet 127b90e3636b4715b441964a1c43afc1
I20260810 01:58:09.574800 21763 log_verifier.cc:126] Checking tablet 39a14ec9527d43b4a6f78b48ad4165cf
I20260810 01:58:10.010376 21763 log_verifier.cc:177] Verified matching terms for 1250 ops in tablet 39a14ec9527d43b4a6f78b48ad4165cf
I20260810 01:58:10.011626 21763 log_verifier.cc:126] Checking tablet 3c77a4e4068b4dac971c281f5819a5a9
I20260810 01:58:10.517678 21763 log_verifier.cc:177] Verified matching terms for 1471 ops in tablet 3c77a4e4068b4dac971c281f5819a5a9
I20260810 01:58:10.519265 21763 log_verifier.cc:126] Checking tablet 40f41d25879b4c58ade48978afadf2ef
I20260810 01:58:10.926891 21763 log_verifier.cc:177] Verified matching terms for 1216 ops in tablet 40f41d25879b4c58ade48978afadf2ef
I20260810 01:58:10.928238 21763 log_verifier.cc:126] Checking tablet 4277bfd83a7e48f8a89be6d3ee55558d
I20260810 01:58:10.948318 21763 log_verifier.cc:177] Verified matching terms for 1 ops in tablet 4277bfd83a7e48f8a89be6d3ee55558d
I20260810 01:58:10.948400 21763 log_verifier.cc:126] Checking tablet 4403a36d26db47278a82abb5df118bbd
I20260810 01:58:11.553669 21763 log_verifier.cc:177] Verified matching terms for 1678 ops in tablet 4403a36d26db47278a82abb5df118bbd
I20260810 01:58:11.555224 21763 log_verifier.cc:126] Checking tablet 4f7860cf1d8449fc9f062f3e09e4aafd
I20260810 01:58:12.022926 21763 log_verifier.cc:177] Verified matching terms for 1409 ops in tablet 4f7860cf1d8449fc9f062f3e09e4aafd
I20260810 01:58:12.024184 21763 log_verifier.cc:126] Checking tablet b10c8ac173fc40ca9817d1b654117ca1
I20260810 01:58:12.538968 21763 log_verifier.cc:177] Verified matching terms for 1283 ops in tablet b10c8ac173fc40ca9817d1b654117ca1
I20260810 01:58:12.540153 21763 log_verifier.cc:126] Checking tablet b59ebeb3dc294227a54a82a640c798ce
I20260810 01:58:12.969728 26449 maintenance_manager.cc:419] P c7a6ab8e5a4c4f8a98fa2c3426f0ed8f: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033397
I20260810 01:58:13.020622 26448 maintenance_manager.cc:643] P c7a6ab8e5a4c4f8a98fa2c3426f0ed8f: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.050s user 0.025s sys 0.022s Metrics: {"bytes_written":12623,"cfile_init":1,"dirs.queue_time_us":492,"dirs.run_cpu_time_us":261,"dirs.run_wall_time_us":983,"drs_written":1,"lbm_read_time_us":81,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1054,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":25,"thread_start_us":648,"threads_started":2,"wal-append.queue_time_us":400}
I20260810 01:58:13.022019 26449 maintenance_manager.cc:419] P c7a6ab8e5a4c4f8a98fa2c3426f0ed8f: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 2920 bytes on disk
I20260810 01:58:13.022863 26448 maintenance_manager.cc:643] P c7a6ab8e5a4c4f8a98fa2c3426f0ed8f: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":75,"lbm_reads_lt_1ms":4}
I20260810 01:58:13.031994 21763 log_verifier.cc:177] Verified matching terms for 1410 ops in tablet b59ebeb3dc294227a54a82a640c798ce
I20260810 01:58:13.033584 21763 log_verifier.cc:126] Checking tablet c72cec0deb794dac95b7a88308c56167
I20260810 01:58:13.612903 21763 log_verifier.cc:177] Verified matching terms for 1620 ops in tablet c72cec0deb794dac95b7a88308c56167
I20260810 01:58:13.614437 21763 log_verifier.cc:126] Checking tablet d76ed7c57001495fb62e15bd9f14a162
I20260810 01:58:14.096258 21763 log_verifier.cc:177] Verified matching terms for 1326 ops in tablet d76ed7c57001495fb62e15bd9f14a162
I20260810 01:58:14.097523 21763 log_verifier.cc:126] Checking tablet d771b2d03cb940018a706ecc38f68a9e
I20260810 01:58:14.509275 21763 log_verifier.cc:177] Verified matching terms for 1276 ops in tablet d771b2d03cb940018a706ecc38f68a9e
I20260810 01:58:14.510785 21763 log_verifier.cc:126] Checking tablet e8b0ab1f966840f3ade9f44232b39a5a
I20260810 01:58:15.031388 21763 log_verifier.cc:177] Verified matching terms for 1289 ops in tablet e8b0ab1f966840f3ade9f44232b39a5a
I20260810 01:58:15.032645 21763 log_verifier.cc:126] Checking tablet fdf1cc811a8349efa251d05e9b077fad
I20260810 01:58:15.562227 21763 log_verifier.cc:177] Verified matching terms for 1295 ops in tablet fdf1cc811a8349efa251d05e9b077fad
I20260810 01:58:15.579897 21763 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNubV1X/build/asan/bin/kudu
/tmp/dist-test-taskNubV1X/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/wal
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/logs
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.64.200:0
--local_ip_for_outbound_sockets=127.21.64.200
--webserver_interface=127.21.64.200
--webserver_port=0
--tserver_master_addrs=127.21.64.254:38173
--builtin_ntp_servers=127.21.64.212:42671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
W20260810 01:58:16.249902 1720 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:58:16.250468 1720 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:58:16.250671 1720 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 01:58:16.264211 1720 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260810 01:58:16.264369 1720 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:58:16.264621 1720 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.64.200
I20260810 01:58:16.279176 1720 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.64.212:42671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/data
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.64.200:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/data/info.pb
--webserver_interface=127.21.64.200
--webserver_port=0
--tserver_master_addrs=127.21.64.254:38173
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.64.200
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 01:44:04 UTC on e7f111948823
build id 13266
ASAN enabled
I20260810 01:58:16.281136 1720 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:58:16.283780 1720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 01:58:16.296025 1729 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:58:16.297681 1733 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:58:16.299567 1735 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:58:16.300441 1720 server_base.cc:1061] running on GCE node
I20260810 01:58:16.301092 1720 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:58:16.302090 1720 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:58:16.303362 1720 hybrid_clock.cc:648] HybridClock initialized: now 1786327096303301 us; error 29 us; skew 500 ppm
I20260810 01:58:16.303754 1720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 01:58:16.306401 1720 webserver.cc:533] Webserver started at http://127.21.64.200:39057/ using document root <none> and password file <none>
I20260810 01:58:16.307179 1720 fs_manager.cc:362] Metadata directory not provided
I20260810 01:58:16.307339 1720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:58:16.307772 1720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:58:16.310328 1720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/data/instance:
uuid: "e88eaab4436345f48ef52e0675768ea6"
format_stamp: "Formatted at 2026-08-10 01:58:16 on dist-test-slave-bw88"
I20260810 01:58:16.311183 1720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/wal/instance:
uuid: "e88eaab4436345f48ef52e0675768ea6"
format_stamp: "Formatted at 2026-08-10 01:58:16 on dist-test-slave-bw88"
I20260810 01:58:16.317902 1720 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260810 01:58:16.322690 1744 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:58:16.324551 1720 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260810 01:58:16.324822 1720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/data,/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/wal
uuid: "e88eaab4436345f48ef52e0675768ea6"
format_stamp: "Formatted at 2026-08-10 01:58:16 on dist-test-slave-bw88"
I20260810 01:58:16.325122 1720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/wal
metadata directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/wal
1 data directories: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:58:16.355283 1720 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 01:58:16.356654 1720 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:58:16.357093 1720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:58:16.358655 1720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260810 01:58:16.361457 1720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:58:16.361622 1720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260810 01:58:16.361878 1720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260810 01:58:16.362004 1720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:58:16.470764 1720 rpc_server.cc:307] RPC server started. Bound to: 127.21.64.200:43937
I20260810 01:58:16.470963 1889 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.64.200:43937 every 8 connection(s)
I20260810 01:58:16.472709 1720 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/data/info.pb
I20260810 01:58:16.477654 21763 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNubV1X/build/asan/bin/kudu as pid 1720
I20260810 01:58:16.477890 21763 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/wal/instance
I20260810 01:58:16.497640 1891 heartbeater.cc:344] Connected to a master server at 127.21.64.254:38173
I20260810 01:58:16.498250 1891 heartbeater.cc:461] Registering TS with master...
I20260810 01:58:16.499356 1891 heartbeater.cc:507] Master 127.21.64.254:38173 requested a full tablet report, sending...
I20260810 01:58:16.501194 26456 ts_manager.cc:194] Registered new tserver with Master: e88eaab4436345f48ef52e0675768ea6 (127.21.64.200:43937)
I20260810 01:58:16.502121 26456 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.21.64.200:60179
I20260810 01:58:17.483717 28916 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:17.483875 26976 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:17.495581 26806 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 01:58:17.505203 28379 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:17.506105 1891 heartbeater.cc:499] Master 127.21.64.254:38173 was elected leader, sending a full tablet report...
I20260810 01:58:17.525441 26634 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:58:17.534823 28563 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:58:17.544044 28739 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:58:17.601727 1814 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:58:17.878881 28916 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:17.897459 26976 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:17.942711 28563 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:58:17.945626 28379 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:17.959244 1814 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:58:17.963186 28739 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:58:17.966305 26806 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 01:58:17.976150 26634 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:58:18.151448 26658 consensus_queue.cc:237] T 059177b44a51490f9765e20391967605 P a46364d7cd504f8ca7fc003c59ae6d31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1312, Committed index: 1312, Last appended: 1.1312, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1313 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } } peers { permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 } }
I20260810 01:58:18.154475 28768 raft_consensus.cc:1275] T 059177b44a51490f9765e20391967605 P 9353b63b4d854d23b51a8103bc899aab [term 1 FOLLOWER]: Refusing update from remote peer a46364d7cd504f8ca7fc003c59ae6d31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1312. Preceding OpId from leader: term: 1 index: 1313. (index mismatch)
I20260810 01:58:18.155226 1614 consensus_queue.cc:1048] T 059177b44a51490f9765e20391967605 P a46364d7cd504f8ca7fc003c59ae6d31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1313, Last known committed idx: 1312, Time since last communication: 0.000s
I20260810 01:58:18.158521 1614 raft_consensus.cc:2955] T 059177b44a51490f9765e20391967605 P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 LEADER]: Committing config change with OpId 1.1313: config changed from index 554 to 1313, VOTER e88eaab4436345f48ef52e0675768ea6 (127.21.64.200) added. New config: { opid_index: 1313 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } } peers { permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 } } }
I20260810 01:58:18.162896 28768 raft_consensus.cc:2955] T 059177b44a51490f9765e20391967605 P 9353b63b4d854d23b51a8103bc899aab [term 1 FOLLOWER]: Committing config change with OpId 1.1313: config changed from index 554 to 1313, VOTER e88eaab4436345f48ef52e0675768ea6 (127.21.64.200) added. New config: { opid_index: 1313 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } } peers { permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 } } }
I20260810 01:58:18.173558 26466 catalog_manager.cc:5719] T 059177b44a51490f9765e20391967605 P 9353b63b4d854d23b51a8103bc899aab reported cstate change: config changed from index 554 to 1313, VOTER e88eaab4436345f48ef52e0675768ea6 (127.21.64.200) added. New cstate: current_term: 1 leader_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" committed_config { opid_index: 1313 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } } peers { permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 } } }
W20260810 01:58:18.197642 26576 consensus_peers.cc:597] T 059177b44a51490f9765e20391967605 P a46364d7cd504f8ca7fc003c59ae6d31 -> Peer e88eaab4436345f48ef52e0675768ea6 (127.21.64.200:43937): Couldn't send request to peer e88eaab4436345f48ef52e0675768ea6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 059177b44a51490f9765e20391967605. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:58:18.238981 26828 consensus_queue.cc:237] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1620, Committed index: 1620, Last appended: 1.1620, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1621 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } peers { permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 } }
I20260810 01:58:18.242414 28941 raft_consensus.cc:1275] T c72cec0deb794dac95b7a88308c56167 P 07e0a39216984856b2ff8c512c4c2f93 [term 1 FOLLOWER]: Refusing update from remote peer 60d4538b78b44201964cf440ea562c72: Log matching property violated. Preceding OpId in replica: term: 1 index: 1620. Preceding OpId from leader: term: 1 index: 1621. (index mismatch)
I20260810 01:58:18.243083 2072 consensus_queue.cc:1048] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1621, Last known committed idx: 1620, Time since last communication: 0.000s
I20260810 01:58:18.246273 1566 raft_consensus.cc:2955] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72 [term 1 LEADER]: Committing config change with OpId 1.1621: config changed from index 691 to 1621, VOTER e88eaab4436345f48ef52e0675768ea6 (127.21.64.200) added. New config: { opid_index: 1621 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } peers { permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 } } }
W20260810 01:58:18.248813 26744 consensus_peers.cc:597] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72 -> Peer e88eaab4436345f48ef52e0675768ea6 (127.21.64.200:43937): Couldn't send request to peer e88eaab4436345f48ef52e0675768ea6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c72cec0deb794dac95b7a88308c56167. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:58:18.251845 28941 raft_consensus.cc:2955] T c72cec0deb794dac95b7a88308c56167 P 07e0a39216984856b2ff8c512c4c2f93 [term 1 FOLLOWER]: Committing config change with OpId 1.1621: config changed from index 691 to 1621, VOTER e88eaab4436345f48ef52e0675768ea6 (127.21.64.200) added. New config: { opid_index: 1621 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } peers { permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 } } }
I20260810 01:58:18.252686 26456 catalog_manager.cc:5719] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72 reported cstate change: config changed from index 691 to 1621, VOTER e88eaab4436345f48ef52e0675768ea6 (127.21.64.200) added. New cstate: current_term: 1 leader_uuid: "60d4538b78b44201964cf440ea562c72" committed_config { opid_index: 1621 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } peers { permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 } } }
I20260810 01:58:18.289331 26658 consensus_queue.cc:237] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1410, Committed index: 1410, Last appended: 1.1410, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1411 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } peers { permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 } }
I20260810 01:58:18.292022 28941 raft_consensus.cc:1275] T b59ebeb3dc294227a54a82a640c798ce P 07e0a39216984856b2ff8c512c4c2f93 [term 1 FOLLOWER]: Refusing update from remote peer a46364d7cd504f8ca7fc003c59ae6d31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1410. Preceding OpId from leader: term: 1 index: 1411. (index mismatch)
W20260810 01:58:18.292361 26576 consensus_peers.cc:597] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31 -> Peer e88eaab4436345f48ef52e0675768ea6 (127.21.64.200:43937): Couldn't send request to peer e88eaab4436345f48ef52e0675768ea6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b59ebeb3dc294227a54a82a640c798ce. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:58:18.292665 2045 consensus_queue.cc:1048] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1411, Last known committed idx: 1410, Time since last communication: 0.000s
I20260810 01:58:18.295828 1614 raft_consensus.cc:2955] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 LEADER]: Committing config change with OpId 1.1411: config changed from index 388 to 1411, VOTER e88eaab4436345f48ef52e0675768ea6 (127.21.64.200) added. New config: { opid_index: 1411 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } peers { permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 } } }
I20260810 01:58:18.296715 28941 raft_consensus.cc:2955] T b59ebeb3dc294227a54a82a640c798ce P 07e0a39216984856b2ff8c512c4c2f93 [term 1 FOLLOWER]: Committing config change with OpId 1.1411: config changed from index 388 to 1411, VOTER e88eaab4436345f48ef52e0675768ea6 (127.21.64.200) added. New config: { opid_index: 1411 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } peers { permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 } } }
I20260810 01:58:18.300887 26456 catalog_manager.cc:5719] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31 reported cstate change: config changed from index 388 to 1411, VOTER e88eaab4436345f48ef52e0675768ea6 (127.21.64.200) added. New cstate: current_term: 1 leader_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" committed_config { opid_index: 1411 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } peers { permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 } } }
I20260810 01:58:18.345747 26658 consensus_queue.cc:237] T 4277bfd83a7e48f8a89be6d3ee55558d P a46364d7cd504f8ca7fc003c59ae6d31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 } }
I20260810 01:58:18.348268 27004 raft_consensus.cc:1275] T 4277bfd83a7e48f8a89be6d3ee55558d P 56388bef1a0f453cadc8b6aa9434311d [term 1 FOLLOWER]: Refusing update from remote peer a46364d7cd504f8ca7fc003c59ae6d31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260810 01:58:18.348464 26576 consensus_peers.cc:597] T 4277bfd83a7e48f8a89be6d3ee55558d P a46364d7cd504f8ca7fc003c59ae6d31 -> Peer e88eaab4436345f48ef52e0675768ea6 (127.21.64.200:43937): Couldn't send request to peer e88eaab4436345f48ef52e0675768ea6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4277bfd83a7e48f8a89be6d3ee55558d. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:58:18.348876 2045 consensus_queue.cc:1048] T 4277bfd83a7e48f8a89be6d3ee55558d P a46364d7cd504f8ca7fc003c59ae6d31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260810 01:58:18.351722 1614 raft_consensus.cc:2955] T 4277bfd83a7e48f8a89be6d3ee55558d P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER e88eaab4436345f48ef52e0675768ea6 (127.21.64.200) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 } } }
I20260810 01:58:18.352425 27004 raft_consensus.cc:2955] T 4277bfd83a7e48f8a89be6d3ee55558d P 56388bef1a0f453cadc8b6aa9434311d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER e88eaab4436345f48ef52e0675768ea6 (127.21.64.200) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 } } }
I20260810 01:58:18.356549 26456 catalog_manager.cc:5719] T 4277bfd83a7e48f8a89be6d3ee55558d P a46364d7cd504f8ca7fc003c59ae6d31 reported cstate change: config changed from index -1 to 2, VOTER e88eaab4436345f48ef52e0675768ea6 (127.21.64.200) added. New cstate: current_term: 1 leader_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 } } }
I20260810 01:58:18.505973 28379 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:18.515043 28916 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:18.539746 26806 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 01:58:18.542902 28563 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:58:18.554186 26976 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:18.579668 26634 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:58:18.602285 1814 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:58:18.611593 28739 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:58:18.667095 2192 ts_tablet_manager.cc:933] T c72cec0deb794dac95b7a88308c56167 P e88eaab4436345f48ef52e0675768ea6: Initiating tablet copy from peer 60d4538b78b44201964cf440ea562c72 (127.21.64.194:36943)
I20260810 01:58:18.682595 2192 tablet_copy_client.cc:323] T c72cec0deb794dac95b7a88308c56167 P e88eaab4436345f48ef52e0675768ea6: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.194:36943
I20260810 01:58:18.698413 2195 ts_tablet_manager.cc:933] T 059177b44a51490f9765e20391967605 P e88eaab4436345f48ef52e0675768ea6: Initiating tablet copy from peer a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193:45781)
I20260810 01:58:18.703718 2195 tablet_copy_client.cc:323] T 059177b44a51490f9765e20391967605 P e88eaab4436345f48ef52e0675768ea6: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.193:45781
I20260810 01:58:18.717597 26856 tablet_copy_service.cc:140] P 60d4538b78b44201964cf440ea562c72: Received BeginTabletCopySession request for tablet c72cec0deb794dac95b7a88308c56167 from peer e88eaab4436345f48ef52e0675768ea6 ({username='slave'} at 127.21.64.200:55053)
I20260810 01:58:18.717777 26856 tablet_copy_service.cc:161] P 60d4538b78b44201964cf440ea562c72: Beginning new tablet copy session on tablet c72cec0deb794dac95b7a88308c56167 from peer e88eaab4436345f48ef52e0675768ea6 at {username='slave'} at 127.21.64.200:55053: session id = e88eaab4436345f48ef52e0675768ea6-c72cec0deb794dac95b7a88308c56167
I20260810 01:58:18.721212 26856 tablet_copy_source_session.cc:215] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:58:18.724274 26686 tablet_copy_service.cc:140] P a46364d7cd504f8ca7fc003c59ae6d31: Received BeginTabletCopySession request for tablet 059177b44a51490f9765e20391967605 from peer e88eaab4436345f48ef52e0675768ea6 ({username='slave'} at 127.21.64.200:40671)
I20260810 01:58:18.724464 26686 tablet_copy_service.cc:161] P a46364d7cd504f8ca7fc003c59ae6d31: Beginning new tablet copy session on tablet 059177b44a51490f9765e20391967605 from peer e88eaab4436345f48ef52e0675768ea6 at {username='slave'} at 127.21.64.200:40671: session id = e88eaab4436345f48ef52e0675768ea6-059177b44a51490f9765e20391967605
I20260810 01:58:18.728699 26686 tablet_copy_source_session.cc:215] T 059177b44a51490f9765e20391967605 P a46364d7cd504f8ca7fc003c59ae6d31: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:58:18.730228 2192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c72cec0deb794dac95b7a88308c56167. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:18.730851 2195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 059177b44a51490f9765e20391967605. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:18.746119 2199 ts_tablet_manager.cc:933] T b59ebeb3dc294227a54a82a640c798ce P e88eaab4436345f48ef52e0675768ea6: Initiating tablet copy from peer a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193:45781)
I20260810 01:58:18.749205 2192 tablet_copy_client.cc:806] T c72cec0deb794dac95b7a88308c56167 P e88eaab4436345f48ef52e0675768ea6: tablet copy: Starting download of 0 data blocks...
I20260810 01:58:18.749644 2192 tablet_copy_client.cc:670] T c72cec0deb794dac95b7a88308c56167 P e88eaab4436345f48ef52e0675768ea6: tablet copy: Starting download of 1 WAL segments...
I20260810 01:58:18.768044 2195 tablet_copy_client.cc:806] T 059177b44a51490f9765e20391967605 P e88eaab4436345f48ef52e0675768ea6: tablet copy: Starting download of 0 data blocks...
I20260810 01:58:18.768550 2195 tablet_copy_client.cc:670] T 059177b44a51490f9765e20391967605 P e88eaab4436345f48ef52e0675768ea6: tablet copy: Starting download of 1 WAL segments...
I20260810 01:58:18.770155 2192 tablet_copy_client.cc:538] T c72cec0deb794dac95b7a88308c56167 P e88eaab4436345f48ef52e0675768ea6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:58:18.778020 2199 tablet_copy_client.cc:323] T b59ebeb3dc294227a54a82a640c798ce P e88eaab4436345f48ef52e0675768ea6: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.193:45781
I20260810 01:58:18.779381 26685 tablet_copy_service.cc:140] P a46364d7cd504f8ca7fc003c59ae6d31: Received BeginTabletCopySession request for tablet b59ebeb3dc294227a54a82a640c798ce from peer e88eaab4436345f48ef52e0675768ea6 ({username='slave'} at 127.21.64.200:40671)
I20260810 01:58:18.779646 26685 tablet_copy_service.cc:161] P a46364d7cd504f8ca7fc003c59ae6d31: Beginning new tablet copy session on tablet b59ebeb3dc294227a54a82a640c798ce from peer e88eaab4436345f48ef52e0675768ea6 at {username='slave'} at 127.21.64.200:40671: session id = e88eaab4436345f48ef52e0675768ea6-b59ebeb3dc294227a54a82a640c798ce
I20260810 01:58:18.780272 2192 tablet_bootstrap.cc:492] T c72cec0deb794dac95b7a88308c56167 P e88eaab4436345f48ef52e0675768ea6: Bootstrap starting.
I20260810 01:58:18.784266 26685 tablet_copy_source_session.cc:215] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:58:18.794354 2195 tablet_copy_client.cc:538] T 059177b44a51490f9765e20391967605 P e88eaab4436345f48ef52e0675768ea6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:58:18.798763 2195 tablet_bootstrap.cc:492] T 059177b44a51490f9765e20391967605 P e88eaab4436345f48ef52e0675768ea6: Bootstrap starting.
I20260810 01:58:18.811002 2199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b59ebeb3dc294227a54a82a640c798ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:18.822089 2199 tablet_copy_client.cc:806] T b59ebeb3dc294227a54a82a640c798ce P e88eaab4436345f48ef52e0675768ea6: tablet copy: Starting download of 0 data blocks...
I20260810 01:58:18.822391 2199 tablet_copy_client.cc:670] T b59ebeb3dc294227a54a82a640c798ce P e88eaab4436345f48ef52e0675768ea6: tablet copy: Starting download of 1 WAL segments...
I20260810 01:58:18.840247 2199 tablet_copy_client.cc:538] T b59ebeb3dc294227a54a82a640c798ce P e88eaab4436345f48ef52e0675768ea6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:58:18.845229 2199 tablet_bootstrap.cc:492] T b59ebeb3dc294227a54a82a640c798ce P e88eaab4436345f48ef52e0675768ea6: Bootstrap starting.
I20260810 01:58:18.955451 2221 ts_tablet_manager.cc:933] T 4277bfd83a7e48f8a89be6d3ee55558d P e88eaab4436345f48ef52e0675768ea6: Initiating tablet copy from peer a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193:45781)
I20260810 01:58:18.977463 2221 tablet_copy_client.cc:323] T 4277bfd83a7e48f8a89be6d3ee55558d P e88eaab4436345f48ef52e0675768ea6: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.193:45781
I20260810 01:58:18.978346 26686 tablet_copy_service.cc:140] P a46364d7cd504f8ca7fc003c59ae6d31: Received BeginTabletCopySession request for tablet 4277bfd83a7e48f8a89be6d3ee55558d from peer e88eaab4436345f48ef52e0675768ea6 ({username='slave'} at 127.21.64.200:40671)
I20260810 01:58:18.978572 26686 tablet_copy_service.cc:161] P a46364d7cd504f8ca7fc003c59ae6d31: Beginning new tablet copy session on tablet 4277bfd83a7e48f8a89be6d3ee55558d from peer e88eaab4436345f48ef52e0675768ea6 at {username='slave'} at 127.21.64.200:40671: session id = e88eaab4436345f48ef52e0675768ea6-4277bfd83a7e48f8a89be6d3ee55558d
I20260810 01:58:18.981767 26686 tablet_copy_source_session.cc:215] T 4277bfd83a7e48f8a89be6d3ee55558d P a46364d7cd504f8ca7fc003c59ae6d31: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:58:18.983259 2221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4277bfd83a7e48f8a89be6d3ee55558d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:18.990686 2221 tablet_copy_client.cc:806] T 4277bfd83a7e48f8a89be6d3ee55558d P e88eaab4436345f48ef52e0675768ea6: tablet copy: Starting download of 0 data blocks...
I20260810 01:58:18.990967 2221 tablet_copy_client.cc:670] T 4277bfd83a7e48f8a89be6d3ee55558d P e88eaab4436345f48ef52e0675768ea6: tablet copy: Starting download of 1 WAL segments...
I20260810 01:58:18.993449 2221 tablet_copy_client.cc:538] T 4277bfd83a7e48f8a89be6d3ee55558d P e88eaab4436345f48ef52e0675768ea6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:58:18.999392 2221 tablet_bootstrap.cc:492] T 4277bfd83a7e48f8a89be6d3ee55558d P e88eaab4436345f48ef52e0675768ea6: Bootstrap starting.
I20260810 01:58:19.020795 2221 log.cc:826] T 4277bfd83a7e48f8a89be6d3ee55558d P e88eaab4436345f48ef52e0675768ea6: Log is configured to *not* fsync() on all Append() calls
I20260810 01:58:19.041872 2221 tablet_bootstrap.cc:492] T 4277bfd83a7e48f8a89be6d3ee55558d P e88eaab4436345f48ef52e0675768ea6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:58:19.053934 2221 tablet_bootstrap.cc:492] T 4277bfd83a7e48f8a89be6d3ee55558d P e88eaab4436345f48ef52e0675768ea6: Bootstrap complete.
I20260810 01:58:19.054606 2221 ts_tablet_manager.cc:1403] T 4277bfd83a7e48f8a89be6d3ee55558d P e88eaab4436345f48ef52e0675768ea6: Time spent bootstrapping tablet: real 0.055s user 0.008s sys 0.006s
I20260810 01:58:19.078454 2221 raft_consensus.cc:359] T 4277bfd83a7e48f8a89be6d3ee55558d P e88eaab4436345f48ef52e0675768ea6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 } }
I20260810 01:58:19.079048 2221 raft_consensus.cc:740] T 4277bfd83a7e48f8a89be6d3ee55558d P e88eaab4436345f48ef52e0675768ea6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e88eaab4436345f48ef52e0675768ea6, State: Initialized, Role: FOLLOWER
I20260810 01:58:19.079907 2221 consensus_queue.cc:260] T 4277bfd83a7e48f8a89be6d3ee55558d P e88eaab4436345f48ef52e0675768ea6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 } }
I20260810 01:58:19.102624 2221 ts_tablet_manager.cc:1434] T 4277bfd83a7e48f8a89be6d3ee55558d P e88eaab4436345f48ef52e0675768ea6: Time spent starting tablet: real 0.043s user 0.011s sys 0.001s
I20260810 01:58:19.103852 26686 tablet_copy_service.cc:342] P a46364d7cd504f8ca7fc003c59ae6d31: Request end of tablet copy session e88eaab4436345f48ef52e0675768ea6-4277bfd83a7e48f8a89be6d3ee55558d received from {username='slave'} at 127.21.64.200:40671
I20260810 01:58:19.104027 26686 tablet_copy_service.cc:434] P a46364d7cd504f8ca7fc003c59ae6d31: ending tablet copy session e88eaab4436345f48ef52e0675768ea6-4277bfd83a7e48f8a89be6d3ee55558d on tablet 4277bfd83a7e48f8a89be6d3ee55558d with peer e88eaab4436345f48ef52e0675768ea6
I20260810 01:58:19.131141 28916 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:19.205021 26976 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:19.219609 26634 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:58:19.226262 28739 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:58:19.230000 26806 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 01:58:19.230427 28379 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:19.263278 28563 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:58:19.316128 1814 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:58:19.425508 1836 raft_consensus.cc:1217] T 4277bfd83a7e48f8a89be6d3ee55558d P e88eaab4436345f48ef52e0675768ea6 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260810 01:58:19.868023 28916 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:19.923393 28379 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:19.934708 26976 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:19.950503 26806 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 01:58:19.960705 28563 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:58:19.989682 28739 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:58:20.054611 26634 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:58:20.097986 1814 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:58:20.711875 28916 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:20.721856 28379 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:20.754678 26976 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:20.857084 26806 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 01:58:20.865832 28739 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:58:20.875452 28563 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:58:20.931807 26634 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:58:20.995276 1814 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:58:21.088960 27068 maintenance_manager.cc:419] P 56388bef1a0f453cadc8b6aa9434311d: Scheduling FlushMRSOp(059c8fa5da994e6c9f3582df4542d276): perf score=0.033346
W20260810 01:58:21.162775 26744 consensus_peers.cc:597] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72 -> Peer e88eaab4436345f48ef52e0675768ea6 (127.21.64.200:43937): Couldn't send request to peer e88eaab4436345f48ef52e0675768ea6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20260810 01:58:21.234297 26576 consensus_peers.cc:597] T 059177b44a51490f9765e20391967605 P a46364d7cd504f8ca7fc003c59ae6d31 -> Peer e88eaab4436345f48ef52e0675768ea6 (127.21.64.200:43937): Couldn't send request to peer e88eaab4436345f48ef52e0675768ea6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20260810 01:58:21.283869 26576 consensus_peers.cc:597] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31 -> Peer e88eaab4436345f48ef52e0675768ea6 (127.21.64.200:43937): Couldn't send request to peer e88eaab4436345f48ef52e0675768ea6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260810 01:58:21.304654 26886 maintenance_manager.cc:419] P 60d4538b78b44201964cf440ea562c72: Scheduling FlushMRSOp(c72cec0deb794dac95b7a88308c56167): perf score=0.033400
I20260810 01:58:21.746461 28916 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:21.754197 28379 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:21.796865 26976 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:21.815614 26806 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 01:58:21.876839 28563 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:58:21.920576 26634 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:58:21.927271 28739 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:58:21.940267 26915 maintenance_manager.cc:643] P 56388bef1a0f453cadc8b6aa9434311d: FlushMRSOp(059c8fa5da994e6c9f3582df4542d276) complete. Timing: real 0.849s user 0.221s sys 0.086s Metrics: {"bytes_written":52048,"cfile_init":1,"compiler_manager_pool.queue_time_us":17908,"dirs.queue_time_us":14683,"dirs.run_cpu_time_us":245,"dirs.run_wall_time_us":5267,"drs_written":1,"lbm_read_time_us":115,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1335,"lbm_writes_lt_1ms":24,"peak_mem_usage":0,"rows_written":2246,"thread_start_us":90108,"threads_started":3,"wal-append.queue_time_us":55922}
I20260810 01:58:21.960143 27068 maintenance_manager.cc:419] P 56388bef1a0f453cadc8b6aa9434311d: Scheduling UndoDeltaBlockGCOp(059c8fa5da994e6c9f3582df4542d276): 22997 bytes on disk
I20260810 01:58:21.971791 26915 maintenance_manager.cc:643] P 56388bef1a0f453cadc8b6aa9434311d: UndoDeltaBlockGCOp(059c8fa5da994e6c9f3582df4542d276) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":137,"lbm_reads_lt_1ms":4}
I20260810 01:58:21.974252 1814 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:58:22.223645 27068 maintenance_manager.cc:419] P 56388bef1a0f453cadc8b6aa9434311d: Scheduling FlushMRSOp(127b90e3636b4715b441964a1c43afc1): perf score=0.033341
I20260810 01:58:22.275801 26719 maintenance_manager.cc:419] P a46364d7cd504f8ca7fc003c59ae6d31: Scheduling FlushMRSOp(fdf1cc811a8349efa251d05e9b077fad): perf score=0.033352
I20260810 01:58:22.295387 26746 maintenance_manager.cc:643] P 60d4538b78b44201964cf440ea562c72: FlushMRSOp(c72cec0deb794dac95b7a88308c56167) complete. Timing: real 0.990s user 0.208s sys 0.097s Metrics: {"bytes_written":52181,"cfile_init":1,"compiler_manager_pool.queue_time_us":22015,"dirs.queue_time_us":13669,"dirs.run_cpu_time_us":292,"dirs.run_wall_time_us":4055,"drs_written":1,"lbm_read_time_us":135,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1786,"lbm_writes_lt_1ms":24,"peak_mem_usage":0,"rows_written":2304,"thread_start_us":79977,"threads_started":3,"wal-append.queue_time_us":31634}
I20260810 01:58:22.297679 26886 maintenance_manager.cc:419] P 60d4538b78b44201964cf440ea562c72: Scheduling UndoDeltaBlockGCOp(c72cec0deb794dac95b7a88308c56167): 23412 bytes on disk
I20260810 01:58:22.305267 26746 maintenance_manager.cc:643] P 60d4538b78b44201964cf440ea562c72: UndoDeltaBlockGCOp(c72cec0deb794dac95b7a88308c56167) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":152,"lbm_reads_lt_1ms":4}
I20260810 01:58:22.306301 26886 maintenance_manager.cc:419] P 60d4538b78b44201964cf440ea562c72: Scheduling FlushMRSOp(127b90e3636b4715b441964a1c43afc1): perf score=0.033364
I20260810 01:58:22.596642 2195 tablet_bootstrap.cc:492] T 059177b44a51490f9765e20391967605 P e88eaab4436345f48ef52e0675768ea6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1313 overwritten=0 applied=1313 ignored=0} inserts{seen=1983 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:58:22.601884 2195 tablet_bootstrap.cc:492] T 059177b44a51490f9765e20391967605 P e88eaab4436345f48ef52e0675768ea6: Bootstrap complete.
I20260810 01:58:22.602480 2195 ts_tablet_manager.cc:1403] T 059177b44a51490f9765e20391967605 P e88eaab4436345f48ef52e0675768ea6: Time spent bootstrapping tablet: real 3.804s user 1.647s sys 0.309s
I20260810 01:58:22.603727 2195 raft_consensus.cc:359] T 059177b44a51490f9765e20391967605 P e88eaab4436345f48ef52e0675768ea6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 1313 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } } peers { permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 } }
I20260810 01:58:22.604540 2195 raft_consensus.cc:740] T 059177b44a51490f9765e20391967605 P e88eaab4436345f48ef52e0675768ea6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e88eaab4436345f48ef52e0675768ea6, State: Initialized, Role: FOLLOWER
I20260810 01:58:22.604909 2195 consensus_queue.cc:260] T 059177b44a51490f9765e20391967605 P e88eaab4436345f48ef52e0675768ea6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1313, Last appended: 1.1313, Last appended by leader: 1313, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 1313 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "9353b63b4d854d23b51a8103bc899aab" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 41745 } } peers { permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 } }
I20260810 01:58:22.622300 2195 ts_tablet_manager.cc:1434] T 059177b44a51490f9765e20391967605 P e88eaab4436345f48ef52e0675768ea6: Time spent starting tablet: real 0.020s user 0.002s sys 0.002s
I20260810 01:58:22.624334 26686 tablet_copy_service.cc:342] P a46364d7cd504f8ca7fc003c59ae6d31: Request end of tablet copy session e88eaab4436345f48ef52e0675768ea6-059177b44a51490f9765e20391967605 received from {username='slave'} at 127.21.64.200:40671
I20260810 01:58:22.624539 26686 tablet_copy_service.cc:434] P a46364d7cd504f8ca7fc003c59ae6d31: ending tablet copy session e88eaab4436345f48ef52e0675768ea6-059177b44a51490f9765e20391967605 on tablet 059177b44a51490f9765e20391967605 with peer e88eaab4436345f48ef52e0675768ea6
I20260810 01:58:22.655506 2199 tablet_bootstrap.cc:492] T b59ebeb3dc294227a54a82a640c798ce P e88eaab4436345f48ef52e0675768ea6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1411 overwritten=0 applied=1411 ignored=0} inserts{seen=2081 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:58:22.656080 2199 tablet_bootstrap.cc:492] T b59ebeb3dc294227a54a82a640c798ce P e88eaab4436345f48ef52e0675768ea6: Bootstrap complete.
I20260810 01:58:22.657253 2199 ts_tablet_manager.cc:1403] T b59ebeb3dc294227a54a82a640c798ce P e88eaab4436345f48ef52e0675768ea6: Time spent bootstrapping tablet: real 3.812s user 1.767s sys 0.306s
I20260810 01:58:22.659201 2199 raft_consensus.cc:359] T b59ebeb3dc294227a54a82a640c798ce P e88eaab4436345f48ef52e0675768ea6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 1411 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } peers { permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 } }
I20260810 01:58:22.669560 2199 raft_consensus.cc:740] T b59ebeb3dc294227a54a82a640c798ce P e88eaab4436345f48ef52e0675768ea6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e88eaab4436345f48ef52e0675768ea6, State: Initialized, Role: FOLLOWER
I20260810 01:58:22.669891 2199 consensus_queue.cc:260] T b59ebeb3dc294227a54a82a640c798ce P e88eaab4436345f48ef52e0675768ea6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1411, Last appended: 1.1411, Last appended by leader: 1411, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 1411 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } peers { permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 } }
I20260810 01:58:22.670607 2199 ts_tablet_manager.cc:1434] T b59ebeb3dc294227a54a82a640c798ce P e88eaab4436345f48ef52e0675768ea6: Time spent starting tablet: real 0.012s user 0.001s sys 0.000s
I20260810 01:58:22.671530 26686 tablet_copy_service.cc:342] P a46364d7cd504f8ca7fc003c59ae6d31: Request end of tablet copy session e88eaab4436345f48ef52e0675768ea6-b59ebeb3dc294227a54a82a640c798ce received from {username='slave'} at 127.21.64.200:40671
I20260810 01:58:22.671731 26686 tablet_copy_service.cc:434] P a46364d7cd504f8ca7fc003c59ae6d31: ending tablet copy session e88eaab4436345f48ef52e0675768ea6-b59ebeb3dc294227a54a82a640c798ce on tablet b59ebeb3dc294227a54a82a640c798ce with peer e88eaab4436345f48ef52e0675768ea6
I20260810 01:58:22.750499 28916 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:22.766862 1836 raft_consensus.cc:1217] T b59ebeb3dc294227a54a82a640c798ce P e88eaab4436345f48ef52e0675768ea6 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.1410->[1.1411-1.1411] Dedup: 1.1411->[]
I20260810 01:58:22.785091 26976 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
W20260810 01:58:22.832038 28675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.197:46107, user_credentials={real_user=slave}} blocked reactor thread for 52054.2us
I20260810 01:58:22.849318 28379 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:22.873952 28739 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:58:22.890568 26634 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:58:22.905175 28563 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:58:22.906744 26806 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 01:58:22.905112 26915 maintenance_manager.cc:643] P 56388bef1a0f453cadc8b6aa9434311d: FlushMRSOp(127b90e3636b4715b441964a1c43afc1) complete. Timing: real 0.681s user 0.164s sys 0.059s Metrics: {"bytes_written":43042,"cfile_init":1,"dirs.queue_time_us":7485,"dirs.run_cpu_time_us":305,"dirs.run_wall_time_us":12230,"drs_written":1,"lbm_read_time_us":112,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1755,"lbm_writes_lt_1ms":24,"peak_mem_usage":0,"rows_written":1898,"thread_start_us":31862,"threads_started":2,"wal-append.queue_time_us":17630}
I20260810 01:58:22.917372 27068 maintenance_manager.cc:419] P 56388bef1a0f453cadc8b6aa9434311d: Scheduling UndoDeltaBlockGCOp(127b90e3636b4715b441964a1c43afc1): 19043 bytes on disk
I20260810 01:58:22.918213 26915 maintenance_manager.cc:643] P 56388bef1a0f453cadc8b6aa9434311d: UndoDeltaBlockGCOp(127b90e3636b4715b441964a1c43afc1) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":118,"lbm_reads_lt_1ms":4}
I20260810 01:58:22.990571 1814 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:58:23.053081 26578 maintenance_manager.cc:643] P a46364d7cd504f8ca7fc003c59ae6d31: FlushMRSOp(fdf1cc811a8349efa251d05e9b077fad) complete. Timing: real 0.776s user 0.173s sys 0.148s Metrics: {"bytes_written":43894,"cfile_init":1,"compiler_manager_pool.queue_time_us":9972,"dirs.queue_time_us":69201,"dirs.run_cpu_time_us":271,"dirs.run_wall_time_us":924,"drs_written":1,"lbm_read_time_us":115,"lbm_reads_lt_1ms":4,"lbm_write_time_us":8605,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":1966,"thread_start_us":133447,"threads_started":3,"wal-append.queue_time_us":58373}
I20260810 01:58:23.055303 26719 maintenance_manager.cc:419] P a46364d7cd504f8ca7fc003c59ae6d31: Scheduling UndoDeltaBlockGCOp(fdf1cc811a8349efa251d05e9b077fad): 19594 bytes on disk
I20260810 01:58:23.056274 26578 maintenance_manager.cc:643] P a46364d7cd504f8ca7fc003c59ae6d31: UndoDeltaBlockGCOp(fdf1cc811a8349efa251d05e9b077fad) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":113,"lbm_reads_lt_1ms":4}
I20260810 01:58:23.179342 1836 raft_consensus.cc:1217] T 059177b44a51490f9765e20391967605 P e88eaab4436345f48ef52e0675768ea6 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.1312->[1.1313-1.1313] Dedup: 1.1313->[]
I20260810 01:58:23.229423 26746 maintenance_manager.cc:643] P 60d4538b78b44201964cf440ea562c72: FlushMRSOp(127b90e3636b4715b441964a1c43afc1) complete. Timing: real 0.916s user 0.145s sys 0.089s Metrics: {"bytes_written":43042,"cfile_init":1,"dirs.queue_time_us":25063,"dirs.run_cpu_time_us":306,"dirs.run_wall_time_us":9757,"drs_written":1,"lbm_read_time_us":86,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1734,"lbm_writes_lt_1ms":24,"peak_mem_usage":0,"rows_written":1898,"thread_start_us":57529,"threads_started":2,"wal-append.queue_time_us":9127}
I20260810 01:58:23.230769 26886 maintenance_manager.cc:419] P 60d4538b78b44201964cf440ea562c72: Scheduling UndoDeltaBlockGCOp(127b90e3636b4715b441964a1c43afc1): 19043 bytes on disk
I20260810 01:58:23.237958 26746 maintenance_manager.cc:643] P 60d4538b78b44201964cf440ea562c72: UndoDeltaBlockGCOp(127b90e3636b4715b441964a1c43afc1) complete. Timing: real 0.005s user 0.001s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":150,"lbm_reads_lt_1ms":4}
I20260810 01:58:23.489603 26886 maintenance_manager.cc:419] P 60d4538b78b44201964cf440ea562c72: Scheduling FlushMRSOp(d76ed7c57001495fb62e15bd9f14a162): perf score=0.033352
W20260810 01:58:23.495092 26744 consensus_peers.cc:597] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72 -> Peer e88eaab4436345f48ef52e0675768ea6 (127.21.64.200:43937): Couldn't send request to peer e88eaab4436345f48ef52e0675768ea6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
I20260810 01:58:23.558480 26719 maintenance_manager.cc:419] P a46364d7cd504f8ca7fc003c59ae6d31: Scheduling FlushMRSOp(39a14ec9527d43b4a6f78b48ad4165cf): perf score=0.033367
I20260810 01:58:23.639907 2192 tablet_bootstrap.cc:492] T c72cec0deb794dac95b7a88308c56167 P e88eaab4436345f48ef52e0675768ea6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1621 overwritten=0 applied=1621 ignored=0} inserts{seen=2304 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:58:23.640659 2192 tablet_bootstrap.cc:492] T c72cec0deb794dac95b7a88308c56167 P e88eaab4436345f48ef52e0675768ea6: Bootstrap complete.
I20260810 01:58:23.641224 2192 ts_tablet_manager.cc:1403] T c72cec0deb794dac95b7a88308c56167 P e88eaab4436345f48ef52e0675768ea6: Time spent bootstrapping tablet: real 4.861s user 2.171s sys 0.257s
I20260810 01:58:23.642087 2192 raft_consensus.cc:359] T c72cec0deb794dac95b7a88308c56167 P e88eaab4436345f48ef52e0675768ea6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 1621 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } peers { permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 } }
I20260810 01:58:23.642571 2192 raft_consensus.cc:740] T c72cec0deb794dac95b7a88308c56167 P e88eaab4436345f48ef52e0675768ea6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e88eaab4436345f48ef52e0675768ea6, State: Initialized, Role: FOLLOWER
I20260810 01:58:23.642899 2192 consensus_queue.cc:260] T c72cec0deb794dac95b7a88308c56167 P e88eaab4436345f48ef52e0675768ea6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1621, Last appended: 1.1621, Last appended by leader: 1621, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 1621 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } peers { permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 } }
I20260810 01:58:23.649430 2192 ts_tablet_manager.cc:1434] T c72cec0deb794dac95b7a88308c56167 P e88eaab4436345f48ef52e0675768ea6: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 01:58:23.650400 26856 tablet_copy_service.cc:342] P 60d4538b78b44201964cf440ea562c72: Request end of tablet copy session e88eaab4436345f48ef52e0675768ea6-c72cec0deb794dac95b7a88308c56167 received from {username='slave'} at 127.21.64.200:55053
I20260810 01:58:23.650532 26856 tablet_copy_service.cc:434] P 60d4538b78b44201964cf440ea562c72: ending tablet copy session e88eaab4436345f48ef52e0675768ea6-c72cec0deb794dac95b7a88308c56167 on tablet c72cec0deb794dac95b7a88308c56167 with peer e88eaab4436345f48ef52e0675768ea6
I20260810 01:58:23.671886 27068 maintenance_manager.cc:419] P 56388bef1a0f453cadc8b6aa9434311d: Scheduling FlushMRSOp(40f41d25879b4c58ade48978afadf2ef): perf score=0.033399
I20260810 01:58:23.871829 26746 maintenance_manager.cc:643] P 60d4538b78b44201964cf440ea562c72: FlushMRSOp(d76ed7c57001495fb62e15bd9f14a162) complete. Timing: real 0.382s user 0.112s sys 0.058s Metrics: {"bytes_written":44704,"cfile_init":1,"dirs.queue_time_us":10356,"dirs.run_cpu_time_us":225,"dirs.run_wall_time_us":3375,"drs_written":1,"lbm_read_time_us":75,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1067,"lbm_writes_lt_1ms":24,"peak_mem_usage":0,"rows_written":2010,"thread_start_us":19322,"threads_started":2,"wal-append.queue_time_us":7730}
I20260810 01:58:23.875675 26886 maintenance_manager.cc:419] P 60d4538b78b44201964cf440ea562c72: Scheduling UndoDeltaBlockGCOp(d76ed7c57001495fb62e15bd9f14a162): 20037 bytes on disk
I20260810 01:58:23.876816 26746 maintenance_manager.cc:643] P 60d4538b78b44201964cf440ea562c72: UndoDeltaBlockGCOp(d76ed7c57001495fb62e15bd9f14a162) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":217,"lbm_reads_lt_1ms":4}
I20260810 01:58:23.898289 26915 maintenance_manager.cc:643] P 56388bef1a0f453cadc8b6aa9434311d: FlushMRSOp(40f41d25879b4c58ade48978afadf2ef) complete. Timing: real 0.226s user 0.128s sys 0.040s Metrics: {"bytes_written":41800,"cfile_init":1,"dirs.queue_time_us":3768,"dirs.run_cpu_time_us":160,"dirs.run_wall_time_us":6188,"drs_written":1,"lbm_read_time_us":98,"lbm_reads_lt_1ms":4,"lbm_write_time_us":7767,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":1845,"thread_start_us":10381,"threads_started":2,"wal-append.queue_time_us":12060}
I20260810 01:58:23.900640 27068 maintenance_manager.cc:419] P 56388bef1a0f453cadc8b6aa9434311d: Scheduling UndoDeltaBlockGCOp(40f41d25879b4c58ade48978afadf2ef): 18463 bytes on disk
I20260810 01:58:23.901433 26915 maintenance_manager.cc:643] P 56388bef1a0f453cadc8b6aa9434311d: UndoDeltaBlockGCOp(40f41d25879b4c58ade48978afadf2ef) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":114,"lbm_reads_lt_1ms":4}
I20260810 01:58:23.904043 26578 maintenance_manager.cc:643] P a46364d7cd504f8ca7fc003c59ae6d31: FlushMRSOp(39a14ec9527d43b4a6f78b48ad4165cf) complete. Timing: real 0.345s user 0.116s sys 0.069s Metrics: {"bytes_written":42709,"cfile_init":1,"compiler_manager_pool.queue_time_us":194336,"compiler_manager_pool.run_cpu_time_us":9,"compiler_manager_pool.run_wall_time_us":9,"dirs.queue_time_us":19976,"dirs.run_cpu_time_us":195,"dirs.run_wall_time_us":7494,"drs_written":1,"lbm_read_time_us":97,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1210,"lbm_writes_lt_1ms":24,"peak_mem_usage":0,"rows_written":1921,"thread_start_us":38691,"threads_started":2,"wal-append.queue_time_us":11181}
I20260810 01:58:23.905547 26719 maintenance_manager.cc:419] P a46364d7cd504f8ca7fc003c59ae6d31: Scheduling UndoDeltaBlockGCOp(39a14ec9527d43b4a6f78b48ad4165cf): 19097 bytes on disk
I20260810 01:58:23.907218 26578 maintenance_manager.cc:643] P a46364d7cd504f8ca7fc003c59ae6d31: UndoDeltaBlockGCOp(39a14ec9527d43b4a6f78b48ad4165cf) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":86,"lbm_reads_lt_1ms":4}
I20260810 01:58:23.941991 28379 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:23.955042 28916 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:23.970479 26806 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 01:58:23.993804 26976 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:24.014400 26634 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:58:24.015923 28739 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:58:24.020834 28563 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:58:24.074209 1836 raft_consensus.cc:1217] T c72cec0deb794dac95b7a88308c56167 P e88eaab4436345f48ef52e0675768ea6 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.1620->[1.1621-1.1621] Dedup: 1.1621->[]
I20260810 01:58:24.103174 1814 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:58:24.211838 26658 consensus_queue.cc:237] T 4277bfd83a7e48f8a89be6d3ee55558d P a46364d7cd504f8ca7fc003c59ae6d31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 } }
I20260810 01:58:24.214115 1836 raft_consensus.cc:1275] T 4277bfd83a7e48f8a89be6d3ee55558d P e88eaab4436345f48ef52e0675768ea6 [term 1 FOLLOWER]: Refusing update from remote peer a46364d7cd504f8ca7fc003c59ae6d31: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260810 01:58:24.214691 2401 consensus_queue.cc:1048] T 4277bfd83a7e48f8a89be6d3ee55558d P a46364d7cd504f8ca7fc003c59ae6d31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260810 01:58:24.219234 2656 raft_consensus.cc:2955] T 4277bfd83a7e48f8a89be6d3ee55558d P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, VOTER 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195) evicted. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 } } }
I20260810 01:58:24.220160 1836 raft_consensus.cc:2955] T 4277bfd83a7e48f8a89be6d3ee55558d P e88eaab4436345f48ef52e0675768ea6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, VOTER 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195) evicted. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 } } }
I20260810 01:58:24.224255 26466 catalog_manager.cc:5719] T 4277bfd83a7e48f8a89be6d3ee55558d P a46364d7cd504f8ca7fc003c59ae6d31 reported cstate change: config changed from index 2 to 3, VOTER 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195) evicted. New cstate: current_term: 1 leader_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 } } }
I20260810 01:58:24.232482 26976 tablet_service.cc:1558] Processing DeleteTablet for tablet 4277bfd83a7e48f8a89be6d3ee55558d with delete_type TABLET_DATA_TOMBSTONED (TS 56388bef1a0f453cadc8b6aa9434311d not found in new config with opid_index 3) from {username='slave'} at 127.0.0.1:39126
I20260810 01:58:24.236915 2666 tablet_replica.cc:333] T 4277bfd83a7e48f8a89be6d3ee55558d P 56388bef1a0f453cadc8b6aa9434311d: stopping tablet replica
I20260810 01:58:24.237150 2666 raft_consensus.cc:2243] T 4277bfd83a7e48f8a89be6d3ee55558d P 56388bef1a0f453cadc8b6aa9434311d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:58:24.237447 2666 raft_consensus.cc:2272] T 4277bfd83a7e48f8a89be6d3ee55558d P 56388bef1a0f453cadc8b6aa9434311d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:58:24.239629 2666 ts_tablet_manager.cc:1916] T 4277bfd83a7e48f8a89be6d3ee55558d P 56388bef1a0f453cadc8b6aa9434311d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:58:24.247087 2666 ts_tablet_manager.cc:1929] T 4277bfd83a7e48f8a89be6d3ee55558d P 56388bef1a0f453cadc8b6aa9434311d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.2
I20260810 01:58:24.247179 2666 log.cc:1199] T 4277bfd83a7e48f8a89be6d3ee55558d P 56388bef1a0f453cadc8b6aa9434311d: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/wal/wals/4277bfd83a7e48f8a89be6d3ee55558d
I20260810 01:58:24.248045 26445 catalog_manager.cc:5050] TS 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195:45355): tablet 4277bfd83a7e48f8a89be6d3ee55558d (table TestTable [id=f1ed845809e84391b90ff1948a854775]) successfully deleted
I20260810 01:58:24.354103 28916 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:24.372362 26976 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:24.377158 28379 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:24.388365 26806 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 01:58:24.408427 28563 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:58:24.442454 26634 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:58:24.449075 28739 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:58:24.483574 1814 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:58:24.563068 26658 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b59ebeb3dc294227a54a82a640c798ce"
dest_uuid: "a46364d7cd504f8ca7fc003c59ae6d31"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:38148
I20260810 01:58:24.563370 26658 raft_consensus.cc:606] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 LEADER]: Received request to transfer leadership
I20260810 01:58:24.675686 28379 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:24.684808 26976 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:24.698673 26806 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 01:58:24.698791 28916 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:24.711731 28563 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:58:24.719959 2656 raft_consensus.cc:993] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31: : Instructing follower 07e0a39216984856b2ff8c512c4c2f93 to start an election
I20260810 01:58:24.720136 2656 raft_consensus.cc:1081] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 LEADER]: Signalling peer 07e0a39216984856b2ff8c512c4c2f93 to start an election
I20260810 01:58:24.720872 28739 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:58:24.721920 28941 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b59ebeb3dc294227a54a82a640c798ce"
dest_uuid: "07e0a39216984856b2ff8c512c4c2f93"
from {username='slave'} at 127.21.64.193:51663
I20260810 01:58:24.722121 28941 raft_consensus.cc:493] T b59ebeb3dc294227a54a82a640c798ce P 07e0a39216984856b2ff8c512c4c2f93 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260810 01:58:24.722203 28941 raft_consensus.cc:3060] T b59ebeb3dc294227a54a82a640c798ce P 07e0a39216984856b2ff8c512c4c2f93 [term 1 FOLLOWER]: Advancing to term 2
I20260810 01:58:24.728830 28941 raft_consensus.cc:515] T b59ebeb3dc294227a54a82a640c798ce P 07e0a39216984856b2ff8c512c4c2f93 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 1411 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } peers { permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 } }
I20260810 01:58:24.740549 26634 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:58:24.741820 28941 leader_election.cc:290] T b59ebeb3dc294227a54a82a640c798ce P 07e0a39216984856b2ff8c512c4c2f93 [CANDIDATE]: Term 2 election: Requested vote from peers a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193:45781), e88eaab4436345f48ef52e0675768ea6 (127.21.64.200:43937)
I20260810 01:58:24.765404 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59ebeb3dc294227a54a82a640c798ce" candidate_uuid: "07e0a39216984856b2ff8c512c4c2f93" candidate_term: 2 candidate_status { last_received { term: 1 index: 1411 } } ignore_live_leader: true dest_uuid: "a46364d7cd504f8ca7fc003c59ae6d31"
I20260810 01:58:24.765650 26658 raft_consensus.cc:3055] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 LEADER]: Stepping down as leader of term 1
I20260810 01:58:24.765735 26658 raft_consensus.cc:740] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a46364d7cd504f8ca7fc003c59ae6d31, State: Running, Role: LEADER
I20260810 01:58:24.766060 26658 consensus_queue.cc:260] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1411, Committed index: 1411, Last appended: 1.1411, Last appended by leader: 1411, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 1411 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } peers { permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 } }
I20260810 01:58:24.766484 26658 raft_consensus.cc:3060] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 FOLLOWER]: Advancing to term 2
I20260810 01:58:24.771766 26658 raft_consensus.cc:2468] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07e0a39216984856b2ff8c512c4c2f93 in term 2.
I20260810 01:58:24.772435 28856 leader_election.cc:304] T b59ebeb3dc294227a54a82a640c798ce P 07e0a39216984856b2ff8c512c4c2f93 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07e0a39216984856b2ff8c512c4c2f93, a46364d7cd504f8ca7fc003c59ae6d31; no voters:
I20260810 01:58:24.772809 2712 raft_consensus.cc:2804] T b59ebeb3dc294227a54a82a640c798ce P 07e0a39216984856b2ff8c512c4c2f93 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 01:58:24.775779 2712 raft_consensus.cc:697] T b59ebeb3dc294227a54a82a640c798ce P 07e0a39216984856b2ff8c512c4c2f93 [term 2 LEADER]: Becoming Leader. State: Replica: 07e0a39216984856b2ff8c512c4c2f93, State: Running, Role: LEADER
I20260810 01:58:24.776130 2712 consensus_queue.cc:237] T b59ebeb3dc294227a54a82a640c798ce P 07e0a39216984856b2ff8c512c4c2f93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1411, Committed index: 1411, Last appended: 1.1411, Last appended by leader: 1411, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1411 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } peers { permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 } }
I20260810 01:58:24.784168 1814 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:58:24.803092 1836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59ebeb3dc294227a54a82a640c798ce" candidate_uuid: "07e0a39216984856b2ff8c512c4c2f93" candidate_term: 2 candidate_status { last_received { term: 1 index: 1411 } } ignore_live_leader: true dest_uuid: "e88eaab4436345f48ef52e0675768ea6"
I20260810 01:58:24.803433 1836 raft_consensus.cc:3060] T b59ebeb3dc294227a54a82a640c798ce P e88eaab4436345f48ef52e0675768ea6 [term 1 FOLLOWER]: Advancing to term 2
I20260810 01:58:24.807322 1836 raft_consensus.cc:2468] T b59ebeb3dc294227a54a82a640c798ce P e88eaab4436345f48ef52e0675768ea6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07e0a39216984856b2ff8c512c4c2f93 in term 2.
I20260810 01:58:24.816144 26457 catalog_manager.cc:5719] T b59ebeb3dc294227a54a82a640c798ce P 07e0a39216984856b2ff8c512c4c2f93 reported cstate change: term changed from 1 to 2, leader changed from a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193) to 07e0a39216984856b2ff8c512c4c2f93 (127.21.64.199). New cstate: current_term: 2 leader_uuid: "07e0a39216984856b2ff8c512c4c2f93" committed_config { opid_index: 1411 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } peers { permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 } } }
I20260810 01:58:24.880986 26886 maintenance_manager.cc:419] P 60d4538b78b44201964cf440ea562c72: Scheduling FlushMRSOp(d771b2d03cb940018a706ecc38f68a9e): perf score=0.033382
I20260810 01:58:24.906390 27068 maintenance_manager.cc:419] P 56388bef1a0f453cadc8b6aa9434311d: Scheduling FlushMRSOp(e8b0ab1f966840f3ade9f44232b39a5a): perf score=0.033389
I20260810 01:58:24.910964 26719 maintenance_manager.cc:419] P a46364d7cd504f8ca7fc003c59ae6d31: Scheduling FlushMRSOp(059177b44a51490f9765e20391967605): perf score=0.033388
I20260810 01:58:25.074733 26578 maintenance_manager.cc:643] P a46364d7cd504f8ca7fc003c59ae6d31: FlushMRSOp(059177b44a51490f9765e20391967605) complete. Timing: real 0.163s user 0.123s sys 0.029s Metrics: {"bytes_written":44355,"cfile_init":1,"dirs.queue_time_us":25704,"dirs.run_cpu_time_us":249,"dirs.run_wall_time_us":2402,"drs_written":1,"lbm_read_time_us":109,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1162,"lbm_writes_lt_1ms":24,"peak_mem_usage":0,"rows_written":1983,"thread_start_us":32928,"threads_started":2,"wal-append.queue_time_us":6338}
I20260810 01:58:25.076478 26719 maintenance_manager.cc:419] P a46364d7cd504f8ca7fc003c59ae6d31: Scheduling UndoDeltaBlockGCOp(059177b44a51490f9765e20391967605): 19816 bytes on disk
I20260810 01:58:25.078704 26578 maintenance_manager.cc:643] P a46364d7cd504f8ca7fc003c59ae6d31: UndoDeltaBlockGCOp(059177b44a51490f9765e20391967605) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":102,"lbm_reads_lt_1ms":4}
I20260810 01:58:25.089917 26746 maintenance_manager.cc:643] P 60d4538b78b44201964cf440ea562c72: FlushMRSOp(d771b2d03cb940018a706ecc38f68a9e) complete. Timing: real 0.209s user 0.125s sys 0.030s Metrics: {"bytes_written":43330,"cfile_init":1,"dirs.queue_time_us":6444,"dirs.run_cpu_time_us":234,"dirs.run_wall_time_us":7318,"drs_written":1,"lbm_read_time_us":103,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1267,"lbm_writes_lt_1ms":24,"peak_mem_usage":0,"rows_written":1905,"thread_start_us":48368,"threads_started":2,"wal-append.queue_time_us":41599}
I20260810 01:58:25.091387 26886 maintenance_manager.cc:419] P 60d4538b78b44201964cf440ea562c72: Scheduling UndoDeltaBlockGCOp(d771b2d03cb940018a706ecc38f68a9e): 19130 bytes on disk
I20260810 01:58:25.093207 26746 maintenance_manager.cc:643] P 60d4538b78b44201964cf440ea562c72: UndoDeltaBlockGCOp(d771b2d03cb940018a706ecc38f68a9e) complete. Timing: real 0.002s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":159,"lbm_reads_lt_1ms":4}
I20260810 01:58:25.112284 26915 maintenance_manager.cc:643] P 56388bef1a0f453cadc8b6aa9434311d: FlushMRSOp(e8b0ab1f966840f3ade9f44232b39a5a) complete. Timing: real 0.206s user 0.137s sys 0.049s Metrics: {"bytes_written":43723,"cfile_init":1,"dirs.queue_time_us":9280,"dirs.run_cpu_time_us":262,"dirs.run_wall_time_us":9417,"drs_written":1,"lbm_read_time_us":97,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1315,"lbm_writes_lt_1ms":24,"peak_mem_usage":0,"rows_written":1973,"thread_start_us":43693,"threads_started":2,"wal-append.queue_time_us":34457}
I20260810 01:58:25.113386 27068 maintenance_manager.cc:419] P 56388bef1a0f453cadc8b6aa9434311d: Scheduling UndoDeltaBlockGCOp(e8b0ab1f966840f3ade9f44232b39a5a): 19617 bytes on disk
I20260810 01:58:25.116953 26915 maintenance_manager.cc:643] P 56388bef1a0f453cadc8b6aa9434311d: UndoDeltaBlockGCOp(e8b0ab1f966840f3ade9f44232b39a5a) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":94,"lbm_reads_lt_1ms":4}
I20260810 01:58:25.169588 28916 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 01:58:25.175827 1836 raft_consensus.cc:1275] T b59ebeb3dc294227a54a82a640c798ce P e88eaab4436345f48ef52e0675768ea6 [term 2 FOLLOWER]: Refusing update from remote peer 07e0a39216984856b2ff8c512c4c2f93: Log matching property violated. Preceding OpId in replica: term: 1 index: 1411. Preceding OpId from leader: term: 2 index: 1412. (index mismatch)
I20260810 01:58:25.176642 2712 consensus_queue.cc:1048] T b59ebeb3dc294227a54a82a640c798ce P 07e0a39216984856b2ff8c512c4c2f93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1412, Last known committed idx: 1411, Time since last communication: 0.000s
I20260810 01:58:25.179092 26976 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:25.196128 28563 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:58:25.198395 28379 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:25.199218 28739 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:58:25.199612 26806 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 01:58:25.265046 26634 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:58:25.266083 1814 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:58:25.283207 26658 raft_consensus.cc:1275] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31 [term 2 FOLLOWER]: Refusing update from remote peer 07e0a39216984856b2ff8c512c4c2f93: Log matching property violated. Preceding OpId in replica: term: 1 index: 1411. Preceding OpId from leader: term: 2 index: 1412. (index mismatch)
I20260810 01:58:25.284102 2776 consensus_queue.cc:1048] T b59ebeb3dc294227a54a82a640c798ce P 07e0a39216984856b2ff8c512c4c2f93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1412, Last known committed idx: 1411, Time since last communication: 0.000s
I20260810 01:58:25.402060 26658 consensus_queue.cc:237] T 059177b44a51490f9765e20391967605 P a46364d7cd504f8ca7fc003c59ae6d31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1313, Committed index: 1313, Last appended: 1.1313, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1314 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 } }
I20260810 01:58:25.403837 1836 raft_consensus.cc:1275] T 059177b44a51490f9765e20391967605 P e88eaab4436345f48ef52e0675768ea6 [term 1 FOLLOWER]: Refusing update from remote peer a46364d7cd504f8ca7fc003c59ae6d31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1313. Preceding OpId from leader: term: 1 index: 1314. (index mismatch)
I20260810 01:58:25.404386 2401 consensus_queue.cc:1048] T 059177b44a51490f9765e20391967605 P a46364d7cd504f8ca7fc003c59ae6d31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1314, Last known committed idx: 1313, Time since last communication: 0.000s
I20260810 01:58:25.407648 2887 raft_consensus.cc:2955] T 059177b44a51490f9765e20391967605 P a46364d7cd504f8ca7fc003c59ae6d31 [term 1 LEADER]: Committing config change with OpId 1.1314: config changed from index 1313 to 1314, VOTER 9353b63b4d854d23b51a8103bc899aab (127.21.64.198) evicted. New config: { opid_index: 1314 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 } } }
I20260810 01:58:25.408375 1836 raft_consensus.cc:2955] T 059177b44a51490f9765e20391967605 P e88eaab4436345f48ef52e0675768ea6 [term 1 FOLLOWER]: Committing config change with OpId 1.1314: config changed from index 1313 to 1314, VOTER 9353b63b4d854d23b51a8103bc899aab (127.21.64.198) evicted. New config: { opid_index: 1314 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 } } }
I20260810 01:58:25.412428 26457 catalog_manager.cc:5719] T 059177b44a51490f9765e20391967605 P a46364d7cd504f8ca7fc003c59ae6d31 reported cstate change: config changed from index 1313 to 1314, VOTER 9353b63b4d854d23b51a8103bc899aab (127.21.64.198) evicted. New cstate: current_term: 1 leader_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" committed_config { opid_index: 1314 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 } } }
I20260810 01:58:25.429940 28739 tablet_service.cc:1558] Processing DeleteTablet for tablet 059177b44a51490f9765e20391967605 with delete_type TABLET_DATA_TOMBSTONED (TS 9353b63b4d854d23b51a8103bc899aab not found in new config with opid_index 1314) from {username='slave'} at 127.0.0.1:58236
I20260810 01:58:25.431298 2906 tablet_replica.cc:333] T 059177b44a51490f9765e20391967605 P 9353b63b4d854d23b51a8103bc899aab: stopping tablet replica
I20260810 01:58:25.431833 2906 raft_consensus.cc:2243] T 059177b44a51490f9765e20391967605 P 9353b63b4d854d23b51a8103bc899aab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:58:25.432284 2906 raft_consensus.cc:2272] T 059177b44a51490f9765e20391967605 P 9353b63b4d854d23b51a8103bc899aab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:58:25.434587 2906 ts_tablet_manager.cc:1916] T 059177b44a51490f9765e20391967605 P 9353b63b4d854d23b51a8103bc899aab: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:58:25.440062 2906 ts_tablet_manager.cc:1929] T 059177b44a51490f9765e20391967605 P 9353b63b4d854d23b51a8103bc899aab: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1313
I20260810 01:58:25.440207 2906 log.cc:1199] T 059177b44a51490f9765e20391967605 P 9353b63b4d854d23b51a8103bc899aab: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/wal/wals/059177b44a51490f9765e20391967605
I20260810 01:58:25.441134 26446 catalog_manager.cc:5050] TS 9353b63b4d854d23b51a8103bc899aab (127.21.64.198:41745): tablet 059177b44a51490f9765e20391967605 (table rebalance_test_table_3 [id=165a82ad66824212a25d38b164e619d1]) successfully deleted
I20260810 01:58:25.530560 28916 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 01:58:25.541599 28379 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:25.542785 26806 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 01:58:25.554069 28563 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:58:25.554877 26976 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:25.560858 28739 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:58:25.589903 26634 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:58:25.633770 1814 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:58:25.724098 26828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c72cec0deb794dac95b7a88308c56167"
dest_uuid: "60d4538b78b44201964cf440ea562c72"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:53696
I20260810 01:58:25.724323 26828 raft_consensus.cc:606] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72 [term 1 LEADER]: Received request to transfer leadership
I20260810 01:58:25.831974 26719 maintenance_manager.cc:419] P a46364d7cd504f8ca7fc003c59ae6d31: Scheduling FlushMRSOp(b59ebeb3dc294227a54a82a640c798ce): perf score=0.033388
I20260810 01:58:25.846549 28379 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:25.847015 26886 maintenance_manager.cc:419] P 60d4538b78b44201964cf440ea562c72: Scheduling FlushMRSOp(3c77a4e4068b4dac971c281f5819a5a9): perf score=0.033389
I20260810 01:58:25.867933 28916 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 01:58:25.868820 26806 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 01:58:25.875101 26976 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:25.906898 28563 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:58:25.927526 28739 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:58:25.954342 2075 raft_consensus.cc:993] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72: : Instructing follower 07e0a39216984856b2ff8c512c4c2f93 to start an election
I20260810 01:58:25.954526 2075 raft_consensus.cc:1081] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72 [term 1 LEADER]: Signalling peer 07e0a39216984856b2ff8c512c4c2f93 to start an election
I20260810 01:58:25.955338 28941 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c72cec0deb794dac95b7a88308c56167"
dest_uuid: "07e0a39216984856b2ff8c512c4c2f93"
from {username='slave'} at 127.21.64.194:33663
I20260810 01:58:25.955577 28941 raft_consensus.cc:493] T c72cec0deb794dac95b7a88308c56167 P 07e0a39216984856b2ff8c512c4c2f93 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260810 01:58:25.955706 28941 raft_consensus.cc:3060] T c72cec0deb794dac95b7a88308c56167 P 07e0a39216984856b2ff8c512c4c2f93 [term 1 FOLLOWER]: Advancing to term 2
I20260810 01:58:25.959115 28941 raft_consensus.cc:515] T c72cec0deb794dac95b7a88308c56167 P 07e0a39216984856b2ff8c512c4c2f93 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 1621 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } peers { permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 } }
I20260810 01:58:25.961024 1836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72cec0deb794dac95b7a88308c56167" candidate_uuid: "07e0a39216984856b2ff8c512c4c2f93" candidate_term: 2 candidate_status { last_received { term: 1 index: 1621 } } ignore_live_leader: true dest_uuid: "e88eaab4436345f48ef52e0675768ea6"
I20260810 01:58:25.961282 1836 raft_consensus.cc:3060] T c72cec0deb794dac95b7a88308c56167 P e88eaab4436345f48ef52e0675768ea6 [term 1 FOLLOWER]: Advancing to term 2
I20260810 01:58:25.965003 1836 raft_consensus.cc:2468] T c72cec0deb794dac95b7a88308c56167 P e88eaab4436345f48ef52e0675768ea6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07e0a39216984856b2ff8c512c4c2f93 in term 2.
I20260810 01:58:25.966123 28852 leader_election.cc:304] T c72cec0deb794dac95b7a88308c56167 P 07e0a39216984856b2ff8c512c4c2f93 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07e0a39216984856b2ff8c512c4c2f93, e88eaab4436345f48ef52e0675768ea6; no voters:
I20260810 01:58:25.966500 2712 raft_consensus.cc:2804] T c72cec0deb794dac95b7a88308c56167 P 07e0a39216984856b2ff8c512c4c2f93 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 01:58:25.968967 1835 raft_consensus.cc:1240] T c72cec0deb794dac95b7a88308c56167 P e88eaab4436345f48ef52e0675768ea6 [term 2 FOLLOWER]: Rejecting Update request from peer 60d4538b78b44201964cf440ea562c72 for earlier term 1. Current term is 2. Ops: []
I20260810 01:58:25.969575 26828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72cec0deb794dac95b7a88308c56167" candidate_uuid: "07e0a39216984856b2ff8c512c4c2f93" candidate_term: 2 candidate_status { last_received { term: 1 index: 1621 } } ignore_live_leader: true dest_uuid: "60d4538b78b44201964cf440ea562c72"
I20260810 01:58:25.969817 26828 raft_consensus.cc:3055] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72 [term 1 LEADER]: Stepping down as leader of term 1
I20260810 01:58:25.969913 26828 raft_consensus.cc:740] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 60d4538b78b44201964cf440ea562c72, State: Running, Role: LEADER
I20260810 01:58:25.970244 26828 consensus_queue.cc:260] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1621, Committed index: 1621, Last appended: 1.1621, Last appended by leader: 1621, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 1621 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } peers { permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 } }
I20260810 01:58:25.970466 26828 raft_consensus.cc:3060] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72 [term 1 FOLLOWER]: Advancing to term 2
I20260810 01:58:25.970553 28941 leader_election.cc:290] T c72cec0deb794dac95b7a88308c56167 P 07e0a39216984856b2ff8c512c4c2f93 [CANDIDATE]: Term 2 election: Requested vote from peers 60d4538b78b44201964cf440ea562c72 (127.21.64.194:36943), e88eaab4436345f48ef52e0675768ea6 (127.21.64.200:43937)
I20260810 01:58:25.975620 2712 raft_consensus.cc:697] T c72cec0deb794dac95b7a88308c56167 P 07e0a39216984856b2ff8c512c4c2f93 [term 2 LEADER]: Becoming Leader. State: Replica: 07e0a39216984856b2ff8c512c4c2f93, State: Running, Role: LEADER
I20260810 01:58:25.975795 26828 raft_consensus.cc:2468] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07e0a39216984856b2ff8c512c4c2f93 in term 2.
I20260810 01:58:25.976181 2712 consensus_queue.cc:237] T c72cec0deb794dac95b7a88308c56167 P 07e0a39216984856b2ff8c512c4c2f93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1621, Committed index: 1621, Last appended: 1.1621, Last appended by leader: 1621, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1621 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } peers { permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 } }
I20260810 01:58:25.976504 1814 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:58:25.999580 26466 catalog_manager.cc:5719] T c72cec0deb794dac95b7a88308c56167 P 07e0a39216984856b2ff8c512c4c2f93 reported cstate change: term changed from 1 to 2, leader changed from 60d4538b78b44201964cf440ea562c72 (127.21.64.194) to 07e0a39216984856b2ff8c512c4c2f93 (127.21.64.199). New cstate: current_term: 2 leader_uuid: "07e0a39216984856b2ff8c512c4c2f93" committed_config { opid_index: 1621 OBSOLETE_local: false peers { permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 } } peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } peers { permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 } } }
I20260810 01:58:26.002244 26634 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:58:26.235705 26578 maintenance_manager.cc:643] P a46364d7cd504f8ca7fc003c59ae6d31: FlushMRSOp(b59ebeb3dc294227a54a82a640c798ce) complete. Timing: real 0.401s user 0.087s sys 0.103s Metrics: {"bytes_written":46860,"cfile_init":1,"dirs.queue_time_us":6574,"dirs.run_cpu_time_us":255,"dirs.run_wall_time_us":12320,"drs_written":1,"lbm_read_time_us":96,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1536,"lbm_writes_lt_1ms":24,"peak_mem_usage":0,"rows_written":2081,"thread_start_us":6701,"threads_started":1}
I20260810 01:58:26.236799 26719 maintenance_manager.cc:419] P a46364d7cd504f8ca7fc003c59ae6d31: Scheduling UndoDeltaBlockGCOp(b59ebeb3dc294227a54a82a640c798ce): 20926 bytes on disk
I20260810 01:58:26.237596 26578 maintenance_manager.cc:643] P a46364d7cd504f8ca7fc003c59ae6d31: UndoDeltaBlockGCOp(b59ebeb3dc294227a54a82a640c798ce) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":115,"lbm_reads_lt_1ms":4}
I20260810 01:58:26.270496 26746 maintenance_manager.cc:643] P 60d4538b78b44201964cf440ea562c72: FlushMRSOp(3c77a4e4068b4dac971c281f5819a5a9) complete. Timing: real 0.422s user 0.114s sys 0.103s Metrics: {"bytes_written":48566,"cfile_init":1,"dirs.queue_time_us":6513,"dirs.run_cpu_time_us":196,"dirs.run_wall_time_us":15526,"drs_written":1,"lbm_read_time_us":72,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1655,"lbm_writes_lt_1ms":24,"peak_mem_usage":0,"rows_written":2155,"thread_start_us":6907,"threads_started":2,"wal-append.queue_time_us":367}
I20260810 01:58:26.271551 26886 maintenance_manager.cc:419] P 60d4538b78b44201964cf440ea562c72: Scheduling UndoDeltaBlockGCOp(3c77a4e4068b4dac971c281f5819a5a9): 21699 bytes on disk
I20260810 01:58:26.272082 26746 maintenance_manager.cc:643] P 60d4538b78b44201964cf440ea562c72: UndoDeltaBlockGCOp(3c77a4e4068b4dac971c281f5819a5a9) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":80,"lbm_reads_lt_1ms":4}
I20260810 01:58:26.438230 1836 raft_consensus.cc:1275] T c72cec0deb794dac95b7a88308c56167 P e88eaab4436345f48ef52e0675768ea6 [term 2 FOLLOWER]: Refusing update from remote peer 07e0a39216984856b2ff8c512c4c2f93: Log matching property violated. Preceding OpId in replica: term: 1 index: 1621. Preceding OpId from leader: term: 2 index: 1622. (index mismatch)
I20260810 01:58:26.438994 2712 consensus_queue.cc:1048] T c72cec0deb794dac95b7a88308c56167 P 07e0a39216984856b2ff8c512c4c2f93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1622, Last known committed idx: 1621, Time since last communication: 0.000s
I20260810 01:58:26.475777 26828 raft_consensus.cc:1275] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72 [term 2 FOLLOWER]: Refusing update from remote peer 07e0a39216984856b2ff8c512c4c2f93: Log matching property violated. Preceding OpId in replica: term: 1 index: 1621. Preceding OpId from leader: term: 2 index: 1622. (index mismatch)
I20260810 01:58:26.477485 2712 consensus_queue.cc:1048] T c72cec0deb794dac95b7a88308c56167 P 07e0a39216984856b2ff8c512c4c2f93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d4538b78b44201964cf440ea562c72" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 36943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1622, Last known committed idx: 1621, Time since last communication: 0.000s
I20260810 01:58:26.515270 28379 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:26.527870 26976 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:26.538466 28916 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:58:26.538749 28563 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:58:26.582887 26806 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:26.587325 28739 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:58:26.591167 26634 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:58:26.674117 1814 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:58:26.777724 28941 consensus_queue.cc:237] T b59ebeb3dc294227a54a82a640c798ce P 07e0a39216984856b2ff8c512c4c2f93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1412, Committed index: 1412, Last appended: 2.1412, Last appended by leader: 1411, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1413 OBSOLETE_local: false peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } peers { permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 } }
I20260810 01:58:26.780110 1836 raft_consensus.cc:1275] T b59ebeb3dc294227a54a82a640c798ce P e88eaab4436345f48ef52e0675768ea6 [term 2 FOLLOWER]: Refusing update from remote peer 07e0a39216984856b2ff8c512c4c2f93: Log matching property violated. Preceding OpId in replica: term: 2 index: 1412. Preceding OpId from leader: term: 2 index: 1413. (index mismatch)
I20260810 01:58:26.780709 3004 consensus_queue.cc:1048] T b59ebeb3dc294227a54a82a640c798ce P 07e0a39216984856b2ff8c512c4c2f93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1413, Last known committed idx: 1412, Time since last communication: 0.000s
I20260810 01:58:26.784083 3063 raft_consensus.cc:2955] T b59ebeb3dc294227a54a82a640c798ce P 07e0a39216984856b2ff8c512c4c2f93 [term 2 LEADER]: Committing config change with OpId 2.1413: config changed from index 1411 to 1413, VOTER a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193) evicted. New config: { opid_index: 1413 OBSOLETE_local: false peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } peers { permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 } } }
I20260810 01:58:26.784752 1836 raft_consensus.cc:2955] T b59ebeb3dc294227a54a82a640c798ce P e88eaab4436345f48ef52e0675768ea6 [term 2 FOLLOWER]: Committing config change with OpId 2.1413: config changed from index 1411 to 1413, VOTER a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193) evicted. New config: { opid_index: 1413 OBSOLETE_local: false peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } peers { permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 } } }
I20260810 01:58:26.791016 26457 catalog_manager.cc:5719] T b59ebeb3dc294227a54a82a640c798ce P 07e0a39216984856b2ff8c512c4c2f93 reported cstate change: config changed from index 1411 to 1413, VOTER a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193) evicted. New cstate: current_term: 2 leader_uuid: "07e0a39216984856b2ff8c512c4c2f93" committed_config { opid_index: 1413 OBSOLETE_local: false peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } peers { permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 } } }
I20260810 01:58:26.797704 26634 tablet_service.cc:1558] Processing DeleteTablet for tablet b59ebeb3dc294227a54a82a640c798ce with delete_type TABLET_DATA_TOMBSTONED (TS a46364d7cd504f8ca7fc003c59ae6d31 not found in new config with opid_index 1413) from {username='slave'} at 127.0.0.1:37082
I20260810 01:58:26.798478 3126 tablet_replica.cc:333] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31: stopping tablet replica
I20260810 01:58:26.798728 3126 raft_consensus.cc:2243] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260810 01:58:26.798976 3126 raft_consensus.cc:2272] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260810 01:58:26.801723 3126 ts_tablet_manager.cc:1916] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:58:26.811468 3126 ts_tablet_manager.cc:1929] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.1412
I20260810 01:58:26.811576 3126 log.cc:1199] T b59ebeb3dc294227a54a82a640c798ce P a46364d7cd504f8ca7fc003c59ae6d31: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/wal/wals/b59ebeb3dc294227a54a82a640c798ce
I20260810 01:58:26.812556 26446 catalog_manager.cc:5050] TS a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193:45781): tablet b59ebeb3dc294227a54a82a640c798ce (table rebalance_test_table_4 [id=b8ab0a3e55d1493fb5fc271a33432c29]) successfully deleted
I20260810 01:58:26.953426 26976 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:26.954686 28916 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:58:26.955197 28379 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:26.964815 26806 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:26.977231 28563 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:58:26.988341 28739 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:58:26.994398 26634 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:58:27.054649 1814 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:58:27.171005 28941 consensus_queue.cc:237] T c72cec0deb794dac95b7a88308c56167 P 07e0a39216984856b2ff8c512c4c2f93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1622, Committed index: 1622, Last appended: 2.1622, Last appended by leader: 1621, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1623 OBSOLETE_local: false peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } peers { permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 } }
I20260810 01:58:27.172788 1836 raft_consensus.cc:1275] T c72cec0deb794dac95b7a88308c56167 P e88eaab4436345f48ef52e0675768ea6 [term 2 FOLLOWER]: Refusing update from remote peer 07e0a39216984856b2ff8c512c4c2f93: Log matching property violated. Preceding OpId in replica: term: 2 index: 1622. Preceding OpId from leader: term: 2 index: 1623. (index mismatch)
I20260810 01:58:27.173398 3063 consensus_queue.cc:1048] T c72cec0deb794dac95b7a88308c56167 P 07e0a39216984856b2ff8c512c4c2f93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1623, Last known committed idx: 1622, Time since last communication: 0.000s
I20260810 01:58:27.175707 3004 raft_consensus.cc:2955] T c72cec0deb794dac95b7a88308c56167 P 07e0a39216984856b2ff8c512c4c2f93 [term 2 LEADER]: Committing config change with OpId 2.1623: config changed from index 1621 to 1623, VOTER 60d4538b78b44201964cf440ea562c72 (127.21.64.194) evicted. New config: { opid_index: 1623 OBSOLETE_local: false peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } peers { permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 } } }
I20260810 01:58:27.179415 1836 raft_consensus.cc:2955] T c72cec0deb794dac95b7a88308c56167 P e88eaab4436345f48ef52e0675768ea6 [term 2 FOLLOWER]: Committing config change with OpId 2.1623: config changed from index 1621 to 1623, VOTER 60d4538b78b44201964cf440ea562c72 (127.21.64.194) evicted. New config: { opid_index: 1623 OBSOLETE_local: false peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } peers { permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 } } }
I20260810 01:58:27.180856 26457 catalog_manager.cc:5719] T c72cec0deb794dac95b7a88308c56167 P 07e0a39216984856b2ff8c512c4c2f93 reported cstate change: config changed from index 1621 to 1623, VOTER 60d4538b78b44201964cf440ea562c72 (127.21.64.194) evicted. New cstate: current_term: 2 leader_uuid: "07e0a39216984856b2ff8c512c4c2f93" committed_config { opid_index: 1623 OBSOLETE_local: false peers { permanent_uuid: "07e0a39216984856b2ff8c512c4c2f93" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 42747 } } peers { permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 } } }
I20260810 01:58:27.186721 26806 tablet_service.cc:1558] Processing DeleteTablet for tablet c72cec0deb794dac95b7a88308c56167 with delete_type TABLET_DATA_TOMBSTONED (TS 60d4538b78b44201964cf440ea562c72 not found in new config with opid_index 1623) from {username='slave'} at 127.0.0.1:59826
I20260810 01:58:27.194689 3204 tablet_replica.cc:333] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72: stopping tablet replica
I20260810 01:58:27.194965 3204 raft_consensus.cc:2243] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260810 01:58:27.195277 3204 raft_consensus.cc:2272] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260810 01:58:27.197407 3204 ts_tablet_manager.cc:1916] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:58:27.206593 3204 ts_tablet_manager.cc:1929] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.1622
I20260810 01:58:27.206764 3204 log.cc:1199] T c72cec0deb794dac95b7a88308c56167 P 60d4538b78b44201964cf440ea562c72: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal/wals/c72cec0deb794dac95b7a88308c56167
I20260810 01:58:27.207921 26442 catalog_manager.cc:5050] TS 60d4538b78b44201964cf440ea562c72 (127.21.64.194:36943): tablet c72cec0deb794dac95b7a88308c56167 (table rebalance_test_table_0 [id=52f00827f2964d63b49607d8194867d6]) successfully deleted
I20260810 01:58:27.326243 28916 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:58:27.346105 28379 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:27.347532 28739 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:58:27.351354 26806 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:27.363152 26976 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:27.367674 28563 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:58:27.380313 1814 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:58:27.470450 26634 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:58:27.710824 26976 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:27.712659 28379 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:27.714723 28916 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:58:27.737114 26806 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:27.754513 1814 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:58:27.754640 28739 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:58:27.755743 28563 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:58:27.774448 26634 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:58:28.297051 28916 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:58:28.299196 26976 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:28.307839 28379 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:28.308285 26806 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 01:58:28.327168 26634 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:58:28.346903 28739 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:58:28.372654 28563 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:58:28.379029 1814 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+---------------------+---------
c7a6ab8e5a4c4f8a98fa2c3426f0ed8f | 127.21.64.254:38173 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------+-------------------------
allow_unsafe_replication_factor | true | runtime,unsafe | all 1 server(s) checked
ipki_ca_key_size | 768 | experimental | all 1 server(s) checked
ipki_server_key_size | 768 | experimental | all 1 server(s) checked
never_fsync | true | unsafe,advanced | all 1 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 1 server(s) checked
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 1 server(s) checked
rpc_reuseport | true | experimental | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
server_dump_info_format | pb | hidden | all 1 server(s) checked
server_dump_info_path | /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/data/info.pb | hidden | all 1 server(s) checked
tsk_num_rsa_bits | 512 | experimental | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+---------------------+-------------------------
builtin_ntp_servers | 127.21.64.212:42671 | all 1 server(s) checked
time_source | builtin | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+---------------------+---------+----------+----------------+-----------------
07e0a39216984856b2ff8c512c4c2f93 | 127.21.64.199:42747 | HEALTHY | <none> | 4 | 0
28812b178f824d539cab11abfe98d77d | 127.21.64.196:41095 | HEALTHY | <none> | 2 | 0
56388bef1a0f453cadc8b6aa9434311d | 127.21.64.195:45355 | HEALTHY | <none> | 2 | 0
60d4538b78b44201964cf440ea562c72 | 127.21.64.194:36943 | HEALTHY | <none> | 2 | 0
8be4ab1c5cca41849942448806160d19 | 127.21.64.197:46107 | HEALTHY | <none> | 1 | 0
9353b63b4d854d23b51a8103bc899aab | 127.21.64.198:41745 | HEALTHY | <none> | 1 | 0
a46364d7cd504f8ca7fc003c59ae6d31 | 127.21.64.193:45781 | HEALTHY | <none> | 4 | 0
e88eaab4436345f48ef52e0675768ea6 | 127.21.64.200:43937 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 8
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------+-------------------------
ipki_server_key_size | 768 | experimental | all 8 server(s) checked
local_ip_for_outbound_sockets | 127.21.64.193 | experimental | 127.21.64.193:45781
local_ip_for_outbound_sockets | 127.21.64.194 | experimental | 127.21.64.194:36943
local_ip_for_outbound_sockets | 127.21.64.195 | experimental | 127.21.64.195:45355
local_ip_for_outbound_sockets | 127.21.64.196 | experimental | 127.21.64.196:41095
local_ip_for_outbound_sockets | 127.21.64.197 | experimental | 127.21.64.197:46107
local_ip_for_outbound_sockets | 127.21.64.198 | experimental | 127.21.64.198:41745
local_ip_for_outbound_sockets | 127.21.64.199 | experimental | 127.21.64.199:42747
local_ip_for_outbound_sockets | 127.21.64.200 | experimental | 127.21.64.200:43937
never_fsync | true | unsafe,advanced | all 8 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 8 server(s) checked
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 8 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 8 server(s) checked
server_dump_info_format | pb | hidden | all 8 server(s) checked
server_dump_info_path | /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/data/info.pb | hidden | 127.21.64.193:45781
server_dump_info_path | /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/data/info.pb | hidden | 127.21.64.194:36943
server_dump_info_path | /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/data/info.pb | hidden | 127.21.64.195:45355
server_dump_info_path | /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/data/info.pb | hidden | 127.21.64.196:41095
server_dump_info_path | /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data/info.pb | hidden | 127.21.64.197:46107
server_dump_info_path | /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/data/info.pb | hidden | 127.21.64.198:41745
server_dump_info_path | /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/data/info.pb | hidden | 127.21.64.199:42747
server_dump_info_path | /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/data/info.pb | hidden | 127.21.64.200:43937
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+---------------------+-------------------------
builtin_ntp_servers | 127.21.64.212:42671 | all 8 server(s) checked
time_source | builtin | all 8 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 9 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
------------------------+----+---------+---------------+---------+------------+------------------+-------------
TestTable | 2 | HEALTHY | 1 | 1 | 0 | 0 | 0
rebalance_test_table_0 | 2 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_1 | 2 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_2 | 2 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_3 | 2 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_4 | 2 | HEALTHY | 3 | 3 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 4
First Quartile | 4
Median | 4
Third Quartile | 4
Maximum | 4
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 8
Tables | 6
Tablets | 16
Replicas | 32
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20260810 01:58:28.447753 21763 log_verifier.cc:126] Checking tablet 059177b44a51490f9765e20391967605
I20260810 01:58:28.942914 21763 log_verifier.cc:177] Verified matching terms for 1314 ops in tablet 059177b44a51490f9765e20391967605
I20260810 01:58:28.944541 21763 log_verifier.cc:126] Checking tablet 059c8fa5da994e6c9f3582df4542d276
I20260810 01:58:29.528019 21763 log_verifier.cc:177] Verified matching terms for 1617 ops in tablet 059c8fa5da994e6c9f3582df4542d276
I20260810 01:58:29.529597 21763 log_verifier.cc:126] Checking tablet 127b90e3636b4715b441964a1c43afc1
I20260810 01:58:29.912415 21763 log_verifier.cc:177] Verified matching terms for 1266 ops in tablet 127b90e3636b4715b441964a1c43afc1
I20260810 01:58:29.913568 21763 log_verifier.cc:126] Checking tablet 39a14ec9527d43b4a6f78b48ad4165cf
I20260810 01:58:30.348855 21763 log_verifier.cc:177] Verified matching terms for 1250 ops in tablet 39a14ec9527d43b4a6f78b48ad4165cf
I20260810 01:58:30.349998 21763 log_verifier.cc:126] Checking tablet 3c77a4e4068b4dac971c281f5819a5a9
I20260810 01:58:30.800284 21763 log_verifier.cc:177] Verified matching terms for 1471 ops in tablet 3c77a4e4068b4dac971c281f5819a5a9
I20260810 01:58:30.801831 21763 log_verifier.cc:126] Checking tablet 40f41d25879b4c58ade48978afadf2ef
I20260810 01:58:31.246820 21763 log_verifier.cc:177] Verified matching terms for 1216 ops in tablet 40f41d25879b4c58ade48978afadf2ef
I20260810 01:58:31.248059 21763 log_verifier.cc:126] Checking tablet 4277bfd83a7e48f8a89be6d3ee55558d
I20260810 01:58:31.264982 21763 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 4277bfd83a7e48f8a89be6d3ee55558d
I20260810 01:58:31.265112 21763 log_verifier.cc:126] Checking tablet 4403a36d26db47278a82abb5df118bbd
I20260810 01:58:31.765389 21763 log_verifier.cc:177] Verified matching terms for 1678 ops in tablet 4403a36d26db47278a82abb5df118bbd
I20260810 01:58:31.767025 21763 log_verifier.cc:126] Checking tablet 4f7860cf1d8449fc9f062f3e09e4aafd
I20260810 01:58:32.248497 21763 log_verifier.cc:177] Verified matching terms for 1409 ops in tablet 4f7860cf1d8449fc9f062f3e09e4aafd
I20260810 01:58:32.249923 21763 log_verifier.cc:126] Checking tablet b10c8ac173fc40ca9817d1b654117ca1
I20260810 01:58:32.645771 21763 log_verifier.cc:177] Verified matching terms for 1283 ops in tablet b10c8ac173fc40ca9817d1b654117ca1
I20260810 01:58:32.647074 21763 log_verifier.cc:126] Checking tablet b59ebeb3dc294227a54a82a640c798ce
I20260810 01:58:33.206890 21763 log_verifier.cc:177] Verified matching terms for 1413 ops in tablet b59ebeb3dc294227a54a82a640c798ce
I20260810 01:58:33.208467 21763 log_verifier.cc:126] Checking tablet c72cec0deb794dac95b7a88308c56167
I20260810 01:58:33.277926 29008 maintenance_manager.cc:419] P 07e0a39216984856b2ff8c512c4c2f93: Scheduling FlushMRSOp(b59ebeb3dc294227a54a82a640c798ce): perf score=0.033345
I20260810 01:58:33.439951 28857 maintenance_manager.cc:643] P 07e0a39216984856b2ff8c512c4c2f93: FlushMRSOp(b59ebeb3dc294227a54a82a640c798ce) complete. Timing: real 0.161s user 0.071s sys 0.086s Metrics: {"bytes_written":46860,"cfile_init":1,"compiler_manager_pool.queue_time_us":417,"dirs.queue_time_us":462,"dirs.run_cpu_time_us":221,"dirs.run_wall_time_us":977,"drs_written":1,"lbm_read_time_us":72,"lbm_reads_lt_1ms":4,"lbm_write_time_us":990,"lbm_writes_lt_1ms":24,"peak_mem_usage":0,"rows_written":2081,"thread_start_us":936,"threads_started":3,"wal-append.queue_time_us":442}
I20260810 01:58:33.441596 29008 maintenance_manager.cc:419] P 07e0a39216984856b2ff8c512c4c2f93: Scheduling UndoDeltaBlockGCOp(b59ebeb3dc294227a54a82a640c798ce): 20926 bytes on disk
I20260810 01:58:33.442471 28857 maintenance_manager.cc:643] P 07e0a39216984856b2ff8c512c4c2f93: UndoDeltaBlockGCOp(b59ebeb3dc294227a54a82a640c798ce) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":92,"lbm_reads_lt_1ms":4}
I20260810 01:58:33.842487 21763 log_verifier.cc:177] Verified matching terms for 1623 ops in tablet c72cec0deb794dac95b7a88308c56167
I20260810 01:58:33.844241 21763 log_verifier.cc:126] Checking tablet d76ed7c57001495fb62e15bd9f14a162
I20260810 01:58:34.275359 21763 log_verifier.cc:177] Verified matching terms for 1326 ops in tablet d76ed7c57001495fb62e15bd9f14a162
I20260810 01:58:34.276690 21763 log_verifier.cc:126] Checking tablet d771b2d03cb940018a706ecc38f68a9e
I20260810 01:58:34.687978 28465 maintenance_manager.cc:419] P 28812b178f824d539cab11abfe98d77d: Scheduling FlushMRSOp(e8b0ab1f966840f3ade9f44232b39a5a): perf score=0.033336
I20260810 01:58:34.721463 21763 log_verifier.cc:177] Verified matching terms for 1276 ops in tablet d771b2d03cb940018a706ecc38f68a9e
I20260810 01:58:34.722782 21763 log_verifier.cc:126] Checking tablet e8b0ab1f966840f3ade9f44232b39a5a
I20260810 01:58:34.918111 28318 maintenance_manager.cc:643] P 28812b178f824d539cab11abfe98d77d: FlushMRSOp(e8b0ab1f966840f3ade9f44232b39a5a) complete. Timing: real 0.229s user 0.128s sys 0.098s Metrics: {"bytes_written":43723,"cfile_init":1,"compiler_manager_pool.queue_time_us":469,"dirs.queue_time_us":390,"dirs.run_cpu_time_us":239,"dirs.run_wall_time_us":803,"drs_written":1,"lbm_read_time_us":141,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1450,"lbm_writes_lt_1ms":24,"peak_mem_usage":0,"rows_written":1973,"thread_start_us":1038,"threads_started":3,"wal-append.queue_time_us":563}
I20260810 01:58:34.919978 28465 maintenance_manager.cc:419] P 28812b178f824d539cab11abfe98d77d: Scheduling UndoDeltaBlockGCOp(e8b0ab1f966840f3ade9f44232b39a5a): 19617 bytes on disk
I20260810 01:58:34.920877 28318 maintenance_manager.cc:643] P 28812b178f824d539cab11abfe98d77d: UndoDeltaBlockGCOp(e8b0ab1f966840f3ade9f44232b39a5a) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":117,"lbm_reads_lt_1ms":4}
I20260810 01:58:35.001932 28649 maintenance_manager.cc:419] P 8be4ab1c5cca41849942448806160d19: Scheduling FlushMRSOp(39a14ec9527d43b4a6f78b48ad4165cf): perf score=0.033394
W20260810 01:58:35.063591 28497 dir_manager.cc:275] Insufficient disk space under path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data/data: will retry after 10 seconds: IO error: Insufficient disk space to allocate 0 bytes under path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data/data (500989952 bytes available vs 518351011 bytes reserved) (error 28)
W20260810 01:58:35.103448 28497 tablet_replica_mm_ops.cc:214] T 39a14ec9527d43b4a6f78b48ad4165cf P 8be4ab1c5cca41849942448806160d19: failed to flush MRS: IO error: Failed to open DiskRowSet for flush: No directories could be added (1 dirs total, 0 failed, 1 full): IO error: No directories available in 39a14ec9527d43b4a6f78b48ad4165cf's directory group (1 dirs total, 0 failed, 1 full) (error 28) (error 19)
F20260810 01:58:35.103855 28497 tablet_replica_mm_ops.cc:215] Check failed: tablet->HasBeenStopped() Unrecoverable flush failure caused by error: IO error: Failed to open DiskRowSet for flush: No directories could be added (1 dirs total, 0 failed, 1 full): IO error: No directories available in 39a14ec9527d43b4a6f78b48ad4165cf's directory group (1 dirs total, 0 failed, 1 full) (error 28) (error 19)
*** Check failure stack trace: ***
@ 0x7fc31984cd5d google::LogMessage::Fail() at ??:0
@ 0x7fc319850b23 google::LogMessage::SendToLog() at ??:0
@ 0x7fc31984c75c google::LogMessage::Flush() at ??:0
@ 0x7fc31984dee9 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fc3299ca8bd kudu::tablet::FlushMRSOp::Perform() at ??:0
@ 0x7fc31c61eb09 kudu::MaintenanceManager::LaunchOp() at ??:0
@ 0x7fc31c621a43 kudu::MaintenanceManager::RunSchedulerThread()::$_3::operator()() at ??:0
@ 0x7fc31c6218d9 std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaaf86d std::function<>::operator()() at ??:?
@ 0x7fc31c595850 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fc31c598b4c kudu::ThreadPool::CreateThread()::$_1::operator()() at ??:0
@ 0x7fc31c5989c9 std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaaf86d std::function<>::operator()() at ??:?
@ 0x7fc31c574dd9 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fc31fc446db start_thread at ??:0
@ 0x7fc3186fb61f clone at ??:0
I20260810 01:58:35.297554 21763 log_verifier.cc:177] Verified matching terms for 1289 ops in tablet e8b0ab1f966840f3ade9f44232b39a5a
I20260810 01:58:35.299731 21763 log_verifier.cc:126] Checking tablet fdf1cc811a8349efa251d05e9b077fad
W20260810 01:58:35.476631 26574 connection.cc:573] client connection to 127.21.64.197:46107 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 01:58:35.476778 28675 connection.cc:573] client connection to 127.21.64.197:46107 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 01:58:35.476903 26574 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 01:58:35.476986 28675 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 01:58:35.477895 26739 connection.cc:573] client connection to 127.21.64.197:46107 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 01:58:35.478148 26739 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 01:58:35.487498 28675 consensus_peers.cc:597] T b10c8ac173fc40ca9817d1b654117ca1 P 9353b63b4d854d23b51a8103bc899aab -> Peer 8be4ab1c5cca41849942448806160d19 (127.21.64.197:46107): Couldn't send request to peer 8be4ab1c5cca41849942448806160d19. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.197:46107: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260810 01:58:35.488176 26574 consensus_peers.cc:597] T 39a14ec9527d43b4a6f78b48ad4165cf P a46364d7cd504f8ca7fc003c59ae6d31 -> Peer 8be4ab1c5cca41849942448806160d19 (127.21.64.197:46107): Couldn't send request to peer 8be4ab1c5cca41849942448806160d19. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.197:46107: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260810 01:58:35.488749 26739 consensus_peers.cc:597] T 3c77a4e4068b4dac971c281f5819a5a9 P 60d4538b78b44201964cf440ea562c72 -> Peer 8be4ab1c5cca41849942448806160d19 (127.21.64.197:46107): Couldn't send request to peer 8be4ab1c5cca41849942448806160d19. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.197:46107: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 01:58:35.698454 29008 maintenance_manager.cc:419] P 07e0a39216984856b2ff8c512c4c2f93: Scheduling FlushMRSOp(c72cec0deb794dac95b7a88308c56167): perf score=0.033400
I20260810 01:58:35.796861 21763 log_verifier.cc:177] Verified matching terms for 1295 ops in tablet fdf1cc811a8349efa251d05e9b077fad
I20260810 01:58:35.806849 21763 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskNubV1X/build/asan/bin/kudu pid 26557
I20260810 01:58:35.826148 28857 maintenance_manager.cc:643] P 07e0a39216984856b2ff8c512c4c2f93: FlushMRSOp(c72cec0deb794dac95b7a88308c56167) complete. Timing: real 0.127s user 0.100s sys 0.025s Metrics: {"bytes_written":52181,"cfile_init":1,"dirs.queue_time_us":387,"dirs.run_cpu_time_us":275,"dirs.run_wall_time_us":1506,"drs_written":1,"lbm_read_time_us":62,"lbm_reads_lt_1ms":4,"lbm_write_time_us":986,"lbm_writes_lt_1ms":24,"peak_mem_usage":0,"rows_written":2304,"thread_start_us":6695,"threads_started":2,"wal-append.queue_time_us":6322}
I20260810 01:58:35.827133 29008 maintenance_manager.cc:419] P 07e0a39216984856b2ff8c512c4c2f93: Scheduling UndoDeltaBlockGCOp(c72cec0deb794dac95b7a88308c56167): 23412 bytes on disk
I20260810 01:58:35.827807 28857 maintenance_manager.cc:643] P 07e0a39216984856b2ff8c512c4c2f93: UndoDeltaBlockGCOp(c72cec0deb794dac95b7a88308c56167) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":107,"lbm_reads_lt_1ms":4}
I20260810 01:58:35.828301 26708 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 01:58:35.924440 28465 maintenance_manager.cc:419] P 28812b178f824d539cab11abfe98d77d: Scheduling FlushMRSOp(fdf1cc811a8349efa251d05e9b077fad): perf score=0.033343
I20260810 01:58:36.001009 28318 maintenance_manager.cc:643] P 28812b178f824d539cab11abfe98d77d: FlushMRSOp(fdf1cc811a8349efa251d05e9b077fad) complete. Timing: real 0.076s user 0.050s sys 0.023s Metrics: {"bytes_written":43894,"cfile_init":1,"dirs.queue_time_us":387,"dirs.run_cpu_time_us":271,"dirs.run_wall_time_us":1357,"drs_written":1,"lbm_read_time_us":88,"lbm_reads_lt_1ms":4,"lbm_write_time_us":893,"lbm_writes_lt_1ms":24,"peak_mem_usage":0,"rows_written":1966,"thread_start_us":1076,"threads_started":2,"wal-append.queue_time_us":896}
I20260810 01:58:36.001964 28465 maintenance_manager.cc:419] P 28812b178f824d539cab11abfe98d77d: Scheduling UndoDeltaBlockGCOp(fdf1cc811a8349efa251d05e9b077fad): 19594 bytes on disk
I20260810 01:58:36.002532 28318 maintenance_manager.cc:643] P 28812b178f824d539cab11abfe98d77d: UndoDeltaBlockGCOp(fdf1cc811a8349efa251d05e9b077fad) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":69,"lbm_reads_lt_1ms":4}
I20260810 01:58:36.183185 21763 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskNubV1X/build/asan/bin/kudu with pid 26557
I20260810 01:58:36.253144 21763 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskNubV1X/build/asan/bin/kudu pid 26722
W20260810 01:58:36.253269 1750 connection.cc:573] server connection from 127.21.64.193:44429 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 01:58:36.259733 26877 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 01:58:36.488826 28826 maintenance_manager.cc:419] P 9353b63b4d854d23b51a8103bc899aab: Scheduling FlushMRSOp(d76ed7c57001495fb62e15bd9f14a162): perf score=0.033345
W20260810 01:58:36.492617 28680 dir_manager.cc:275] Insufficient disk space under path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/data/data: will retry after 10 seconds: IO error: Insufficient disk space to allocate 0 bytes under path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/data/data (500682752 bytes available vs 518351011 bytes reserved) (error 28)
W20260810 01:58:36.493824 28680 tablet_replica_mm_ops.cc:214] T d76ed7c57001495fb62e15bd9f14a162 P 9353b63b4d854d23b51a8103bc899aab: failed to flush MRS: IO error: Failed to open DiskRowSet for flush: tablet d76ed7c57001495fb62e15bd9f14a162: unable to open output file for column key INT32 NOT NULL: No directories could be added (1 dirs total, 0 failed, 1 full): IO error: No directories available in d76ed7c57001495fb62e15bd9f14a162's directory group (1 dirs total, 0 failed, 1 full) (error 28) (error 19)
F20260810 01:58:36.493933 28680 tablet_replica_mm_ops.cc:215] Check failed: tablet->HasBeenStopped() Unrecoverable flush failure caused by error: IO error: Failed to open DiskRowSet for flush: tablet d76ed7c57001495fb62e15bd9f14a162: unable to open output file for column key INT32 NOT NULL: No directories could be added (1 dirs total, 0 failed, 1 full): IO error: No directories available in d76ed7c57001495fb62e15bd9f14a162's directory group (1 dirs total, 0 failed, 1 full) (error 28) (error 19)
*** Check failure stack trace: ***
@ 0x7f2f47d07d5d google::LogMessage::Fail() at ??:0
@ 0x7f2f47d0bb23 google::LogMessage::SendToLog() at ??:0
@ 0x7f2f47d0775c google::LogMessage::Flush() at ??:0
@ 0x7f2f47d08ee9 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f2f57e858bd kudu::tablet::FlushMRSOp::Perform() at ??:0
@ 0x7f2f4aad9b09 kudu::MaintenanceManager::LaunchOp() at ??:0
@ 0x7f2f4aadca43 kudu::MaintenanceManager::RunSchedulerThread()::$_3::operator()() at ??:0
@ 0x7f2f4aadc8d9 std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaaf86d std::function<>::operator()() at ??:?
@ 0x7f2f4aa50850 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f2f4aa53b4c kudu::ThreadPool::CreateThread()::$_1::operator()() at ??:0
@ 0x7f2f4aa539c9 std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaaf86d std::function<>::operator()() at ??:?
@ 0x7f2f4aa2fdd9 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f2f4e0ff6db start_thread at ??:0
@ 0x7f2f46bb661f clone at ??:0
I20260810 01:58:36.616053 3391 raft_consensus.cc:493] T 059c8fa5da994e6c9f3582df4542d276 P 56388bef1a0f453cadc8b6aa9434311d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8be4ab1c5cca41849942448806160d19)
I20260810 01:58:36.616283 3391 raft_consensus.cc:515] T 059c8fa5da994e6c9f3582df4542d276 P 56388bef1a0f453cadc8b6aa9434311d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 322 OBSOLETE_local: false peers { permanent_uuid: "56388bef1a0f453cadc8b6aa9434311d" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 45355 } } peers { permanent_uuid: "8be4ab1c5cca41849942448806160d19" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 46107 } }
I20260810 01:58:36.617086 3391 leader_election.cc:290] T 059c8fa5da994e6c9f3582df4542d276 P 56388bef1a0f453cadc8b6aa9434311d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8be4ab1c5cca41849942448806160d19 (127.21.64.197:46107)
W20260810 01:58:36.618289 26910 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.64.197:46107: connect: Connection refused (error 111)
W20260810 01:58:36.620044 26910 leader_election.cc:336] T 059c8fa5da994e6c9f3582df4542d276 P 56388bef1a0f453cadc8b6aa9434311d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8be4ab1c5cca41849942448806160d19 (127.21.64.197:46107): Network error: Client connection negotiation failed: client connection to 127.21.64.197:46107: connect: Connection refused (error 111)
I20260810 01:58:36.620189 26910 leader_election.cc:304] T 059c8fa5da994e6c9f3582df4542d276 P 56388bef1a0f453cadc8b6aa9434311d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: 56388bef1a0f453cadc8b6aa9434311d; no voters: 8be4ab1c5cca41849942448806160d19
I20260810 01:58:36.620491 3391 raft_consensus.cc:2749] T 059c8fa5da994e6c9f3582df4542d276 P 56388bef1a0f453cadc8b6aa9434311d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260810 01:58:36.670373 21763 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskNubV1X/build/asan/bin/kudu with pid 26722
W20260810 01:58:36.779546 28850 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.64.194:36943 (error 108)
W20260810 01:58:36.779649 26442 connection.cc:573] server connection from 127.21.64.194:37225 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 01:58:36.780543 21763 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskNubV1X/build/asan/bin/kudu pid 26889
W20260810 01:58:36.781834 28850 consensus_peers.cc:597] T d771b2d03cb940018a706ecc38f68a9e P 07e0a39216984856b2ff8c512c4c2f93 -> Peer 60d4538b78b44201964cf440ea562c72 (127.21.64.194:36943): Couldn't send request to peer 60d4538b78b44201964cf440ea562c72. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.194:36943: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 01:58:36.788318 27061 generic_service.cc:196] Checking for leaks (request via RPC)
W20260810 01:58:36.854985 28317 connection.cc:573] client connection to 127.21.64.198:41745 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 01:58:36.855269 28317 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 01:58:36.857208 28317 consensus_peers.cc:597] T 4403a36d26db47278a82abb5df118bbd P 28812b178f824d539cab11abfe98d77d -> Peer 9353b63b4d854d23b51a8103bc899aab (127.21.64.198:41745): Couldn't send request to peer 9353b63b4d854d23b51a8103bc899aab. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.198:41745: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260810 01:58:36.865872 28317 consensus_peers.cc:597] T 4f7860cf1d8449fc9f062f3e09e4aafd P 28812b178f824d539cab11abfe98d77d -> Peer 9353b63b4d854d23b51a8103bc899aab (127.21.64.198:41745): Couldn't send request to peer 9353b63b4d854d23b51a8103bc899aab. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.198:41745: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 01:58:37.165234 21763 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskNubV1X/build/asan/bin/kudu with pid 26889
I20260810 01:58:37.200490 1715 raft_consensus.cc:493] T fdf1cc811a8349efa251d05e9b077fad P 28812b178f824d539cab11abfe98d77d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a46364d7cd504f8ca7fc003c59ae6d31)
I20260810 01:58:37.200767 1715 raft_consensus.cc:515] T fdf1cc811a8349efa251d05e9b077fad P 28812b178f824d539cab11abfe98d77d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 598 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "28812b178f824d539cab11abfe98d77d" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41095 } }
I20260810 01:58:37.201647 1715 leader_election.cc:290] T fdf1cc811a8349efa251d05e9b077fad P 28812b178f824d539cab11abfe98d77d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193:45781)
W20260810 01:58:37.203410 28317 leader_election.cc:336] T fdf1cc811a8349efa251d05e9b077fad P 28812b178f824d539cab11abfe98d77d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193:45781): Network error: Client connection negotiation failed: client connection to 127.21.64.193:45781: connect: Connection refused (error 111)
I20260810 01:58:37.203603 28317 leader_election.cc:304] T fdf1cc811a8349efa251d05e9b077fad P 28812b178f824d539cab11abfe98d77d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: 28812b178f824d539cab11abfe98d77d; no voters: a46364d7cd504f8ca7fc003c59ae6d31
I20260810 01:58:37.203960 1715 raft_consensus.cc:2749] T fdf1cc811a8349efa251d05e9b077fad P 28812b178f824d539cab11abfe98d77d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 01:58:37.214517 3498 raft_consensus.cc:493] T 4277bfd83a7e48f8a89be6d3ee55558d P e88eaab4436345f48ef52e0675768ea6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a46364d7cd504f8ca7fc003c59ae6d31)
I20260810 01:58:37.214802 3498 raft_consensus.cc:515] T 4277bfd83a7e48f8a89be6d3ee55558d P e88eaab4436345f48ef52e0675768ea6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 } }
I20260810 01:58:37.216532 3498 leader_election.cc:290] T 4277bfd83a7e48f8a89be6d3ee55558d P e88eaab4436345f48ef52e0675768ea6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193:45781)
W20260810 01:58:37.218585 1752 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.64.193:45781: connect: Connection refused (error 111)
W20260810 01:58:37.220422 1752 leader_election.cc:336] T 4277bfd83a7e48f8a89be6d3ee55558d P e88eaab4436345f48ef52e0675768ea6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193:45781): Network error: Client connection negotiation failed: client connection to 127.21.64.193:45781: connect: Connection refused (error 111)
I20260810 01:58:37.220665 1752 leader_election.cc:304] T 4277bfd83a7e48f8a89be6d3ee55558d P e88eaab4436345f48ef52e0675768ea6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: e88eaab4436345f48ef52e0675768ea6; no voters: a46364d7cd504f8ca7fc003c59ae6d31
I20260810 01:58:37.221100 3498 raft_consensus.cc:2749] T 4277bfd83a7e48f8a89be6d3ee55558d P e88eaab4436345f48ef52e0675768ea6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 01:58:37.244941 28852 connection.cc:573] client connection to 127.21.64.195:45355 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 01:58:37.245486 21763 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskNubV1X/build/asan/bin/kudu pid 28294
W20260810 01:58:37.246469 28852 consensus_peers.cc:597] T 40f41d25879b4c58ade48978afadf2ef P 07e0a39216984856b2ff8c512c4c2f93 -> Peer 56388bef1a0f453cadc8b6aa9434311d (127.21.64.195:45355): Couldn't send request to peer 56388bef1a0f453cadc8b6aa9434311d. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.195:45355: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 01:58:37.251816 28457 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 01:58:37.568784 21763 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskNubV1X/build/asan/bin/kudu with pid 28294
I20260810 01:58:37.631678 21763 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskNubV1X/build/asan/bin/kudu pid 28830
I20260810 01:58:37.638630 29000 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 01:58:37.685294 3498 raft_consensus.cc:493] T 059177b44a51490f9765e20391967605 P e88eaab4436345f48ef52e0675768ea6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a46364d7cd504f8ca7fc003c59ae6d31)
I20260810 01:58:37.685566 3498 raft_consensus.cc:515] T 059177b44a51490f9765e20391967605 P e88eaab4436345f48ef52e0675768ea6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 1314 OBSOLETE_local: false peers { permanent_uuid: "a46364d7cd504f8ca7fc003c59ae6d31" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 45781 } } peers { permanent_uuid: "e88eaab4436345f48ef52e0675768ea6" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 43937 } }
I20260810 01:58:37.686259 3498 leader_election.cc:290] T 059177b44a51490f9765e20391967605 P e88eaab4436345f48ef52e0675768ea6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193:45781)
W20260810 01:58:37.687996 1752 leader_election.cc:336] T 059177b44a51490f9765e20391967605 P e88eaab4436345f48ef52e0675768ea6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a46364d7cd504f8ca7fc003c59ae6d31 (127.21.64.193:45781): Network error: Client connection negotiation failed: client connection to 127.21.64.193:45781: connect: Connection refused (error 111)
I20260810 01:58:37.688166 1752 leader_election.cc:304] T 059177b44a51490f9765e20391967605 P e88eaab4436345f48ef52e0675768ea6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: e88eaab4436345f48ef52e0675768ea6; no voters: a46364d7cd504f8ca7fc003c59ae6d31
I20260810 01:58:37.688446 3498 raft_consensus.cc:2749] T 059177b44a51490f9765e20391967605 P e88eaab4436345f48ef52e0675768ea6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 01:58:37.951532 21763 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskNubV1X/build/asan/bin/kudu with pid 28830
W20260810 01:58:38.044656 1752 connection.cc:573] server connection from 127.21.64.199:41691 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 01:58:38.045130 21763 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskNubV1X/build/asan/bin/kudu pid 1720
I20260810 01:58:38.054345 1884 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 01:58:38.282675 21763 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskNubV1X/build/asan/bin/kudu with pid 1720
W20260810 01:58:38.327179 26442 connection.cc:573] server connection from 127.21.64.200:60179 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 01:58:38.327561 21763 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskNubV1X/build/asan/bin/kudu pid 26412
I20260810 01:58:38.328703 26509 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 01:58:38.609719 21763 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskNubV1X/build/asan/bin/kudu with pid 26412
2026-08-10T01:58:38Z chronyd exiting
[ OK ] RebalanceParamTest.Rebalance/2 (146591 ms)
[----------] 1 test from RebalanceParamTest (146591 ms total)
[----------] 1 test from ConcurrentRebalancersTest
[ RUN ] ConcurrentRebalancersTest.TwoConcurrentRebalancers/0
I20260810 01:58:38.783393 21763 ts_itest-base.cc:115] Starting cluster with:
I20260810 01:58:38.783475 21763 ts_itest-base.cc:116] --------------
I20260810 01:58:38.783543 21763 ts_itest-base.cc:117] 8 tablet servers
I20260810 01:58:38.783605 21763 ts_itest-base.cc:118] 3 replicas per TS
I20260810 01:58:38.783702 21763 ts_itest-base.cc:119] --------------
2026-08-10T01:58:38Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:58:38Z Disabled control of system clock
I20260810 01:58:38.870241 21763 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNubV1X/build/asan/bin/kudu
/tmp/dist-test-taskNubV1X/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.64.254:44657
--webserver_interface=127.21.64.254
--webserver_port=0
--builtin_ntp_servers=127.21.64.212:38687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.64.254:44657
--tserver_unresponsive_timeout_ms=3000
--enable_range_replica_placement=false
--raft_prepare_replacement_before_eviction=false
--enable_range_replica_placement=false with env {}
W20260810 01:58:39.263033 3534 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:58:39.263435 3534 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:58:39.263578 3534 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 01:58:39.272053 3534 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260810 01:58:39.272204 3534 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:58:39.272380 3534 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:58:39.272475 3534 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:58:39.272588 3534 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:58:39.282541 3534 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.64.212:38687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/wal
--enable_range_replica_placement=false
--ipki_ca_key_size=768
--master_addresses=127.21.64.254:44657
--tserver_unresponsive_timeout_ms=3000
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.64.254:44657
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.21.64.254
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 01:44:04 UTC on e7f111948823
build id 13266
ASAN enabled
I20260810 01:58:39.284304 3534 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:58:39.286293 3534 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 01:58:39.295392 3540 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:58:39.295395 3541 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:58:39.295643 3543 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:58:39.296739 3534 server_base.cc:1061] running on GCE node
I20260810 01:58:39.297638 3534 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:58:39.298986 3534 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:58:39.300200 3534 hybrid_clock.cc:648] HybridClock initialized: now 1786327119300144 us; error 28 us; skew 500 ppm
I20260810 01:58:39.300549 3534 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 01:58:39.302840 3534 webserver.cc:533] Webserver started at http://127.21.64.254:36777/ using document root <none> and password file <none>
I20260810 01:58:39.303617 3534 fs_manager.cc:362] Metadata directory not provided
I20260810 01:58:39.303776 3534 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:58:39.304162 3534 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:58:39.306713 3534 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "d34fc1f097c643269bf1e5289413e357"
format_stamp: "Formatted at 2026-08-10 01:58:39 on dist-test-slave-bw88"
I20260810 01:58:39.307541 3534 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "d34fc1f097c643269bf1e5289413e357"
format_stamp: "Formatted at 2026-08-10 01:58:39 on dist-test-slave-bw88"
I20260810 01:58:39.313026 3534 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260810 01:58:39.316392 3550 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:58:39.317807 3534 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:58:39.317981 3534 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/wal
uuid: "d34fc1f097c643269bf1e5289413e357"
format_stamp: "Formatted at 2026-08-10 01:58:39 on dist-test-slave-bw88"
I20260810 01:58:39.318187 3534 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:58:39.336351 3534 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 01:58:39.337178 3534 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:58:39.337528 3534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:58:39.359465 3534 rpc_server.cc:307] RPC server started. Bound to: 127.21.64.254:44657
I20260810 01:58:39.359509 3620 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.64.254:44657 every 8 connection(s)
I20260810 01:58:39.361088 3534 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260810 01:58:39.365550 3622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:39.369750 21763 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNubV1X/build/asan/bin/kudu as pid 3534
I20260810 01:58:39.369976 21763 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/wal/instance
I20260810 01:58:39.375728 3622 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d34fc1f097c643269bf1e5289413e357: Bootstrap starting.
I20260810 01:58:39.378962 3622 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d34fc1f097c643269bf1e5289413e357: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:39.380110 3622 log.cc:826] T 00000000000000000000000000000000 P d34fc1f097c643269bf1e5289413e357: Log is configured to *not* fsync() on all Append() calls
I20260810 01:58:39.383280 3622 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d34fc1f097c643269bf1e5289413e357: No bootstrap required, opened a new log
I20260810 01:58:39.388654 3622 raft_consensus.cc:359] T 00000000000000000000000000000000 P d34fc1f097c643269bf1e5289413e357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d34fc1f097c643269bf1e5289413e357" member_type: VOTER last_known_addr { host: "127.21.64.254" port: 44657 } }
I20260810 01:58:39.388998 3622 raft_consensus.cc:385] T 00000000000000000000000000000000 P d34fc1f097c643269bf1e5289413e357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:39.389066 3622 raft_consensus.cc:740] T 00000000000000000000000000000000 P d34fc1f097c643269bf1e5289413e357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d34fc1f097c643269bf1e5289413e357, State: Initialized, Role: FOLLOWER
I20260810 01:58:39.389734 3622 consensus_queue.cc:260] T 00000000000000000000000000000000 P d34fc1f097c643269bf1e5289413e357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d34fc1f097c643269bf1e5289413e357" member_type: VOTER last_known_addr { host: "127.21.64.254" port: 44657 } }
I20260810 01:58:39.389942 3622 raft_consensus.cc:399] T 00000000000000000000000000000000 P d34fc1f097c643269bf1e5289413e357 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:58:39.390129 3622 raft_consensus.cc:493] T 00000000000000000000000000000000 P d34fc1f097c643269bf1e5289413e357 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:58:39.390300 3622 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d34fc1f097c643269bf1e5289413e357 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:39.392796 3622 raft_consensus.cc:515] T 00000000000000000000000000000000 P d34fc1f097c643269bf1e5289413e357 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d34fc1f097c643269bf1e5289413e357" member_type: VOTER last_known_addr { host: "127.21.64.254" port: 44657 } }
I20260810 01:58:39.393312 3622 leader_election.cc:304] T 00000000000000000000000000000000 P d34fc1f097c643269bf1e5289413e357 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d34fc1f097c643269bf1e5289413e357; no voters:
I20260810 01:58:39.393944 3622 leader_election.cc:290] T 00000000000000000000000000000000 P d34fc1f097c643269bf1e5289413e357 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:58:39.394132 3628 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d34fc1f097c643269bf1e5289413e357 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:58:39.394820 3628 raft_consensus.cc:697] T 00000000000000000000000000000000 P d34fc1f097c643269bf1e5289413e357 [term 1 LEADER]: Becoming Leader. State: Replica: d34fc1f097c643269bf1e5289413e357, State: Running, Role: LEADER
I20260810 01:58:39.395452 3628 consensus_queue.cc:237] T 00000000000000000000000000000000 P d34fc1f097c643269bf1e5289413e357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d34fc1f097c643269bf1e5289413e357" member_type: VOTER last_known_addr { host: "127.21.64.254" port: 44657 } }
I20260810 01:58:39.396109 3622 sys_catalog.cc:565] T 00000000000000000000000000000000 P d34fc1f097c643269bf1e5289413e357 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:58:39.398522 3632 sys_catalog.cc:455] T 00000000000000000000000000000000 P d34fc1f097c643269bf1e5289413e357 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d34fc1f097c643269bf1e5289413e357. Latest consensus state: current_term: 1 leader_uuid: "d34fc1f097c643269bf1e5289413e357" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d34fc1f097c643269bf1e5289413e357" member_type: VOTER last_known_addr { host: "127.21.64.254" port: 44657 } } }
I20260810 01:58:39.398898 3632 sys_catalog.cc:458] T 00000000000000000000000000000000 P d34fc1f097c643269bf1e5289413e357 [sys.catalog]: This master's current role is: LEADER
I20260810 01:58:39.398492 3629 sys_catalog.cc:455] T 00000000000000000000000000000000 P d34fc1f097c643269bf1e5289413e357 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d34fc1f097c643269bf1e5289413e357" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d34fc1f097c643269bf1e5289413e357" member_type: VOTER last_known_addr { host: "127.21.64.254" port: 44657 } } }
I20260810 01:58:39.400431 3629 sys_catalog.cc:458] T 00000000000000000000000000000000 P d34fc1f097c643269bf1e5289413e357 [sys.catalog]: This master's current role is: LEADER
I20260810 01:58:39.410339 3637 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260810 01:58:39.416033 3637 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260810 01:58:39.425154 3637 catalog_manager.cc:1383] Generated new cluster ID: af92a1ad67304e8ebb126b95e8dd59ea
I20260810 01:58:39.425311 3637 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260810 01:58:39.445402 3637 catalog_manager.cc:1406] Generated new certificate authority record
I20260810 01:58:39.446631 3637 catalog_manager.cc:1540] Loading token signing keys...
I20260810 01:58:39.462889 3637 catalog_manager.cc:6092] T 00000000000000000000000000000000 P d34fc1f097c643269bf1e5289413e357: Generated new TSK 0
I20260810 01:58:39.463745 3637 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260810 01:58:39.476152 21763 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNubV1X/build/asan/bin/kudu
/tmp/dist-test-taskNubV1X/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.64.193:0
--local_ip_for_outbound_sockets=127.21.64.193
--webserver_interface=127.21.64.193
--webserver_port=0
--tserver_master_addrs=127.21.64.254:44657
--builtin_ntp_servers=127.21.64.212:38687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
W20260810 01:58:39.866322 3652 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:58:39.866669 3652 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:58:39.866744 3652 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 01:58:39.875296 3652 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260810 01:58:39.875396 3652 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:58:39.875599 3652 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.64.193
I20260810 01:58:39.885934 3652 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.64.212:38687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.64.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.21.64.193
--webserver_port=0
--tserver_master_addrs=127.21.64.254:44657
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.64.193
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 01:44:04 UTC on e7f111948823
build id 13266
ASAN enabled
I20260810 01:58:39.887689 3652 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:58:39.889631 3652 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 01:58:39.899755 3658 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:58:39.899823 3659 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:58:39.900476 3663 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:58:39.901661 3652 server_base.cc:1061] running on GCE node
I20260810 01:58:39.902328 3652 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:58:39.903297 3652 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:58:39.904541 3652 hybrid_clock.cc:648] HybridClock initialized: now 1786327119904452 us; error 63 us; skew 500 ppm
I20260810 01:58:39.904840 3652 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 01:58:39.907069 3652 webserver.cc:533] Webserver started at http://127.21.64.193:36635/ using document root <none> and password file <none>
I20260810 01:58:39.907846 3652 fs_manager.cc:362] Metadata directory not provided
I20260810 01:58:39.907999 3652 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:58:39.908362 3652 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:58:39.910823 3652 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "dc85be7d460a404f997177f57680850f"
format_stamp: "Formatted at 2026-08-10 01:58:39 on dist-test-slave-bw88"
I20260810 01:58:39.911720 3652 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "dc85be7d460a404f997177f57680850f"
format_stamp: "Formatted at 2026-08-10 01:58:39 on dist-test-slave-bw88"
I20260810 01:58:39.917098 3652 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260810 01:58:39.920562 3669 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:58:39.921981 3652 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:58:39.922139 3652 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "dc85be7d460a404f997177f57680850f"
format_stamp: "Formatted at 2026-08-10 01:58:39 on dist-test-slave-bw88"
I20260810 01:58:39.922304 3652 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:58:39.957187 3652 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 01:58:39.958441 3652 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:58:39.958906 3652 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:58:39.960176 3652 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260810 01:58:39.962910 3652 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:58:39.962988 3652 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:58:39.963130 3652 ts_tablet_manager.cc:616] Registered 0 tablets
I20260810 01:58:39.963198 3652 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:58:40.001685 3652 rpc_server.cc:307] RPC server started. Bound to: 127.21.64.193:36797
I20260810 01:58:40.001791 3825 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.64.193:36797 every 8 connection(s)
I20260810 01:58:40.003250 3652 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20260810 01:58:40.008167 21763 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNubV1X/build/asan/bin/kudu as pid 3652
I20260810 01:58:40.008443 21763 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20260810 01:58:40.013135 21763 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNubV1X/build/asan/bin/kudu
/tmp/dist-test-taskNubV1X/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.64.194:0
--local_ip_for_outbound_sockets=127.21.64.194
--webserver_interface=127.21.64.194
--webserver_port=0
--tserver_master_addrs=127.21.64.254:44657
--builtin_ntp_servers=127.21.64.212:38687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
I20260810 01:58:40.019799 3826 heartbeater.cc:344] Connected to a master server at 127.21.64.254:44657
I20260810 01:58:40.020254 3826 heartbeater.cc:461] Registering TS with master...
I20260810 01:58:40.021341 3826 heartbeater.cc:507] Master 127.21.64.254:44657 requested a full tablet report, sending...
I20260810 01:58:40.023989 3574 ts_manager.cc:194] Registered new tserver with Master: dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
I20260810 01:58:40.025666 3574 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.21.64.193:45439
W20260810 01:58:40.410473 3830 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:58:40.410823 3830 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:58:40.410969 3830 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 01:58:40.419626 3830 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260810 01:58:40.419770 3830 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:58:40.419975 3830 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.64.194
I20260810 01:58:40.430753 3830 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.64.212:38687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.64.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.21.64.194
--webserver_port=0
--tserver_master_addrs=127.21.64.254:44657
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.64.194
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 01:44:04 UTC on e7f111948823
build id 13266
ASAN enabled
I20260810 01:58:40.432600 3830 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:58:40.434612 3830 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 01:58:40.444615 3843 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:58:40.444620 3844 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:58:40.450134 3847 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:58:40.450666 3830 server_base.cc:1061] running on GCE node
I20260810 01:58:40.451289 3830 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:58:40.452275 3830 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:58:40.453491 3830 hybrid_clock.cc:648] HybridClock initialized: now 1786327120453423 us; error 40 us; skew 500 ppm
I20260810 01:58:40.453881 3830 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 01:58:40.456223 3830 webserver.cc:533] Webserver started at http://127.21.64.194:46825/ using document root <none> and password file <none>
I20260810 01:58:40.457028 3830 fs_manager.cc:362] Metadata directory not provided
I20260810 01:58:40.457176 3830 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:58:40.457602 3830 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:58:40.460134 3830 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "82f93d1d11364ceeb485585b4ae78871"
format_stamp: "Formatted at 2026-08-10 01:58:40 on dist-test-slave-bw88"
I20260810 01:58:40.460934 3830 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "82f93d1d11364ceeb485585b4ae78871"
format_stamp: "Formatted at 2026-08-10 01:58:40 on dist-test-slave-bw88"
I20260810 01:58:40.466964 3830 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.005s sys 0.003s
I20260810 01:58:40.470531 3854 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:58:40.471829 3830 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260810 01:58:40.472010 3830 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "82f93d1d11364ceeb485585b4ae78871"
format_stamp: "Formatted at 2026-08-10 01:58:40 on dist-test-slave-bw88"
I20260810 01:58:40.472206 3830 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:58:40.489511 3830 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 01:58:40.490420 3830 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:58:40.490775 3830 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:58:40.491829 3830 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260810 01:58:40.493683 3830 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:58:40.493788 3830 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:58:40.493935 3830 ts_tablet_manager.cc:616] Registered 0 tablets
I20260810 01:58:40.494012 3830 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:58:40.532220 3830 rpc_server.cc:307] RPC server started. Bound to: 127.21.64.194:43893
I20260810 01:58:40.532270 4009 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.64.194:43893 every 8 connection(s)
I20260810 01:58:40.533845 3830 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20260810 01:58:40.535524 21763 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNubV1X/build/asan/bin/kudu as pid 3830
I20260810 01:58:40.535742 21763 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20260810 01:58:40.551287 21763 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNubV1X/build/asan/bin/kudu
/tmp/dist-test-taskNubV1X/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.64.195:0
--local_ip_for_outbound_sockets=127.21.64.195
--webserver_interface=127.21.64.195
--webserver_port=0
--tserver_master_addrs=127.21.64.254:44657
--builtin_ntp_servers=127.21.64.212:38687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
I20260810 01:58:40.558430 4011 heartbeater.cc:344] Connected to a master server at 127.21.64.254:44657
I20260810 01:58:40.558911 4011 heartbeater.cc:461] Registering TS with master...
I20260810 01:58:40.559854 4011 heartbeater.cc:507] Master 127.21.64.254:44657 requested a full tablet report, sending...
I20260810 01:58:40.561757 3574 ts_manager.cc:194] Registered new tserver with Master: 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 01:58:40.562702 3574 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.21.64.194:49299
W20260810 01:58:40.938439 4017 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:58:40.938848 4017 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:58:40.939002 4017 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 01:58:40.947644 4017 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260810 01:58:40.947798 4017 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:58:40.948020 4017 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.64.195
I20260810 01:58:40.958348 4017 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.64.212:38687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.64.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.21.64.195
--webserver_port=0
--tserver_master_addrs=127.21.64.254:44657
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.64.195
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 01:44:04 UTC on e7f111948823
build id 13266
ASAN enabled
I20260810 01:58:40.960161 4017 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:58:40.962337 4017 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 01:58:40.973102 4025 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:58:40.973134 4023 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:58:40.978118 4028 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:58:40.979133 4017 server_base.cc:1061] running on GCE node
I20260810 01:58:40.979748 4017 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:58:40.980700 4017 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:58:40.981959 4017 hybrid_clock.cc:648] HybridClock initialized: now 1786327120981886 us; error 42 us; skew 500 ppm
I20260810 01:58:40.982358 4017 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 01:58:40.984668 4017 webserver.cc:533] Webserver started at http://127.21.64.195:37609/ using document root <none> and password file <none>
I20260810 01:58:40.985538 4017 fs_manager.cc:362] Metadata directory not provided
I20260810 01:58:40.985692 4017 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:58:40.986053 4017 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:58:40.988624 4017 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "17b49c694faf479ea2e5083470fc0302"
format_stamp: "Formatted at 2026-08-10 01:58:40 on dist-test-slave-bw88"
I20260810 01:58:40.989552 4017 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "17b49c694faf479ea2e5083470fc0302"
format_stamp: "Formatted at 2026-08-10 01:58:40 on dist-test-slave-bw88"
I20260810 01:58:40.995342 4017 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260810 01:58:40.999126 4035 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:58:41.000524 4017 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 01:58:41.000723 4017 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "17b49c694faf479ea2e5083470fc0302"
format_stamp: "Formatted at 2026-08-10 01:58:40 on dist-test-slave-bw88"
I20260810 01:58:41.000936 4017 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:58:41.016893 4017 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 01:58:41.017872 4017 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:58:41.018182 4017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:58:41.019168 4017 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260810 01:58:41.020905 4017 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:58:41.021013 4017 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:58:41.021185 4017 ts_tablet_manager.cc:616] Registered 0 tablets
I20260810 01:58:41.021265 4017 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:58:41.029407 3826 heartbeater.cc:499] Master 127.21.64.254:44657 was elected leader, sending a full tablet report...
I20260810 01:58:41.058197 4017 rpc_server.cc:307] RPC server started. Bound to: 127.21.64.195:39189
I20260810 01:58:41.058238 4193 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.64.195:39189 every 8 connection(s)
I20260810 01:58:41.059736 4017 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20260810 01:58:41.064319 21763 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNubV1X/build/asan/bin/kudu as pid 4017
I20260810 01:58:41.064548 21763 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20260810 01:58:41.068712 21763 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNubV1X/build/asan/bin/kudu
/tmp/dist-test-taskNubV1X/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.64.196:0
--local_ip_for_outbound_sockets=127.21.64.196
--webserver_interface=127.21.64.196
--webserver_port=0
--tserver_master_addrs=127.21.64.254:44657
--builtin_ntp_servers=127.21.64.212:38687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
I20260810 01:58:41.078980 4194 heartbeater.cc:344] Connected to a master server at 127.21.64.254:44657
I20260810 01:58:41.079401 4194 heartbeater.cc:461] Registering TS with master...
I20260810 01:58:41.080263 4194 heartbeater.cc:507] Master 127.21.64.254:44657 requested a full tablet report, sending...
I20260810 01:58:41.081892 3574 ts_manager.cc:194] Registered new tserver with Master: 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189)
I20260810 01:58:41.082904 3574 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.21.64.195:60929
W20260810 01:58:41.455436 4199 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:58:41.455832 4199 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:58:41.455986 4199 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 01:58:41.464676 4199 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260810 01:58:41.464829 4199 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:58:41.465051 4199 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.64.196
I20260810 01:58:41.475364 4199 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.64.212:38687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.64.196:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--webserver_interface=127.21.64.196
--webserver_port=0
--tserver_master_addrs=127.21.64.254:44657
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.64.196
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 01:44:04 UTC on e7f111948823
build id 13266
ASAN enabled
I20260810 01:58:41.477273 4199 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:58:41.479339 4199 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 01:58:41.489288 4207 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:58:41.489257 4209 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:58:41.490094 4211 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:58:41.490818 4199 server_base.cc:1061] running on GCE node
I20260810 01:58:41.491518 4199 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:58:41.492533 4199 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:58:41.493783 4199 hybrid_clock.cc:648] HybridClock initialized: now 1786327121493712 us; error 43 us; skew 500 ppm
I20260810 01:58:41.494112 4199 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 01:58:41.496416 4199 webserver.cc:533] Webserver started at http://127.21.64.196:42949/ using document root <none> and password file <none>
I20260810 01:58:41.497258 4199 fs_manager.cc:362] Metadata directory not provided
I20260810 01:58:41.497471 4199 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:58:41.497911 4199 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:58:41.500327 4199 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/data/instance:
uuid: "ca4469fc2dbc48488bc7ad7f482f129e"
format_stamp: "Formatted at 2026-08-10 01:58:41 on dist-test-slave-bw88"
I20260810 01:58:41.501220 4199 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal/instance:
uuid: "ca4469fc2dbc48488bc7ad7f482f129e"
format_stamp: "Formatted at 2026-08-10 01:58:41 on dist-test-slave-bw88"
I20260810 01:58:41.506810 4199 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260810 01:58:41.510346 4218 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:58:41.511785 4199 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260810 01:58:41.511991 4199 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/data,/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal
uuid: "ca4469fc2dbc48488bc7ad7f482f129e"
format_stamp: "Formatted at 2026-08-10 01:58:41 on dist-test-slave-bw88"
I20260810 01:58:41.512202 4199 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal
metadata directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal
1 data directories: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:58:41.536782 4199 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 01:58:41.537676 4199 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:58:41.537966 4199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:58:41.538856 4199 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260810 01:58:41.540510 4199 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:58:41.540584 4199 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:58:41.540666 4199 ts_tablet_manager.cc:616] Registered 0 tablets
I20260810 01:58:41.540710 4199 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:58:41.565877 4011 heartbeater.cc:499] Master 127.21.64.254:44657 was elected leader, sending a full tablet report...
I20260810 01:58:41.578496 4199 rpc_server.cc:307] RPC server started. Bound to: 127.21.64.196:41943
I20260810 01:58:41.578621 4366 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.64.196:41943 every 8 connection(s)
I20260810 01:58:41.580047 4199 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/data/info.pb
I20260810 01:58:41.583758 21763 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNubV1X/build/asan/bin/kudu as pid 4199
I20260810 01:58:41.583967 21763 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal/instance
I20260810 01:58:41.587491 21763 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNubV1X/build/asan/bin/kudu
/tmp/dist-test-taskNubV1X/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/wal
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/logs
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.64.197:0
--local_ip_for_outbound_sockets=127.21.64.197
--webserver_interface=127.21.64.197
--webserver_port=0
--tserver_master_addrs=127.21.64.254:44657
--builtin_ntp_servers=127.21.64.212:38687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
I20260810 01:58:41.594484 4369 heartbeater.cc:344] Connected to a master server at 127.21.64.254:44657
I20260810 01:58:41.594851 4369 heartbeater.cc:461] Registering TS with master...
I20260810 01:58:41.595649 4369 heartbeater.cc:507] Master 127.21.64.254:44657 requested a full tablet report, sending...
I20260810 01:58:41.597258 3574 ts_manager.cc:194] Registered new tserver with Master: ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943)
I20260810 01:58:41.598394 3574 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.21.64.196:44161
W20260810 01:58:41.969913 4373 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:58:41.970319 4373 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:58:41.970468 4373 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 01:58:41.980285 4373 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260810 01:58:41.980427 4373 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:58:41.980614 4373 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.64.197
I20260810 01:58:41.990892 4373 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.64.212:38687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.64.197:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--webserver_interface=127.21.64.197
--webserver_port=0
--tserver_master_addrs=127.21.64.254:44657
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.64.197
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 01:44:04 UTC on e7f111948823
build id 13266
ASAN enabled
I20260810 01:58:41.992688 4373 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:58:41.994690 4373 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 01:58:42.004783 4381 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:58:42.006551 4380 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:58:42.007114 4384 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:58:42.007736 4373 server_base.cc:1061] running on GCE node
I20260810 01:58:42.008330 4373 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:58:42.009377 4373 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:58:42.010645 4373 hybrid_clock.cc:648] HybridClock initialized: now 1786327122010562 us; error 53 us; skew 500 ppm
I20260810 01:58:42.011014 4373 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 01:58:42.013453 4373 webserver.cc:533] Webserver started at http://127.21.64.197:34207/ using document root <none> and password file <none>
I20260810 01:58:42.014247 4373 fs_manager.cc:362] Metadata directory not provided
I20260810 01:58:42.014407 4373 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:58:42.014767 4373 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:58:42.017174 4373 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data/instance:
uuid: "4dd4cba155c941b4b7ad4d64c7431536"
format_stamp: "Formatted at 2026-08-10 01:58:42 on dist-test-slave-bw88"
I20260810 01:58:42.018076 4373 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/wal/instance:
uuid: "4dd4cba155c941b4b7ad4d64c7431536"
format_stamp: "Formatted at 2026-08-10 01:58:42 on dist-test-slave-bw88"
I20260810 01:58:42.024219 4373 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260810 01:58:42.027940 4391 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:58:42.029317 4373 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260810 01:58:42.029568 4373 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data,/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/wal
uuid: "4dd4cba155c941b4b7ad4d64c7431536"
format_stamp: "Formatted at 2026-08-10 01:58:42 on dist-test-slave-bw88"
I20260810 01:58:42.029794 4373 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/wal
metadata directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/wal
1 data directories: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:58:42.045603 4373 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 01:58:42.046495 4373 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:58:42.046810 4373 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:58:42.047765 4373 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260810 01:58:42.049510 4373 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:58:42.049618 4373 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:58:42.049779 4373 ts_tablet_manager.cc:616] Registered 0 tablets
I20260810 01:58:42.049853 4373 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:58:42.088847 4373 rpc_server.cc:307] RPC server started. Bound to: 127.21.64.197:38787
I20260810 01:58:42.088902 4551 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.64.197:38787 every 8 connection(s)
I20260810 01:58:42.090521 4373 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data/info.pb
I20260810 01:58:42.095991 4194 heartbeater.cc:499] Master 127.21.64.254:44657 was elected leader, sending a full tablet report...
I20260810 01:58:42.100366 21763 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNubV1X/build/asan/bin/kudu as pid 4373
I20260810 01:58:42.100581 21763 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/wal/instance
I20260810 01:58:42.104386 21763 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNubV1X/build/asan/bin/kudu
/tmp/dist-test-taskNubV1X/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/wal
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/logs
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.64.198:0
--local_ip_for_outbound_sockets=127.21.64.198
--webserver_interface=127.21.64.198
--webserver_port=0
--tserver_master_addrs=127.21.64.254:44657
--builtin_ntp_servers=127.21.64.212:38687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
I20260810 01:58:42.105285 4552 heartbeater.cc:344] Connected to a master server at 127.21.64.254:44657
I20260810 01:58:42.105736 4552 heartbeater.cc:461] Registering TS with master...
I20260810 01:58:42.106822 4552 heartbeater.cc:507] Master 127.21.64.254:44657 requested a full tablet report, sending...
I20260810 01:58:42.108515 3574 ts_manager.cc:194] Registered new tserver with Master: 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197:38787)
I20260810 01:58:42.109414 3574 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.21.64.197:49247
W20260810 01:58:42.496291 4562 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:58:42.496603 4562 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:58:42.496678 4562 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 01:58:42.505467 4562 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260810 01:58:42.505564 4562 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:58:42.505702 4562 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.64.198
I20260810 01:58:42.515909 4562 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.64.212:38687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/data
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.64.198:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/data/info.pb
--webserver_interface=127.21.64.198
--webserver_port=0
--tserver_master_addrs=127.21.64.254:44657
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.64.198
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 01:44:04 UTC on e7f111948823
build id 13266
ASAN enabled
I20260810 01:58:42.517704 4562 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:58:42.519536 4562 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 01:58:42.529188 4574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:58:42.529166 4573 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:58:42.530416 4577 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:58:42.530897 4562 server_base.cc:1061] running on GCE node
I20260810 01:58:42.531504 4562 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:58:42.532528 4562 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:58:42.533800 4562 hybrid_clock.cc:648] HybridClock initialized: now 1786327122533730 us; error 51 us; skew 500 ppm
I20260810 01:58:42.534152 4562 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 01:58:42.536613 4562 webserver.cc:533] Webserver started at http://127.21.64.198:43427/ using document root <none> and password file <none>
I20260810 01:58:42.537442 4562 fs_manager.cc:362] Metadata directory not provided
I20260810 01:58:42.537585 4562 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:58:42.537978 4562 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:58:42.540540 4562 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/data/instance:
uuid: "22ce0e487f0341fd9bf853393d6e7683"
format_stamp: "Formatted at 2026-08-10 01:58:42 on dist-test-slave-bw88"
I20260810 01:58:42.541465 4562 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/wal/instance:
uuid: "22ce0e487f0341fd9bf853393d6e7683"
format_stamp: "Formatted at 2026-08-10 01:58:42 on dist-test-slave-bw88"
I20260810 01:58:42.546954 4562 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260810 01:58:42.551107 4585 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:58:42.552789 4562 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260810 01:58:42.553026 4562 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/data,/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/wal
uuid: "22ce0e487f0341fd9bf853393d6e7683"
format_stamp: "Formatted at 2026-08-10 01:58:42 on dist-test-slave-bw88"
I20260810 01:58:42.553262 4562 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/wal
metadata directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/wal
1 data directories: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:58:42.578451 4562 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 01:58:42.579382 4562 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:58:42.579717 4562 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:58:42.580770 4562 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260810 01:58:42.582825 4562 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:58:42.582939 4562 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260810 01:58:42.583102 4562 ts_tablet_manager.cc:616] Registered 0 tablets
I20260810 01:58:42.583181 4562 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:58:42.601099 4369 heartbeater.cc:499] Master 127.21.64.254:44657 was elected leader, sending a full tablet report...
I20260810 01:58:42.620289 4562 rpc_server.cc:307] RPC server started. Bound to: 127.21.64.198:45317
I20260810 01:58:42.620332 4748 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.64.198:45317 every 8 connection(s)
I20260810 01:58:42.621907 4562 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/data/info.pb
I20260810 01:58:42.626250 21763 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNubV1X/build/asan/bin/kudu as pid 4562
I20260810 01:58:42.626456 21763 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/wal/instance
I20260810 01:58:42.629910 21763 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNubV1X/build/asan/bin/kudu
/tmp/dist-test-taskNubV1X/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/wal
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/logs
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.64.199:0
--local_ip_for_outbound_sockets=127.21.64.199
--webserver_interface=127.21.64.199
--webserver_port=0
--tserver_master_addrs=127.21.64.254:44657
--builtin_ntp_servers=127.21.64.212:38687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
I20260810 01:58:42.636231 4749 heartbeater.cc:344] Connected to a master server at 127.21.64.254:44657
I20260810 01:58:42.636607 4749 heartbeater.cc:461] Registering TS with master...
I20260810 01:58:42.637449 4749 heartbeater.cc:507] Master 127.21.64.254:44657 requested a full tablet report, sending...
I20260810 01:58:42.639040 3574 ts_manager.cc:194] Registered new tserver with Master: 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317)
I20260810 01:58:42.640169 3574 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.21.64.198:44355
W20260810 01:58:43.016462 4755 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:58:43.016773 4755 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:58:43.016937 4755 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 01:58:43.025843 4755 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260810 01:58:43.025949 4755 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:58:43.026150 4755 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.64.199
I20260810 01:58:43.037058 4755 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.64.212:38687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/data
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.64.199:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/data/info.pb
--webserver_interface=127.21.64.199
--webserver_port=0
--tserver_master_addrs=127.21.64.254:44657
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.64.199
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 01:44:04 UTC on e7f111948823
build id 13266
ASAN enabled
I20260810 01:58:43.038916 4755 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:58:43.040818 4755 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 01:58:43.051210 4760 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:58:43.051180 4761 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:58:43.051681 4763 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:58:43.052661 4755 server_base.cc:1061] running on GCE node
I20260810 01:58:43.053370 4755 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:58:43.054366 4755 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:58:43.055611 4755 hybrid_clock.cc:648] HybridClock initialized: now 1786327123055546 us; error 32 us; skew 500 ppm
I20260810 01:58:43.055955 4755 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 01:58:43.058506 4755 webserver.cc:533] Webserver started at http://127.21.64.199:35725/ using document root <none> and password file <none>
I20260810 01:58:43.059517 4755 fs_manager.cc:362] Metadata directory not provided
I20260810 01:58:43.059672 4755 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:58:43.060089 4755 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:58:43.062955 4755 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/data/instance:
uuid: "c5ed5317da9c464b93f979c405f0f6e4"
format_stamp: "Formatted at 2026-08-10 01:58:43 on dist-test-slave-bw88"
I20260810 01:58:43.063771 4755 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/wal/instance:
uuid: "c5ed5317da9c464b93f979c405f0f6e4"
format_stamp: "Formatted at 2026-08-10 01:58:43 on dist-test-slave-bw88"
I20260810 01:58:43.069519 4755 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260810 01:58:43.072976 4771 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:58:43.074554 4755 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:58:43.074756 4755 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/data,/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/wal
uuid: "c5ed5317da9c464b93f979c405f0f6e4"
format_stamp: "Formatted at 2026-08-10 01:58:43 on dist-test-slave-bw88"
I20260810 01:58:43.074941 4755 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/wal
metadata directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/wal
1 data directories: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:58:43.112468 4755 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 01:58:43.112550 4552 heartbeater.cc:499] Master 127.21.64.254:44657 was elected leader, sending a full tablet report...
I20260810 01:58:43.113612 4755 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:58:43.113929 4755 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:58:43.115089 4755 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260810 01:58:43.116840 4755 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:58:43.116966 4755 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:58:43.117110 4755 ts_tablet_manager.cc:616] Registered 0 tablets
I20260810 01:58:43.117187 4755 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:58:43.154906 4755 rpc_server.cc:307] RPC server started. Bound to: 127.21.64.199:41689
I20260810 01:58:43.154974 4925 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.64.199:41689 every 8 connection(s)
I20260810 01:58:43.156477 4755 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/data/info.pb
I20260810 01:58:43.161698 21763 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNubV1X/build/asan/bin/kudu as pid 4755
I20260810 01:58:43.161931 21763 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/wal/instance
I20260810 01:58:43.166194 21763 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNubV1X/build/asan/bin/kudu
/tmp/dist-test-taskNubV1X/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/wal
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/logs
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.64.200:0
--local_ip_for_outbound_sockets=127.21.64.200
--webserver_interface=127.21.64.200
--webserver_port=0
--tserver_master_addrs=127.21.64.254:44657
--builtin_ntp_servers=127.21.64.212:38687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
I20260810 01:58:43.172641 4926 heartbeater.cc:344] Connected to a master server at 127.21.64.254:44657
I20260810 01:58:43.173048 4926 heartbeater.cc:461] Registering TS with master...
I20260810 01:58:43.173892 4926 heartbeater.cc:507] Master 127.21.64.254:44657 requested a full tablet report, sending...
I20260810 01:58:43.175467 3574 ts_manager.cc:194] Registered new tserver with Master: c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199:41689)
I20260810 01:58:43.176291 3574 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.21.64.199:33311
W20260810 01:58:43.552573 4932 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:58:43.552897 4932 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:58:43.552974 4932 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 01:58:43.562242 4932 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260810 01:58:43.562343 4932 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:58:43.562484 4932 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.64.200
I20260810 01:58:43.572937 4932 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.64.212:38687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/data
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.64.200:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/data/info.pb
--webserver_interface=127.21.64.200
--webserver_port=0
--tserver_master_addrs=127.21.64.254:44657
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.64.200
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 01:44:04 UTC on e7f111948823
build id 13266
ASAN enabled
I20260810 01:58:43.574676 4932 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:58:43.576462 4932 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 01:58:43.586400 4941 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:58:43.586448 4940 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:58:43.587693 4944 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:58:43.588331 4932 server_base.cc:1061] running on GCE node
I20260810 01:58:43.588995 4932 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:58:43.590006 4932 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:58:43.591218 4932 hybrid_clock.cc:648] HybridClock initialized: now 1786327123591164 us; error 27 us; skew 500 ppm
I20260810 01:58:43.591557 4932 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 01:58:43.593924 4932 webserver.cc:533] Webserver started at http://127.21.64.200:32803/ using document root <none> and password file <none>
I20260810 01:58:43.594689 4932 fs_manager.cc:362] Metadata directory not provided
I20260810 01:58:43.594833 4932 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:58:43.595203 4932 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:58:43.597775 4932 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/data/instance:
uuid: "3136daf7101445beadc1aa19bc01c227"
format_stamp: "Formatted at 2026-08-10 01:58:43 on dist-test-slave-bw88"
I20260810 01:58:43.598577 4932 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/wal/instance:
uuid: "3136daf7101445beadc1aa19bc01c227"
format_stamp: "Formatted at 2026-08-10 01:58:43 on dist-test-slave-bw88"
I20260810 01:58:43.604224 4932 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260810 01:58:43.608011 4950 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:58:43.609326 4932 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 01:58:43.609568 4932 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/data,/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/wal
uuid: "3136daf7101445beadc1aa19bc01c227"
format_stamp: "Formatted at 2026-08-10 01:58:43 on dist-test-slave-bw88"
I20260810 01:58:43.609783 4932 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/wal
metadata directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/wal
1 data directories: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:58:43.632332 4932 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 01:58:43.633213 4932 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:58:43.633562 4932 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:58:43.634541 4932 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260810 01:58:43.636210 4932 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:58:43.636314 4932 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:58:43.636464 4932 ts_tablet_manager.cc:616] Registered 0 tablets
I20260810 01:58:43.636538 4932 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:58:43.642948 4749 heartbeater.cc:499] Master 127.21.64.254:44657 was elected leader, sending a full tablet report...
I20260810 01:58:43.674258 4932 rpc_server.cc:307] RPC server started. Bound to: 127.21.64.200:32995
I20260810 01:58:43.674319 5109 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.64.200:32995 every 8 connection(s)
I20260810 01:58:43.675777 4932 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/data/info.pb
I20260810 01:58:43.677877 21763 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNubV1X/build/asan/bin/kudu as pid 4932
I20260810 01:58:43.678098 21763 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/wal/instance
I20260810 01:58:43.689949 5110 heartbeater.cc:344] Connected to a master server at 127.21.64.254:44657
I20260810 01:58:43.690294 5110 heartbeater.cc:461] Registering TS with master...
I20260810 01:58:43.691020 5110 heartbeater.cc:507] Master 127.21.64.254:44657 requested a full tablet report, sending...
I20260810 01:58:43.692512 3574 ts_manager.cc:194] Registered new tserver with Master: 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995)
I20260810 01:58:43.693677 3574 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.21.64.200:38329
I20260810 01:58:43.695199 21763 external_mini_cluster.cc:955] 8 TS(s) registered with all masters
I20260810 01:58:43.713721 21763 external_mini_cluster.cc:955] 8 TS(s) registered with all masters
I20260810 01:58:43.713944 21763 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskNubV1X/build/asan/bin/kudu pid 4373
I20260810 01:58:43.722400 4545 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 01:58:43.807873 21763 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskNubV1X/build/asan/bin/kudu with pid 4373
I20260810 01:58:43.834932 21763 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskNubV1X/build/asan/bin/kudu pid 4562
I20260810 01:58:43.843991 4741 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 01:58:43.931243 21763 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskNubV1X/build/asan/bin/kudu with pid 4562
I20260810 01:58:43.956503 21763 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskNubV1X/build/asan/bin/kudu pid 4755
I20260810 01:58:43.965620 4920 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 01:58:44.055423 21763 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskNubV1X/build/asan/bin/kudu with pid 4755
I20260810 01:58:44.084321 21763 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskNubV1X/build/asan/bin/kudu pid 4932
I20260810 01:58:44.093994 5104 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 01:58:44.181429 21763 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskNubV1X/build/asan/bin/kudu with pid 4932
I20260810 01:58:47.959860 3574 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51850:
name: "rebalance_test_table_0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260810 01:58:48.023190 4285 tablet_service.cc:1511] Processing CreateTablet for tablet 0afbd7afdd834537b15c727355724562 (DEFAULT_TABLE table=rebalance_test_table_0 [id=8fd8ee0beeb54ad9bee1c94775d09e8f]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:48.025336 4285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0afbd7afdd834537b15c727355724562. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:48.025704 4286 tablet_service.cc:1511] Processing CreateTablet for tablet be4737d169be4419b5a0a0b656a3930f (DEFAULT_TABLE table=rebalance_test_table_0 [id=8fd8ee0beeb54ad9bee1c94775d09e8f]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:48.030042 4286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be4737d169be4419b5a0a0b656a3930f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:48.040442 3916 tablet_service.cc:1511] Processing CreateTablet for tablet 0afbd7afdd834537b15c727355724562 (DEFAULT_TABLE table=rebalance_test_table_0 [id=8fd8ee0beeb54ad9bee1c94775d09e8f]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:48.042373 3916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0afbd7afdd834537b15c727355724562. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:48.043031 3920 tablet_service.cc:1511] Processing CreateTablet for tablet be4737d169be4419b5a0a0b656a3930f (DEFAULT_TABLE table=rebalance_test_table_0 [id=8fd8ee0beeb54ad9bee1c94775d09e8f]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:48.043603 3920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be4737d169be4419b5a0a0b656a3930f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:48.044965 3917 tablet_service.cc:1511] Processing CreateTablet for tablet b63d0798e1ae4aea9b0272716d53d46d (DEFAULT_TABLE table=rebalance_test_table_0 [id=8fd8ee0beeb54ad9bee1c94775d09e8f]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:48.045622 3917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b63d0798e1ae4aea9b0272716d53d46d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:48.054514 5142 tablet_bootstrap.cc:492] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e: Bootstrap starting.
I20260810 01:58:48.057116 3735 tablet_service.cc:1511] Processing CreateTablet for tablet 0afbd7afdd834537b15c727355724562 (DEFAULT_TABLE table=rebalance_test_table_0 [id=8fd8ee0beeb54ad9bee1c94775d09e8f]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:48.058609 5142 tablet_bootstrap.cc:654] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:48.057956 3737 tablet_service.cc:1511] Processing CreateTablet for tablet b63d0798e1ae4aea9b0272716d53d46d (DEFAULT_TABLE table=rebalance_test_table_0 [id=8fd8ee0beeb54ad9bee1c94775d09e8f]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:48.059087 4105 tablet_service.cc:1511] Processing CreateTablet for tablet be4737d169be4419b5a0a0b656a3930f (DEFAULT_TABLE table=rebalance_test_table_0 [id=8fd8ee0beeb54ad9bee1c94775d09e8f]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:48.059903 3737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b63d0798e1ae4aea9b0272716d53d46d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:48.060091 5142 log.cc:826] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e: Log is configured to *not* fsync() on all Append() calls
I20260810 01:58:48.059990 4103 tablet_service.cc:1511] Processing CreateTablet for tablet b63d0798e1ae4aea9b0272716d53d46d (DEFAULT_TABLE table=rebalance_test_table_0 [id=8fd8ee0beeb54ad9bee1c94775d09e8f]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:48.066406 4103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b63d0798e1ae4aea9b0272716d53d46d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:48.069583 3735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0afbd7afdd834537b15c727355724562. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:48.073665 4105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be4737d169be4419b5a0a0b656a3930f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:48.107194 5145 tablet_bootstrap.cc:492] T be4737d169be4419b5a0a0b656a3930f P 82f93d1d11364ceeb485585b4ae78871: Bootstrap starting.
I20260810 01:58:48.112730 5145 tablet_bootstrap.cc:654] T be4737d169be4419b5a0a0b656a3930f P 82f93d1d11364ceeb485585b4ae78871: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:48.114542 5145 log.cc:826] T be4737d169be4419b5a0a0b656a3930f P 82f93d1d11364ceeb485585b4ae78871: Log is configured to *not* fsync() on all Append() calls
I20260810 01:58:48.118788 5150 tablet_bootstrap.cc:492] T be4737d169be4419b5a0a0b656a3930f P 17b49c694faf479ea2e5083470fc0302: Bootstrap starting.
I20260810 01:58:48.123884 5147 tablet_bootstrap.cc:492] T 0afbd7afdd834537b15c727355724562 P dc85be7d460a404f997177f57680850f: Bootstrap starting.
I20260810 01:58:48.124790 5145 tablet_bootstrap.cc:492] T be4737d169be4419b5a0a0b656a3930f P 82f93d1d11364ceeb485585b4ae78871: No bootstrap required, opened a new log
I20260810 01:58:48.125200 5145 ts_tablet_manager.cc:1403] T be4737d169be4419b5a0a0b656a3930f P 82f93d1d11364ceeb485585b4ae78871: Time spent bootstrapping tablet: real 0.018s user 0.007s sys 0.007s
I20260810 01:58:48.126770 5142 tablet_bootstrap.cc:492] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e: No bootstrap required, opened a new log
I20260810 01:58:48.127147 5142 ts_tablet_manager.cc:1403] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e: Time spent bootstrapping tablet: real 0.073s user 0.031s sys 0.038s
I20260810 01:58:48.127130 5150 tablet_bootstrap.cc:654] T be4737d169be4419b5a0a0b656a3930f P 17b49c694faf479ea2e5083470fc0302: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:48.128549 5150 log.cc:826] T be4737d169be4419b5a0a0b656a3930f P 17b49c694faf479ea2e5083470fc0302: Log is configured to *not* fsync() on all Append() calls
I20260810 01:58:48.128684 5147 tablet_bootstrap.cc:654] T 0afbd7afdd834537b15c727355724562 P dc85be7d460a404f997177f57680850f: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:48.130764 5147 log.cc:826] T 0afbd7afdd834537b15c727355724562 P dc85be7d460a404f997177f57680850f: Log is configured to *not* fsync() on all Append() calls
I20260810 01:58:48.136569 5142 raft_consensus.cc:359] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:48.137028 5142 raft_consensus.cc:385] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:48.137171 5142 raft_consensus.cc:740] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca4469fc2dbc48488bc7ad7f482f129e, State: Initialized, Role: FOLLOWER
I20260810 01:58:48.137327 5145 raft_consensus.cc:359] T be4737d169be4419b5a0a0b656a3930f P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:48.137867 5145 raft_consensus.cc:385] T be4737d169be4419b5a0a0b656a3930f P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:48.138036 5145 raft_consensus.cc:740] T be4737d169be4419b5a0a0b656a3930f P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f93d1d11364ceeb485585b4ae78871, State: Initialized, Role: FOLLOWER
I20260810 01:58:48.138093 5142 consensus_queue.cc:260] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:48.139138 5145 consensus_queue.cc:260] T be4737d169be4419b5a0a0b656a3930f P 82f93d1d11364ceeb485585b4ae78871 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:48.146955 5150 tablet_bootstrap.cc:492] T be4737d169be4419b5a0a0b656a3930f P 17b49c694faf479ea2e5083470fc0302: No bootstrap required, opened a new log
I20260810 01:58:48.147403 5150 ts_tablet_manager.cc:1403] T be4737d169be4419b5a0a0b656a3930f P 17b49c694faf479ea2e5083470fc0302: Time spent bootstrapping tablet: real 0.029s user 0.009s sys 0.006s
I20260810 01:58:48.148720 5147 tablet_bootstrap.cc:492] T 0afbd7afdd834537b15c727355724562 P dc85be7d460a404f997177f57680850f: No bootstrap required, opened a new log
I20260810 01:58:48.149088 5147 ts_tablet_manager.cc:1403] T 0afbd7afdd834537b15c727355724562 P dc85be7d460a404f997177f57680850f: Time spent bootstrapping tablet: real 0.026s user 0.011s sys 0.004s
I20260810 01:58:48.149878 5145 ts_tablet_manager.cc:1434] T be4737d169be4419b5a0a0b656a3930f P 82f93d1d11364ceeb485585b4ae78871: Time spent starting tablet: real 0.024s user 0.011s sys 0.006s
I20260810 01:58:48.155757 5142 ts_tablet_manager.cc:1434] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e: Time spent starting tablet: real 0.028s user 0.021s sys 0.003s
I20260810 01:58:48.156312 5142 tablet_bootstrap.cc:492] T be4737d169be4419b5a0a0b656a3930f P ca4469fc2dbc48488bc7ad7f482f129e: Bootstrap starting.
I20260810 01:58:48.157742 5145 tablet_bootstrap.cc:492] T 0afbd7afdd834537b15c727355724562 P 82f93d1d11364ceeb485585b4ae78871: Bootstrap starting.
I20260810 01:58:48.158327 5142 tablet_bootstrap.cc:654] T be4737d169be4419b5a0a0b656a3930f P ca4469fc2dbc48488bc7ad7f482f129e: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:48.159845 5145 tablet_bootstrap.cc:654] T 0afbd7afdd834537b15c727355724562 P 82f93d1d11364ceeb485585b4ae78871: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:48.160303 5147 raft_consensus.cc:359] T 0afbd7afdd834537b15c727355724562 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:48.161182 5147 raft_consensus.cc:385] T 0afbd7afdd834537b15c727355724562 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:48.161453 5147 raft_consensus.cc:740] T 0afbd7afdd834537b15c727355724562 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc85be7d460a404f997177f57680850f, State: Initialized, Role: FOLLOWER
I20260810 01:58:48.161336 5150 raft_consensus.cc:359] T be4737d169be4419b5a0a0b656a3930f P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:48.161923 5150 raft_consensus.cc:385] T be4737d169be4419b5a0a0b656a3930f P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:48.162115 5150 raft_consensus.cc:740] T be4737d169be4419b5a0a0b656a3930f P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17b49c694faf479ea2e5083470fc0302, State: Initialized, Role: FOLLOWER
I20260810 01:58:48.163130 5147 consensus_queue.cc:260] T 0afbd7afdd834537b15c727355724562 P dc85be7d460a404f997177f57680850f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:48.163844 5150 consensus_queue.cc:260] T be4737d169be4419b5a0a0b656a3930f P 17b49c694faf479ea2e5083470fc0302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:48.166184 5145 tablet_bootstrap.cc:492] T 0afbd7afdd834537b15c727355724562 P 82f93d1d11364ceeb485585b4ae78871: No bootstrap required, opened a new log
I20260810 01:58:48.166661 5145 ts_tablet_manager.cc:1403] T 0afbd7afdd834537b15c727355724562 P 82f93d1d11364ceeb485585b4ae78871: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.004s
I20260810 01:58:48.169080 5145 raft_consensus.cc:359] T 0afbd7afdd834537b15c727355724562 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:48.169448 5145 raft_consensus.cc:385] T 0afbd7afdd834537b15c727355724562 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:48.169636 5145 raft_consensus.cc:740] T 0afbd7afdd834537b15c727355724562 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f93d1d11364ceeb485585b4ae78871, State: Initialized, Role: FOLLOWER
I20260810 01:58:48.169948 5145 consensus_queue.cc:260] T 0afbd7afdd834537b15c727355724562 P 82f93d1d11364ceeb485585b4ae78871 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:48.171516 5145 ts_tablet_manager.cc:1434] T 0afbd7afdd834537b15c727355724562 P 82f93d1d11364ceeb485585b4ae78871: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260810 01:58:48.171908 5145 tablet_bootstrap.cc:492] T b63d0798e1ae4aea9b0272716d53d46d P 82f93d1d11364ceeb485585b4ae78871: Bootstrap starting.
I20260810 01:58:48.173895 5150 ts_tablet_manager.cc:1434] T be4737d169be4419b5a0a0b656a3930f P 17b49c694faf479ea2e5083470fc0302: Time spent starting tablet: real 0.026s user 0.009s sys 0.004s
I20260810 01:58:48.174429 5150 tablet_bootstrap.cc:492] T b63d0798e1ae4aea9b0272716d53d46d P 17b49c694faf479ea2e5083470fc0302: Bootstrap starting.
I20260810 01:58:48.175714 5145 tablet_bootstrap.cc:654] T b63d0798e1ae4aea9b0272716d53d46d P 82f93d1d11364ceeb485585b4ae78871: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:48.176888 5150 tablet_bootstrap.cc:654] T b63d0798e1ae4aea9b0272716d53d46d P 17b49c694faf479ea2e5083470fc0302: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:48.181035 5145 tablet_bootstrap.cc:492] T b63d0798e1ae4aea9b0272716d53d46d P 82f93d1d11364ceeb485585b4ae78871: No bootstrap required, opened a new log
I20260810 01:58:48.181327 5145 ts_tablet_manager.cc:1403] T b63d0798e1ae4aea9b0272716d53d46d P 82f93d1d11364ceeb485585b4ae78871: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260810 01:58:48.182379 5145 raft_consensus.cc:359] T b63d0798e1ae4aea9b0272716d53d46d P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 01:58:48.182713 5145 raft_consensus.cc:385] T b63d0798e1ae4aea9b0272716d53d46d P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:48.182938 5145 raft_consensus.cc:740] T b63d0798e1ae4aea9b0272716d53d46d P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f93d1d11364ceeb485585b4ae78871, State: Initialized, Role: FOLLOWER
I20260810 01:58:48.183281 5145 consensus_queue.cc:260] T b63d0798e1ae4aea9b0272716d53d46d P 82f93d1d11364ceeb485585b4ae78871 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 01:58:48.184062 5145 ts_tablet_manager.cc:1434] T b63d0798e1ae4aea9b0272716d53d46d P 82f93d1d11364ceeb485585b4ae78871: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 01:58:48.185925 5150 tablet_bootstrap.cc:492] T b63d0798e1ae4aea9b0272716d53d46d P 17b49c694faf479ea2e5083470fc0302: No bootstrap required, opened a new log
I20260810 01:58:48.186095 5150 ts_tablet_manager.cc:1403] T b63d0798e1ae4aea9b0272716d53d46d P 17b49c694faf479ea2e5083470fc0302: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.006s
I20260810 01:58:48.187758 5150 raft_consensus.cc:359] T b63d0798e1ae4aea9b0272716d53d46d P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 01:58:48.187994 5150 raft_consensus.cc:385] T b63d0798e1ae4aea9b0272716d53d46d P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:48.188114 5150 raft_consensus.cc:740] T b63d0798e1ae4aea9b0272716d53d46d P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17b49c694faf479ea2e5083470fc0302, State: Initialized, Role: FOLLOWER
I20260810 01:58:48.188366 5150 consensus_queue.cc:260] T b63d0798e1ae4aea9b0272716d53d46d P 17b49c694faf479ea2e5083470fc0302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 01:58:48.188927 5150 ts_tablet_manager.cc:1434] T b63d0798e1ae4aea9b0272716d53d46d P 17b49c694faf479ea2e5083470fc0302: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 01:58:48.190069 5147 ts_tablet_manager.cc:1434] T 0afbd7afdd834537b15c727355724562 P dc85be7d460a404f997177f57680850f: Time spent starting tablet: real 0.041s user 0.007s sys 0.008s
I20260810 01:58:48.190351 5142 tablet_bootstrap.cc:492] T be4737d169be4419b5a0a0b656a3930f P ca4469fc2dbc48488bc7ad7f482f129e: No bootstrap required, opened a new log
I20260810 01:58:48.190542 5142 ts_tablet_manager.cc:1403] T be4737d169be4419b5a0a0b656a3930f P ca4469fc2dbc48488bc7ad7f482f129e: Time spent bootstrapping tablet: real 0.034s user 0.007s sys 0.020s
I20260810 01:58:48.190821 5147 tablet_bootstrap.cc:492] T b63d0798e1ae4aea9b0272716d53d46d P dc85be7d460a404f997177f57680850f: Bootstrap starting.
I20260810 01:58:48.191589 5142 raft_consensus.cc:359] T be4737d169be4419b5a0a0b656a3930f P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:48.191797 5142 raft_consensus.cc:385] T be4737d169be4419b5a0a0b656a3930f P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:48.191903 5142 raft_consensus.cc:740] T be4737d169be4419b5a0a0b656a3930f P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca4469fc2dbc48488bc7ad7f482f129e, State: Initialized, Role: FOLLOWER
I20260810 01:58:48.192191 5142 consensus_queue.cc:260] T be4737d169be4419b5a0a0b656a3930f P ca4469fc2dbc48488bc7ad7f482f129e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:48.192986 5142 ts_tablet_manager.cc:1434] T be4737d169be4419b5a0a0b656a3930f P ca4469fc2dbc48488bc7ad7f482f129e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 01:58:48.193343 5147 tablet_bootstrap.cc:654] T b63d0798e1ae4aea9b0272716d53d46d P dc85be7d460a404f997177f57680850f: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:48.197181 5147 tablet_bootstrap.cc:492] T b63d0798e1ae4aea9b0272716d53d46d P dc85be7d460a404f997177f57680850f: No bootstrap required, opened a new log
I20260810 01:58:48.197400 5147 ts_tablet_manager.cc:1403] T b63d0798e1ae4aea9b0272716d53d46d P dc85be7d460a404f997177f57680850f: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.002s
I20260810 01:58:48.198621 5147 raft_consensus.cc:359] T b63d0798e1ae4aea9b0272716d53d46d P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 01:58:48.198864 5147 raft_consensus.cc:385] T b63d0798e1ae4aea9b0272716d53d46d P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:48.198971 5147 raft_consensus.cc:740] T b63d0798e1ae4aea9b0272716d53d46d P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc85be7d460a404f997177f57680850f, State: Initialized, Role: FOLLOWER
I20260810 01:58:48.199254 5147 consensus_queue.cc:260] T b63d0798e1ae4aea9b0272716d53d46d P dc85be7d460a404f997177f57680850f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 01:58:48.199913 5147 ts_tablet_manager.cc:1434] T b63d0798e1ae4aea9b0272716d53d46d P dc85be7d460a404f997177f57680850f: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
W20260810 01:58:48.261832 3827 tablet.cc:2406] T 0afbd7afdd834537b15c727355724562 P dc85be7d460a404f997177f57680850f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:58:48.264333 5153 raft_consensus.cc:493] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:58:48.264604 5153 raft_consensus.cc:515] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:48.266507 5153 leader_election.cc:290] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc85be7d460a404f997177f57680850f (127.21.64.193:36797), 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 01:58:48.275861 3945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afbd7afdd834537b15c727355724562" candidate_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f93d1d11364ceeb485585b4ae78871" is_pre_election: true
I20260810 01:58:48.275861 3761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afbd7afdd834537b15c727355724562" candidate_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc85be7d460a404f997177f57680850f" is_pre_election: true
I20260810 01:58:48.276439 3761 raft_consensus.cc:2468] T 0afbd7afdd834537b15c727355724562 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca4469fc2dbc48488bc7ad7f482f129e in term 0.
I20260810 01:58:48.276439 3945 raft_consensus.cc:2468] T 0afbd7afdd834537b15c727355724562 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca4469fc2dbc48488bc7ad7f482f129e in term 0.
I20260810 01:58:48.277185 4222 leader_election.cc:304] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82f93d1d11364ceeb485585b4ae78871, ca4469fc2dbc48488bc7ad7f482f129e; no voters:
I20260810 01:58:48.277623 5153 raft_consensus.cc:2804] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:58:48.277794 5153 raft_consensus.cc:493] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:58:48.277930 5153 raft_consensus.cc:3060] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:48.280074 5153 raft_consensus.cc:515] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:48.280771 5153 leader_election.cc:290] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [CANDIDATE]: Term 1 election: Requested vote from peers dc85be7d460a404f997177f57680850f (127.21.64.193:36797), 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 01:58:48.281214 3761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afbd7afdd834537b15c727355724562" candidate_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc85be7d460a404f997177f57680850f"
I20260810 01:58:48.281379 3945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afbd7afdd834537b15c727355724562" candidate_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f93d1d11364ceeb485585b4ae78871"
I20260810 01:58:48.281467 3761 raft_consensus.cc:3060] T 0afbd7afdd834537b15c727355724562 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:48.281585 3945 raft_consensus.cc:3060] T 0afbd7afdd834537b15c727355724562 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:48.284936 3761 raft_consensus.cc:2468] T 0afbd7afdd834537b15c727355724562 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca4469fc2dbc48488bc7ad7f482f129e in term 1.
I20260810 01:58:48.284936 3945 raft_consensus.cc:2468] T 0afbd7afdd834537b15c727355724562 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca4469fc2dbc48488bc7ad7f482f129e in term 1.
I20260810 01:58:48.285437 4219 leader_election.cc:304] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca4469fc2dbc48488bc7ad7f482f129e, dc85be7d460a404f997177f57680850f; no voters:
I20260810 01:58:48.285822 5153 raft_consensus.cc:2804] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:58:48.286330 5153 raft_consensus.cc:697] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Becoming Leader. State: Replica: ca4469fc2dbc48488bc7ad7f482f129e, State: Running, Role: LEADER
I20260810 01:58:48.286912 5153 consensus_queue.cc:237] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
W20260810 01:58:48.291544 4012 tablet.cc:2406] T 0afbd7afdd834537b15c727355724562 P 82f93d1d11364ceeb485585b4ae78871: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:58:48.291683 3573 catalog_manager.cc:5719] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e reported cstate change: term changed from 0 to 1, leader changed from <none> to ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196). New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
W20260810 01:58:48.317219 4195 tablet.cc:2406] T b63d0798e1ae4aea9b0272716d53d46d P 17b49c694faf479ea2e5083470fc0302: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 01:58:48.336934 4370 tablet.cc:2406] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:58:48.391170 5153 raft_consensus.cc:493] T be4737d169be4419b5a0a0b656a3930f P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:58:48.391422 5153 raft_consensus.cc:515] T be4737d169be4419b5a0a0b656a3930f P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:48.392314 5153 leader_election.cc:290] T be4737d169be4419b5a0a0b656a3930f P ca4469fc2dbc48488bc7ad7f482f129e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189), 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 01:58:48.393069 3945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be4737d169be4419b5a0a0b656a3930f" candidate_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f93d1d11364ceeb485585b4ae78871" is_pre_election: true
I20260810 01:58:48.393388 3945 raft_consensus.cc:2468] T be4737d169be4419b5a0a0b656a3930f P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca4469fc2dbc48488bc7ad7f482f129e in term 0.
I20260810 01:58:48.393895 4222 leader_election.cc:304] T be4737d169be4419b5a0a0b656a3930f P ca4469fc2dbc48488bc7ad7f482f129e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82f93d1d11364ceeb485585b4ae78871, ca4469fc2dbc48488bc7ad7f482f129e; no voters:
I20260810 01:58:48.394271 5153 raft_consensus.cc:2804] T be4737d169be4419b5a0a0b656a3930f P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:58:48.394379 5153 raft_consensus.cc:493] T be4737d169be4419b5a0a0b656a3930f P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:58:48.394480 5153 raft_consensus.cc:3060] T be4737d169be4419b5a0a0b656a3930f P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:48.397094 5153 raft_consensus.cc:515] T be4737d169be4419b5a0a0b656a3930f P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:48.397892 5153 leader_election.cc:290] T be4737d169be4419b5a0a0b656a3930f P ca4469fc2dbc48488bc7ad7f482f129e [CANDIDATE]: Term 1 election: Requested vote from peers 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189), 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 01:58:48.398402 3945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be4737d169be4419b5a0a0b656a3930f" candidate_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f93d1d11364ceeb485585b4ae78871"
I20260810 01:58:48.398620 3945 raft_consensus.cc:3060] T be4737d169be4419b5a0a0b656a3930f P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:48.399585 4132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be4737d169be4419b5a0a0b656a3930f" candidate_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17b49c694faf479ea2e5083470fc0302" is_pre_election: true
I20260810 01:58:48.399606 4131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be4737d169be4419b5a0a0b656a3930f" candidate_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17b49c694faf479ea2e5083470fc0302"
I20260810 01:58:48.400168 4131 raft_consensus.cc:3060] T be4737d169be4419b5a0a0b656a3930f P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:48.400683 3945 raft_consensus.cc:2468] T be4737d169be4419b5a0a0b656a3930f P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca4469fc2dbc48488bc7ad7f482f129e in term 1.
I20260810 01:58:48.401226 4222 leader_election.cc:304] T be4737d169be4419b5a0a0b656a3930f P ca4469fc2dbc48488bc7ad7f482f129e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82f93d1d11364ceeb485585b4ae78871, ca4469fc2dbc48488bc7ad7f482f129e; no voters:
I20260810 01:58:48.401557 5153 raft_consensus.cc:2804] T be4737d169be4419b5a0a0b656a3930f P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:58:48.401759 5153 raft_consensus.cc:697] T be4737d169be4419b5a0a0b656a3930f P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Becoming Leader. State: Replica: ca4469fc2dbc48488bc7ad7f482f129e, State: Running, Role: LEADER
I20260810 01:58:48.402050 5153 consensus_queue.cc:237] T be4737d169be4419b5a0a0b656a3930f P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:48.403497 4131 raft_consensus.cc:2468] T be4737d169be4419b5a0a0b656a3930f P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca4469fc2dbc48488bc7ad7f482f129e in term 1.
I20260810 01:58:48.404973 3573 catalog_manager.cc:5719] T be4737d169be4419b5a0a0b656a3930f P ca4469fc2dbc48488bc7ad7f482f129e reported cstate change: term changed from 0 to 1, leader changed from <none> to ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196). New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 01:58:48.533658 5154 raft_consensus.cc:493] T b63d0798e1ae4aea9b0272716d53d46d P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:58:48.533874 5154 raft_consensus.cc:515] T b63d0798e1ae4aea9b0272716d53d46d P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 01:58:48.536155 5154 leader_election.cc:290] T b63d0798e1ae4aea9b0272716d53d46d P 82f93d1d11364ceeb485585b4ae78871 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189), dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
I20260810 01:58:48.544224 4131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b63d0798e1ae4aea9b0272716d53d46d" candidate_uuid: "82f93d1d11364ceeb485585b4ae78871" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17b49c694faf479ea2e5083470fc0302" is_pre_election: true
I20260810 01:58:48.544552 4131 raft_consensus.cc:2468] T b63d0798e1ae4aea9b0272716d53d46d P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82f93d1d11364ceeb485585b4ae78871 in term 0.
I20260810 01:58:48.545069 3856 leader_election.cc:304] T b63d0798e1ae4aea9b0272716d53d46d P 82f93d1d11364ceeb485585b4ae78871 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17b49c694faf479ea2e5083470fc0302, 82f93d1d11364ceeb485585b4ae78871; no voters:
I20260810 01:58:48.545518 5154 raft_consensus.cc:2804] T b63d0798e1ae4aea9b0272716d53d46d P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:58:48.545650 5154 raft_consensus.cc:493] T b63d0798e1ae4aea9b0272716d53d46d P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:58:48.545609 3761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b63d0798e1ae4aea9b0272716d53d46d" candidate_uuid: "82f93d1d11364ceeb485585b4ae78871" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc85be7d460a404f997177f57680850f" is_pre_election: true
I20260810 01:58:48.545734 5154 raft_consensus.cc:3060] T b63d0798e1ae4aea9b0272716d53d46d P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:48.545872 3761 raft_consensus.cc:2468] T b63d0798e1ae4aea9b0272716d53d46d P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82f93d1d11364ceeb485585b4ae78871 in term 0.
I20260810 01:58:48.549073 5154 raft_consensus.cc:515] T b63d0798e1ae4aea9b0272716d53d46d P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 01:58:48.549829 5154 leader_election.cc:290] T b63d0798e1ae4aea9b0272716d53d46d P 82f93d1d11364ceeb485585b4ae78871 [CANDIDATE]: Term 1 election: Requested vote from peers 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189), dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
I20260810 01:58:48.550298 4131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b63d0798e1ae4aea9b0272716d53d46d" candidate_uuid: "82f93d1d11364ceeb485585b4ae78871" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17b49c694faf479ea2e5083470fc0302"
I20260810 01:58:48.550341 3761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b63d0798e1ae4aea9b0272716d53d46d" candidate_uuid: "82f93d1d11364ceeb485585b4ae78871" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc85be7d460a404f997177f57680850f"
I20260810 01:58:48.550514 4131 raft_consensus.cc:3060] T b63d0798e1ae4aea9b0272716d53d46d P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:48.550556 3761 raft_consensus.cc:3060] T b63d0798e1ae4aea9b0272716d53d46d P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:48.552817 3761 raft_consensus.cc:2468] T b63d0798e1ae4aea9b0272716d53d46d P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82f93d1d11364ceeb485585b4ae78871 in term 1.
I20260810 01:58:48.552820 4131 raft_consensus.cc:2468] T b63d0798e1ae4aea9b0272716d53d46d P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82f93d1d11364ceeb485585b4ae78871 in term 1.
I20260810 01:58:48.553244 3856 leader_election.cc:304] T b63d0798e1ae4aea9b0272716d53d46d P 82f93d1d11364ceeb485585b4ae78871 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17b49c694faf479ea2e5083470fc0302, 82f93d1d11364ceeb485585b4ae78871; no voters:
I20260810 01:58:48.553649 5154 raft_consensus.cc:2804] T b63d0798e1ae4aea9b0272716d53d46d P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:58:48.554100 5154 raft_consensus.cc:697] T b63d0798e1ae4aea9b0272716d53d46d P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Becoming Leader. State: Replica: 82f93d1d11364ceeb485585b4ae78871, State: Running, Role: LEADER
I20260810 01:58:48.554647 5154 consensus_queue.cc:237] T b63d0798e1ae4aea9b0272716d53d46d P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 01:58:48.559070 3573 catalog_manager.cc:5719] T b63d0798e1ae4aea9b0272716d53d46d P 82f93d1d11364ceeb485585b4ae78871 reported cstate change: term changed from 0 to 1, leader changed from <none> to 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194). New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } }
I20260810 01:58:48.739025 5153 consensus_queue.cc:1048] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:58:48.747607 5153 consensus_queue.cc:1048] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:58:48.789954 5153 consensus_queue.cc:1048] T be4737d169be4419b5a0a0b656a3930f P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:58:48.796074 5169 consensus_queue.cc:1048] T be4737d169be4419b5a0a0b656a3930f P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 01:58:48.995049 5178 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:58:48.995448 5178 flags.cc:432] Enabled unsafe flag: --never_fsync=true
Using table 'rebalance_test_table_0'
I20260810 01:58:49.094664 5154 consensus_queue.cc:1048] T b63d0798e1ae4aea9b0272716d53d46d P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:58:49.112242 5235 consensus_queue.cc:1048] T b63d0798e1ae4aea9b0272716d53d46d P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 275.432 ms
time per row: 0.137716 ms
I20260810 01:58:49.444511 3563 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51850:
name: "rebalance_test_table_1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260810 01:58:49.454152 3735 tablet_service.cc:1511] Processing CreateTablet for tablet 3a15b27dbdaf4092aea66c3670204fcc (DEFAULT_TABLE table=rebalance_test_table_1 [id=945a223441a04ba2bf938b104bc91cf8]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:49.454720 3735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a15b27dbdaf4092aea66c3670204fcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:49.454900 4285 tablet_service.cc:1511] Processing CreateTablet for tablet 3a15b27dbdaf4092aea66c3670204fcc (DEFAULT_TABLE table=rebalance_test_table_1 [id=945a223441a04ba2bf938b104bc91cf8]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:49.454881 4103 tablet_service.cc:1511] Processing CreateTablet for tablet 3a15b27dbdaf4092aea66c3670204fcc (DEFAULT_TABLE table=rebalance_test_table_1 [id=945a223441a04ba2bf938b104bc91cf8]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:49.455343 4103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a15b27dbdaf4092aea66c3670204fcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:49.455343 4285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a15b27dbdaf4092aea66c3670204fcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:49.456172 4105 tablet_service.cc:1511] Processing CreateTablet for tablet a586b7d625bb4c27a6343ae7918c8cea (DEFAULT_TABLE table=rebalance_test_table_1 [id=945a223441a04ba2bf938b104bc91cf8]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:49.456595 4105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a586b7d625bb4c27a6343ae7918c8cea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:49.458181 3737 tablet_service.cc:1511] Processing CreateTablet for tablet a586b7d625bb4c27a6343ae7918c8cea (DEFAULT_TABLE table=rebalance_test_table_1 [id=945a223441a04ba2bf938b104bc91cf8]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:49.458598 3737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a586b7d625bb4c27a6343ae7918c8cea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:49.460361 4102 tablet_service.cc:1511] Processing CreateTablet for tablet 2e72e04459b140cc9e20ad633b1ab5c4 (DEFAULT_TABLE table=rebalance_test_table_1 [id=945a223441a04ba2bf938b104bc91cf8]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:49.460765 4102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e72e04459b140cc9e20ad633b1ab5c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:49.463193 3734 tablet_service.cc:1511] Processing CreateTablet for tablet 2e72e04459b140cc9e20ad633b1ab5c4 (DEFAULT_TABLE table=rebalance_test_table_1 [id=945a223441a04ba2bf938b104bc91cf8]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:49.463649 3734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e72e04459b140cc9e20ad633b1ab5c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:49.466048 3920 tablet_service.cc:1511] Processing CreateTablet for tablet 2e72e04459b140cc9e20ad633b1ab5c4 (DEFAULT_TABLE table=rebalance_test_table_1 [id=945a223441a04ba2bf938b104bc91cf8]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:49.466486 3920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e72e04459b140cc9e20ad633b1ab5c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:49.470108 4286 tablet_service.cc:1511] Processing CreateTablet for tablet a586b7d625bb4c27a6343ae7918c8cea (DEFAULT_TABLE table=rebalance_test_table_1 [id=945a223441a04ba2bf938b104bc91cf8]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:49.470547 4286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a586b7d625bb4c27a6343ae7918c8cea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:49.483628 5285 tablet_bootstrap.cc:492] T 3a15b27dbdaf4092aea66c3670204fcc P ca4469fc2dbc48488bc7ad7f482f129e: Bootstrap starting.
I20260810 01:58:49.485807 5287 tablet_bootstrap.cc:492] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871: Bootstrap starting.
I20260810 01:58:49.487378 5285 tablet_bootstrap.cc:654] T 3a15b27dbdaf4092aea66c3670204fcc P ca4469fc2dbc48488bc7ad7f482f129e: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:49.488655 5287 tablet_bootstrap.cc:654] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:49.491762 5286 tablet_bootstrap.cc:492] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302: Bootstrap starting.
I20260810 01:58:49.493492 5284 tablet_bootstrap.cc:492] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f: Bootstrap starting.
I20260810 01:58:49.493606 5287 tablet_bootstrap.cc:492] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871: No bootstrap required, opened a new log
I20260810 01:58:49.493770 5287 ts_tablet_manager.cc:1403] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.002s
I20260810 01:58:49.493964 5285 tablet_bootstrap.cc:492] T 3a15b27dbdaf4092aea66c3670204fcc P ca4469fc2dbc48488bc7ad7f482f129e: No bootstrap required, opened a new log
I20260810 01:58:49.494132 5285 ts_tablet_manager.cc:1403] T 3a15b27dbdaf4092aea66c3670204fcc P ca4469fc2dbc48488bc7ad7f482f129e: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.000s
I20260810 01:58:49.494202 5286 tablet_bootstrap.cc:654] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:49.494661 5287 raft_consensus.cc:359] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:49.494894 5287 raft_consensus.cc:385] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:49.494983 5287 raft_consensus.cc:740] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f93d1d11364ceeb485585b4ae78871, State: Initialized, Role: FOLLOWER
I20260810 01:58:49.495048 5285 raft_consensus.cc:359] T 3a15b27dbdaf4092aea66c3670204fcc P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:49.495282 5285 raft_consensus.cc:385] T 3a15b27dbdaf4092aea66c3670204fcc P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:49.495397 5285 raft_consensus.cc:740] T 3a15b27dbdaf4092aea66c3670204fcc P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca4469fc2dbc48488bc7ad7f482f129e, State: Initialized, Role: FOLLOWER
I20260810 01:58:49.495663 5284 tablet_bootstrap.cc:654] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:49.495754 5287 consensus_queue.cc:260] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:49.495751 5285 consensus_queue.cc:260] T 3a15b27dbdaf4092aea66c3670204fcc P ca4469fc2dbc48488bc7ad7f482f129e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:49.496601 5285 ts_tablet_manager.cc:1434] T 3a15b27dbdaf4092aea66c3670204fcc P ca4469fc2dbc48488bc7ad7f482f129e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:58:49.496930 5285 tablet_bootstrap.cc:492] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e: Bootstrap starting.
I20260810 01:58:49.499493 5285 tablet_bootstrap.cc:654] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:49.507572 5287 ts_tablet_manager.cc:1434] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20260810 01:58:49.512850 5286 tablet_bootstrap.cc:492] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302: No bootstrap required, opened a new log
I20260810 01:58:49.513088 5286 ts_tablet_manager.cc:1403] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302: Time spent bootstrapping tablet: real 0.022s user 0.005s sys 0.015s
I20260810 01:58:49.513473 5284 tablet_bootstrap.cc:492] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f: No bootstrap required, opened a new log
I20260810 01:58:49.513513 5285 tablet_bootstrap.cc:492] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e: No bootstrap required, opened a new log
I20260810 01:58:49.513681 5285 ts_tablet_manager.cc:1403] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.011s
I20260810 01:58:49.513695 5284 ts_tablet_manager.cc:1403] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f: Time spent bootstrapping tablet: real 0.020s user 0.008s sys 0.011s
I20260810 01:58:49.514077 5286 raft_consensus.cc:359] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:49.514288 5286 raft_consensus.cc:385] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:49.514510 5285 raft_consensus.cc:359] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:49.514556 5284 raft_consensus.cc:359] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:49.514739 5284 raft_consensus.cc:385] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:49.514712 5286 raft_consensus.cc:740] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17b49c694faf479ea2e5083470fc0302, State: Initialized, Role: FOLLOWER
I20260810 01:58:49.514750 5285 raft_consensus.cc:385] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:49.514824 5285 raft_consensus.cc:740] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca4469fc2dbc48488bc7ad7f482f129e, State: Initialized, Role: FOLLOWER
I20260810 01:58:49.514894 5284 raft_consensus.cc:740] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc85be7d460a404f997177f57680850f, State: Initialized, Role: FOLLOWER
I20260810 01:58:49.515021 5286 consensus_queue.cc:260] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:49.515172 5284 consensus_queue.cc:260] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:49.515188 5285 consensus_queue.cc:260] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:49.515666 5286 ts_tablet_manager.cc:1434] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260810 01:58:49.515761 5284 ts_tablet_manager.cc:1434] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 01:58:49.516040 5286 tablet_bootstrap.cc:492] T 3a15b27dbdaf4092aea66c3670204fcc P 17b49c694faf479ea2e5083470fc0302: Bootstrap starting.
I20260810 01:58:49.516098 5284 tablet_bootstrap.cc:492] T 2e72e04459b140cc9e20ad633b1ab5c4 P dc85be7d460a404f997177f57680850f: Bootstrap starting.
I20260810 01:58:49.518042 5286 tablet_bootstrap.cc:654] T 3a15b27dbdaf4092aea66c3670204fcc P 17b49c694faf479ea2e5083470fc0302: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:49.518095 5284 tablet_bootstrap.cc:654] T 2e72e04459b140cc9e20ad633b1ab5c4 P dc85be7d460a404f997177f57680850f: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:49.518157 5285 ts_tablet_manager.cc:1434] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260810 01:58:49.521971 5284 tablet_bootstrap.cc:492] T 2e72e04459b140cc9e20ad633b1ab5c4 P dc85be7d460a404f997177f57680850f: No bootstrap required, opened a new log
I20260810 01:58:49.522189 5284 ts_tablet_manager.cc:1403] T 2e72e04459b140cc9e20ad633b1ab5c4 P dc85be7d460a404f997177f57680850f: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s
I20260810 01:58:49.523165 5286 tablet_bootstrap.cc:492] T 3a15b27dbdaf4092aea66c3670204fcc P 17b49c694faf479ea2e5083470fc0302: No bootstrap required, opened a new log
I20260810 01:58:49.523108 5284 raft_consensus.cc:359] T 2e72e04459b140cc9e20ad633b1ab5c4 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:49.523346 5286 ts_tablet_manager.cc:1403] T 3a15b27dbdaf4092aea66c3670204fcc P 17b49c694faf479ea2e5083470fc0302: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260810 01:58:49.523350 5284 raft_consensus.cc:385] T 2e72e04459b140cc9e20ad633b1ab5c4 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:49.523451 5284 raft_consensus.cc:740] T 2e72e04459b140cc9e20ad633b1ab5c4 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc85be7d460a404f997177f57680850f, State: Initialized, Role: FOLLOWER
I20260810 01:58:49.523715 5284 consensus_queue.cc:260] T 2e72e04459b140cc9e20ad633b1ab5c4 P dc85be7d460a404f997177f57680850f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:49.524087 5286 raft_consensus.cc:359] T 3a15b27dbdaf4092aea66c3670204fcc P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:49.524158 5284 ts_tablet_manager.cc:1434] T 2e72e04459b140cc9e20ad633b1ab5c4 P dc85be7d460a404f997177f57680850f: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 01:58:49.524292 5286 raft_consensus.cc:385] T 3a15b27dbdaf4092aea66c3670204fcc P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:49.524377 5286 raft_consensus.cc:740] T 3a15b27dbdaf4092aea66c3670204fcc P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17b49c694faf479ea2e5083470fc0302, State: Initialized, Role: FOLLOWER
I20260810 01:58:49.524487 5284 tablet_bootstrap.cc:492] T a586b7d625bb4c27a6343ae7918c8cea P dc85be7d460a404f997177f57680850f: Bootstrap starting.
I20260810 01:58:49.524636 5286 consensus_queue.cc:260] T 3a15b27dbdaf4092aea66c3670204fcc P 17b49c694faf479ea2e5083470fc0302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:49.525097 5286 ts_tablet_manager.cc:1434] T 3a15b27dbdaf4092aea66c3670204fcc P 17b49c694faf479ea2e5083470fc0302: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260810 01:58:49.525429 5286 tablet_bootstrap.cc:492] T 2e72e04459b140cc9e20ad633b1ab5c4 P 17b49c694faf479ea2e5083470fc0302: Bootstrap starting.
I20260810 01:58:49.526367 5284 tablet_bootstrap.cc:654] T a586b7d625bb4c27a6343ae7918c8cea P dc85be7d460a404f997177f57680850f: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:49.527271 5286 tablet_bootstrap.cc:654] T 2e72e04459b140cc9e20ad633b1ab5c4 P 17b49c694faf479ea2e5083470fc0302: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:49.529417 5284 tablet_bootstrap.cc:492] T a586b7d625bb4c27a6343ae7918c8cea P dc85be7d460a404f997177f57680850f: No bootstrap required, opened a new log
I20260810 01:58:49.529585 5284 ts_tablet_manager.cc:1403] T a586b7d625bb4c27a6343ae7918c8cea P dc85be7d460a404f997177f57680850f: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.003s
I20260810 01:58:49.530180 5284 raft_consensus.cc:359] T a586b7d625bb4c27a6343ae7918c8cea P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:49.530339 5284 raft_consensus.cc:385] T a586b7d625bb4c27a6343ae7918c8cea P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:49.530428 5284 raft_consensus.cc:740] T a586b7d625bb4c27a6343ae7918c8cea P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc85be7d460a404f997177f57680850f, State: Initialized, Role: FOLLOWER
I20260810 01:58:49.530681 5286 tablet_bootstrap.cc:492] T 2e72e04459b140cc9e20ad633b1ab5c4 P 17b49c694faf479ea2e5083470fc0302: No bootstrap required, opened a new log
I20260810 01:58:49.530706 5284 consensus_queue.cc:260] T a586b7d625bb4c27a6343ae7918c8cea P dc85be7d460a404f997177f57680850f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:49.530822 5286 ts_tablet_manager.cc:1403] T 2e72e04459b140cc9e20ad633b1ab5c4 P 17b49c694faf479ea2e5083470fc0302: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 01:58:49.531276 5284 ts_tablet_manager.cc:1434] T a586b7d625bb4c27a6343ae7918c8cea P dc85be7d460a404f997177f57680850f: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 01:58:49.531499 5286 raft_consensus.cc:359] T 2e72e04459b140cc9e20ad633b1ab5c4 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:49.531680 5286 raft_consensus.cc:385] T 2e72e04459b140cc9e20ad633b1ab5c4 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:49.531827 5286 raft_consensus.cc:740] T 2e72e04459b140cc9e20ad633b1ab5c4 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17b49c694faf479ea2e5083470fc0302, State: Initialized, Role: FOLLOWER
I20260810 01:58:49.532109 5286 consensus_queue.cc:260] T 2e72e04459b140cc9e20ad633b1ab5c4 P 17b49c694faf479ea2e5083470fc0302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:49.532629 5286 ts_tablet_manager.cc:1434] T 2e72e04459b140cc9e20ad633b1ab5c4 P 17b49c694faf479ea2e5083470fc0302: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:58:49.565316 5180 raft_consensus.cc:493] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:58:49.565588 5180 raft_consensus.cc:515] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:49.567252 5180 leader_election.cc:290] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189), ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943)
I20260810 01:58:49.576721 4132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a15b27dbdaf4092aea66c3670204fcc" candidate_uuid: "dc85be7d460a404f997177f57680850f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17b49c694faf479ea2e5083470fc0302" is_pre_election: true
I20260810 01:58:49.577018 4132 raft_consensus.cc:2468] T 3a15b27dbdaf4092aea66c3670204fcc P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc85be7d460a404f997177f57680850f in term 0.
I20260810 01:58:49.576910 4313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a15b27dbdaf4092aea66c3670204fcc" candidate_uuid: "dc85be7d460a404f997177f57680850f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" is_pre_election: true
I20260810 01:58:49.577392 4313 raft_consensus.cc:2468] T 3a15b27dbdaf4092aea66c3670204fcc P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc85be7d460a404f997177f57680850f in term 0.
I20260810 01:58:49.577716 3671 leader_election.cc:304] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17b49c694faf479ea2e5083470fc0302, dc85be7d460a404f997177f57680850f; no voters:
I20260810 01:58:49.578158 5180 raft_consensus.cc:2804] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:58:49.578302 5180 raft_consensus.cc:493] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:58:49.578437 5180 raft_consensus.cc:3060] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:49.579589 5235 raft_consensus.cc:493] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:58:49.579821 5235 raft_consensus.cc:515] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:49.580673 5235 leader_election.cc:290] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc85be7d460a404f997177f57680850f (127.21.64.193:36797), 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189)
I20260810 01:58:49.581182 3761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e72e04459b140cc9e20ad633b1ab5c4" candidate_uuid: "82f93d1d11364ceeb485585b4ae78871" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc85be7d460a404f997177f57680850f" is_pre_election: true
I20260810 01:58:49.581436 3761 raft_consensus.cc:2468] T 2e72e04459b140cc9e20ad633b1ab5c4 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82f93d1d11364ceeb485585b4ae78871 in term 0.
I20260810 01:58:49.581415 5180 raft_consensus.cc:515] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:49.582000 3855 leader_election.cc:304] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82f93d1d11364ceeb485585b4ae78871, dc85be7d460a404f997177f57680850f; no voters:
I20260810 01:58:49.582345 5235 raft_consensus.cc:2804] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:58:49.582449 5235 raft_consensus.cc:493] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:58:49.582563 5235 raft_consensus.cc:3060] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:49.582937 5180 leader_election.cc:290] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f [CANDIDATE]: Term 1 election: Requested vote from peers 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189), ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943)
I20260810 01:58:49.582965 4313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a15b27dbdaf4092aea66c3670204fcc" candidate_uuid: "dc85be7d460a404f997177f57680850f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca4469fc2dbc48488bc7ad7f482f129e"
I20260810 01:58:49.583148 4313 raft_consensus.cc:3060] T 3a15b27dbdaf4092aea66c3670204fcc P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:49.584658 4132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a15b27dbdaf4092aea66c3670204fcc" candidate_uuid: "dc85be7d460a404f997177f57680850f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17b49c694faf479ea2e5083470fc0302"
I20260810 01:58:49.584772 5235 raft_consensus.cc:515] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:49.584882 4132 raft_consensus.cc:3060] T 3a15b27dbdaf4092aea66c3670204fcc P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:49.585438 5235 leader_election.cc:290] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871 [CANDIDATE]: Term 1 election: Requested vote from peers dc85be7d460a404f997177f57680850f (127.21.64.193:36797), 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189)
I20260810 01:58:49.585808 3761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e72e04459b140cc9e20ad633b1ab5c4" candidate_uuid: "82f93d1d11364ceeb485585b4ae78871" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc85be7d460a404f997177f57680850f"
I20260810 01:58:49.586010 3761 raft_consensus.cc:3060] T 2e72e04459b140cc9e20ad633b1ab5c4 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:49.585979 4131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e72e04459b140cc9e20ad633b1ab5c4" candidate_uuid: "82f93d1d11364ceeb485585b4ae78871" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17b49c694faf479ea2e5083470fc0302" is_pre_election: true
I20260810 01:58:49.586199 4131 raft_consensus.cc:2468] T 2e72e04459b140cc9e20ad633b1ab5c4 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82f93d1d11364ceeb485585b4ae78871 in term 0.
I20260810 01:58:49.586169 4129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e72e04459b140cc9e20ad633b1ab5c4" candidate_uuid: "82f93d1d11364ceeb485585b4ae78871" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17b49c694faf479ea2e5083470fc0302"
I20260810 01:58:49.586469 4129 raft_consensus.cc:3060] T 2e72e04459b140cc9e20ad633b1ab5c4 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:49.588292 4132 raft_consensus.cc:2468] T 3a15b27dbdaf4092aea66c3670204fcc P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc85be7d460a404f997177f57680850f in term 1.
I20260810 01:58:49.588807 3671 leader_election.cc:304] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17b49c694faf479ea2e5083470fc0302, dc85be7d460a404f997177f57680850f; no voters:
I20260810 01:58:49.588937 4129 raft_consensus.cc:2468] T 2e72e04459b140cc9e20ad633b1ab5c4 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82f93d1d11364ceeb485585b4ae78871 in term 1.
I20260810 01:58:49.588996 3761 raft_consensus.cc:2468] T 2e72e04459b140cc9e20ad633b1ab5c4 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82f93d1d11364ceeb485585b4ae78871 in term 1.
I20260810 01:58:49.589145 5180 raft_consensus.cc:2804] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:58:49.591641 4313 raft_consensus.cc:2468] T 3a15b27dbdaf4092aea66c3670204fcc P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc85be7d460a404f997177f57680850f in term 1.
I20260810 01:58:49.589589 3855 leader_election.cc:304] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82f93d1d11364ceeb485585b4ae78871, dc85be7d460a404f997177f57680850f; no voters:
I20260810 01:58:49.592114 5235 raft_consensus.cc:2804] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:58:49.592406 5235 raft_consensus.cc:697] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Becoming Leader. State: Replica: 82f93d1d11364ceeb485585b4ae78871, State: Running, Role: LEADER
I20260810 01:58:49.593261 5235 consensus_queue.cc:237] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:49.593745 5180 raft_consensus.cc:697] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Becoming Leader. State: Replica: dc85be7d460a404f997177f57680850f, State: Running, Role: LEADER
I20260810 01:58:49.594287 5180 consensus_queue.cc:237] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:49.597950 3572 catalog_manager.cc:5719] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f reported cstate change: term changed from 0 to 1, leader changed from <none> to dc85be7d460a404f997177f57680850f (127.21.64.193). New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
I20260810 01:58:49.603317 3572 catalog_manager.cc:5719] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871 reported cstate change: term changed from 0 to 1, leader changed from <none> to 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194). New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } }
I20260810 01:58:49.652309 5153 raft_consensus.cc:493] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:58:49.652640 5153 raft_consensus.cc:515] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:49.653530 5153 leader_election.cc:290] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc85be7d460a404f997177f57680850f (127.21.64.193:36797), 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189)
I20260810 01:58:49.654106 3761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a586b7d625bb4c27a6343ae7918c8cea" candidate_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc85be7d460a404f997177f57680850f" is_pre_election: true
I20260810 01:58:49.654209 4129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a586b7d625bb4c27a6343ae7918c8cea" candidate_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17b49c694faf479ea2e5083470fc0302" is_pre_election: true
I20260810 01:58:49.654366 3761 raft_consensus.cc:2468] T a586b7d625bb4c27a6343ae7918c8cea P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca4469fc2dbc48488bc7ad7f482f129e in term 0.
I20260810 01:58:49.654582 4129 raft_consensus.cc:2468] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca4469fc2dbc48488bc7ad7f482f129e in term 0.
I20260810 01:58:49.654980 4219 leader_election.cc:304] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca4469fc2dbc48488bc7ad7f482f129e, dc85be7d460a404f997177f57680850f; no voters:
I20260810 01:58:49.655313 5153 raft_consensus.cc:2804] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:58:49.655421 5153 raft_consensus.cc:493] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:58:49.655575 5153 raft_consensus.cc:3060] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:49.657966 5153 raft_consensus.cc:515] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:49.658672 5153 leader_election.cc:290] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e [CANDIDATE]: Term 1 election: Requested vote from peers dc85be7d460a404f997177f57680850f (127.21.64.193:36797), 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189)
I20260810 01:58:49.658978 3761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a586b7d625bb4c27a6343ae7918c8cea" candidate_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc85be7d460a404f997177f57680850f"
I20260810 01:58:49.659221 3761 raft_consensus.cc:3060] T a586b7d625bb4c27a6343ae7918c8cea P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:49.659226 4129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a586b7d625bb4c27a6343ae7918c8cea" candidate_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17b49c694faf479ea2e5083470fc0302"
I20260810 01:58:49.659467 4129 raft_consensus.cc:3060] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:49.661355 3761 raft_consensus.cc:2468] T a586b7d625bb4c27a6343ae7918c8cea P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca4469fc2dbc48488bc7ad7f482f129e in term 1.
I20260810 01:58:49.661531 4129 raft_consensus.cc:2468] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca4469fc2dbc48488bc7ad7f482f129e in term 1.
I20260810 01:58:49.661829 4219 leader_election.cc:304] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca4469fc2dbc48488bc7ad7f482f129e, dc85be7d460a404f997177f57680850f; no voters:
I20260810 01:58:49.662113 5153 raft_consensus.cc:2804] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:58:49.662289 5153 raft_consensus.cc:697] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Becoming Leader. State: Replica: ca4469fc2dbc48488bc7ad7f482f129e, State: Running, Role: LEADER
I20260810 01:58:49.662591 5153 consensus_queue.cc:237] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:49.665401 3572 catalog_manager.cc:5719] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e reported cstate change: term changed from 0 to 1, leader changed from <none> to ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196). New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
I20260810 01:58:50.089519 5180 consensus_queue.cc:1048] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:58:50.097143 5305 consensus_queue.cc:1048] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 01:58:50.110322 5310 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:58:50.110668 5310 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260810 01:58:50.123507 5235 consensus_queue.cc:1048] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:58:50.125927 5235 consensus_queue.cc:1048] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
Using table 'rebalance_test_table_1'
I20260810 01:58:50.219003 5153 consensus_queue.cc:1048] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:58:50.226711 5153 consensus_queue.cc:1048] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 01:58:50.406605 4220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.195:39189, user_credentials={real_user=slave}} blocked reactor thread for 79160.5us
INSERT report
rows total: 2000
time total: 228.492 ms
time per row: 0.114246 ms
I20260810 01:58:50.528362 3563 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51850:
name: "rebalance_test_table_2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260810 01:58:50.538722 4285 tablet_service.cc:1511] Processing CreateTablet for tablet df5b102a0b03406f9449cdd84dfd147e (DEFAULT_TABLE table=rebalance_test_table_2 [id=5e8751d351ba4b7da7861e02b0c3c634]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:50.539279 4285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df5b102a0b03406f9449cdd84dfd147e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:50.539281 3920 tablet_service.cc:1511] Processing CreateTablet for tablet df5b102a0b03406f9449cdd84dfd147e (DEFAULT_TABLE table=rebalance_test_table_2 [id=5e8751d351ba4b7da7861e02b0c3c634]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:50.539745 3920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df5b102a0b03406f9449cdd84dfd147e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:50.541095 3737 tablet_service.cc:1511] Processing CreateTablet for tablet 7207ea155ba44c0a9ba216acd22dc1b4 (DEFAULT_TABLE table=rebalance_test_table_2 [id=5e8751d351ba4b7da7861e02b0c3c634]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:50.541788 3737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7207ea155ba44c0a9ba216acd22dc1b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:50.545797 3735 tablet_service.cc:1511] Processing CreateTablet for tablet df5b102a0b03406f9449cdd84dfd147e (DEFAULT_TABLE table=rebalance_test_table_2 [id=5e8751d351ba4b7da7861e02b0c3c634]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:50.546339 3735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df5b102a0b03406f9449cdd84dfd147e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:50.549893 4105 tablet_service.cc:1511] Processing CreateTablet for tablet c53fc4008faf445fa05e436b9c8e0282 (DEFAULT_TABLE table=rebalance_test_table_2 [id=5e8751d351ba4b7da7861e02b0c3c634]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:50.550544 4105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c53fc4008faf445fa05e436b9c8e0282. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:50.552155 5397 tablet_bootstrap.cc:492] T 7207ea155ba44c0a9ba216acd22dc1b4 P dc85be7d460a404f997177f57680850f: Bootstrap starting.
I20260810 01:58:50.553975 4286 tablet_service.cc:1511] Processing CreateTablet for tablet c53fc4008faf445fa05e436b9c8e0282 (DEFAULT_TABLE table=rebalance_test_table_2 [id=5e8751d351ba4b7da7861e02b0c3c634]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:50.554271 5397 tablet_bootstrap.cc:654] T 7207ea155ba44c0a9ba216acd22dc1b4 P dc85be7d460a404f997177f57680850f: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:50.554453 4286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c53fc4008faf445fa05e436b9c8e0282. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:50.558054 4284 tablet_service.cc:1511] Processing CreateTablet for tablet 7207ea155ba44c0a9ba216acd22dc1b4 (DEFAULT_TABLE table=rebalance_test_table_2 [id=5e8751d351ba4b7da7861e02b0c3c634]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:50.558602 4284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7207ea155ba44c0a9ba216acd22dc1b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:50.562117 3917 tablet_service.cc:1511] Processing CreateTablet for tablet c53fc4008faf445fa05e436b9c8e0282 (DEFAULT_TABLE table=rebalance_test_table_2 [id=5e8751d351ba4b7da7861e02b0c3c634]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:50.562595 3917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c53fc4008faf445fa05e436b9c8e0282. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:50.565833 3916 tablet_service.cc:1511] Processing CreateTablet for tablet 7207ea155ba44c0a9ba216acd22dc1b4 (DEFAULT_TABLE table=rebalance_test_table_2 [id=5e8751d351ba4b7da7861e02b0c3c634]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:50.566300 3916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7207ea155ba44c0a9ba216acd22dc1b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:50.567754 5401 tablet_bootstrap.cc:492] T df5b102a0b03406f9449cdd84dfd147e P 82f93d1d11364ceeb485585b4ae78871: Bootstrap starting.
I20260810 01:58:50.569938 5401 tablet_bootstrap.cc:654] T df5b102a0b03406f9449cdd84dfd147e P 82f93d1d11364ceeb485585b4ae78871: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:50.573820 5396 tablet_bootstrap.cc:492] T df5b102a0b03406f9449cdd84dfd147e P ca4469fc2dbc48488bc7ad7f482f129e: Bootstrap starting.
I20260810 01:58:50.575585 5401 tablet_bootstrap.cc:492] T df5b102a0b03406f9449cdd84dfd147e P 82f93d1d11364ceeb485585b4ae78871: No bootstrap required, opened a new log
I20260810 01:58:50.575762 5401 ts_tablet_manager.cc:1403] T df5b102a0b03406f9449cdd84dfd147e P 82f93d1d11364ceeb485585b4ae78871: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20260810 01:58:50.575979 5396 tablet_bootstrap.cc:654] T df5b102a0b03406f9449cdd84dfd147e P ca4469fc2dbc48488bc7ad7f482f129e: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:50.576717 5401 raft_consensus.cc:359] T df5b102a0b03406f9449cdd84dfd147e P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:50.576973 5401 raft_consensus.cc:385] T df5b102a0b03406f9449cdd84dfd147e P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:50.577113 5401 raft_consensus.cc:740] T df5b102a0b03406f9449cdd84dfd147e P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f93d1d11364ceeb485585b4ae78871, State: Initialized, Role: FOLLOWER
I20260810 01:58:50.577414 5401 consensus_queue.cc:260] T df5b102a0b03406f9449cdd84dfd147e P 82f93d1d11364ceeb485585b4ae78871 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:50.577989 5401 ts_tablet_manager.cc:1434] T df5b102a0b03406f9449cdd84dfd147e P 82f93d1d11364ceeb485585b4ae78871: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:58:50.580812 5400 tablet_bootstrap.cc:492] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302: Bootstrap starting.
I20260810 01:58:50.583563 5400 tablet_bootstrap.cc:654] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:50.588572 5401 tablet_bootstrap.cc:492] T 7207ea155ba44c0a9ba216acd22dc1b4 P 82f93d1d11364ceeb485585b4ae78871: Bootstrap starting.
I20260810 01:58:50.590574 5401 tablet_bootstrap.cc:654] T 7207ea155ba44c0a9ba216acd22dc1b4 P 82f93d1d11364ceeb485585b4ae78871: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:50.591329 5400 tablet_bootstrap.cc:492] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302: No bootstrap required, opened a new log
I20260810 01:58:50.591558 5400 ts_tablet_manager.cc:1403] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.005s
I20260810 01:58:50.592449 5400 raft_consensus.cc:359] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:50.592851 5400 raft_consensus.cc:385] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:50.592996 5400 raft_consensus.cc:740] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17b49c694faf479ea2e5083470fc0302, State: Initialized, Role: FOLLOWER
I20260810 01:58:50.593374 5400 consensus_queue.cc:260] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:50.594686 5400 ts_tablet_manager.cc:1434] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 01:58:50.595685 5396 tablet_bootstrap.cc:492] T df5b102a0b03406f9449cdd84dfd147e P ca4469fc2dbc48488bc7ad7f482f129e: No bootstrap required, opened a new log
I20260810 01:58:50.595841 5396 ts_tablet_manager.cc:1403] T df5b102a0b03406f9449cdd84dfd147e P ca4469fc2dbc48488bc7ad7f482f129e: Time spent bootstrapping tablet: real 0.022s user 0.000s sys 0.012s
I20260810 01:58:50.596623 5396 raft_consensus.cc:359] T df5b102a0b03406f9449cdd84dfd147e P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:50.596829 5396 raft_consensus.cc:385] T df5b102a0b03406f9449cdd84dfd147e P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:50.596920 5396 raft_consensus.cc:740] T df5b102a0b03406f9449cdd84dfd147e P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca4469fc2dbc48488bc7ad7f482f129e, State: Initialized, Role: FOLLOWER
I20260810 01:58:50.597165 5396 consensus_queue.cc:260] T df5b102a0b03406f9449cdd84dfd147e P ca4469fc2dbc48488bc7ad7f482f129e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:50.597738 5396 ts_tablet_manager.cc:1434] T df5b102a0b03406f9449cdd84dfd147e P ca4469fc2dbc48488bc7ad7f482f129e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:58:50.598053 5396 tablet_bootstrap.cc:492] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e: Bootstrap starting.
I20260810 01:58:50.598146 5397 tablet_bootstrap.cc:492] T 7207ea155ba44c0a9ba216acd22dc1b4 P dc85be7d460a404f997177f57680850f: No bootstrap required, opened a new log
I20260810 01:58:50.598323 5397 ts_tablet_manager.cc:1403] T 7207ea155ba44c0a9ba216acd22dc1b4 P dc85be7d460a404f997177f57680850f: Time spent bootstrapping tablet: real 0.046s user 0.001s sys 0.009s
I20260810 01:58:50.601312 5396 tablet_bootstrap.cc:654] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:50.603379 5397 raft_consensus.cc:359] T 7207ea155ba44c0a9ba216acd22dc1b4 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:50.608434 5397 raft_consensus.cc:385] T 7207ea155ba44c0a9ba216acd22dc1b4 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:50.608727 5397 raft_consensus.cc:740] T 7207ea155ba44c0a9ba216acd22dc1b4 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc85be7d460a404f997177f57680850f, State: Initialized, Role: FOLLOWER
I20260810 01:58:50.609212 5397 consensus_queue.cc:260] T 7207ea155ba44c0a9ba216acd22dc1b4 P dc85be7d460a404f997177f57680850f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:50.611284 5396 tablet_bootstrap.cc:492] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e: No bootstrap required, opened a new log
I20260810 01:58:50.611514 5396 ts_tablet_manager.cc:1403] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.007s
I20260810 01:58:50.611593 5401 tablet_bootstrap.cc:492] T 7207ea155ba44c0a9ba216acd22dc1b4 P 82f93d1d11364ceeb485585b4ae78871: No bootstrap required, opened a new log
I20260810 01:58:50.611773 5401 ts_tablet_manager.cc:1403] T 7207ea155ba44c0a9ba216acd22dc1b4 P 82f93d1d11364ceeb485585b4ae78871: Time spent bootstrapping tablet: real 0.023s user 0.013s sys 0.008s
I20260810 01:58:50.612578 5397 ts_tablet_manager.cc:1434] T 7207ea155ba44c0a9ba216acd22dc1b4 P dc85be7d460a404f997177f57680850f: Time spent starting tablet: real 0.014s user 0.003s sys 0.000s
I20260810 01:58:50.612555 5396 raft_consensus.cc:359] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:50.612694 5312 raft_consensus.cc:493] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:58:50.612784 5396 raft_consensus.cc:385] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:50.612869 5396 raft_consensus.cc:740] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca4469fc2dbc48488bc7ad7f482f129e, State: Initialized, Role: FOLLOWER
I20260810 01:58:50.612908 5312 raft_consensus.cc:515] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:50.613301 5396 consensus_queue.cc:260] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:50.613880 5396 ts_tablet_manager.cc:1434] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:58:50.614288 5396 tablet_bootstrap.cc:492] T c53fc4008faf445fa05e436b9c8e0282 P ca4469fc2dbc48488bc7ad7f482f129e: Bootstrap starting.
I20260810 01:58:50.614979 5312 leader_election.cc:290] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893), ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943)
I20260810 01:58:50.617234 5396 tablet_bootstrap.cc:654] T c53fc4008faf445fa05e436b9c8e0282 P ca4469fc2dbc48488bc7ad7f482f129e: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:50.619232 5397 tablet_bootstrap.cc:492] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f: Bootstrap starting.
I20260810 01:58:50.619431 5401 raft_consensus.cc:359] T 7207ea155ba44c0a9ba216acd22dc1b4 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:50.619719 5401 raft_consensus.cc:385] T 7207ea155ba44c0a9ba216acd22dc1b4 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:50.619840 5401 raft_consensus.cc:740] T 7207ea155ba44c0a9ba216acd22dc1b4 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f93d1d11364ceeb485585b4ae78871, State: Initialized, Role: FOLLOWER
I20260810 01:58:50.620209 5401 consensus_queue.cc:260] T 7207ea155ba44c0a9ba216acd22dc1b4 P 82f93d1d11364ceeb485585b4ae78871 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:50.621261 5397 tablet_bootstrap.cc:654] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:50.622730 5396 tablet_bootstrap.cc:492] T c53fc4008faf445fa05e436b9c8e0282 P ca4469fc2dbc48488bc7ad7f482f129e: No bootstrap required, opened a new log
I20260810 01:58:50.622997 5396 ts_tablet_manager.cc:1403] T c53fc4008faf445fa05e436b9c8e0282 P ca4469fc2dbc48488bc7ad7f482f129e: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.004s
I20260810 01:58:50.624135 5401 ts_tablet_manager.cc:1434] T 7207ea155ba44c0a9ba216acd22dc1b4 P 82f93d1d11364ceeb485585b4ae78871: Time spent starting tablet: real 0.012s user 0.002s sys 0.001s
I20260810 01:58:50.624100 5396 raft_consensus.cc:359] T c53fc4008faf445fa05e436b9c8e0282 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:50.624500 5396 raft_consensus.cc:385] T c53fc4008faf445fa05e436b9c8e0282 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:50.624691 5396 raft_consensus.cc:740] T c53fc4008faf445fa05e436b9c8e0282 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca4469fc2dbc48488bc7ad7f482f129e, State: Initialized, Role: FOLLOWER
I20260810 01:58:50.625133 5396 consensus_queue.cc:260] T c53fc4008faf445fa05e436b9c8e0282 P ca4469fc2dbc48488bc7ad7f482f129e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:50.627929 5401 tablet_bootstrap.cc:492] T c53fc4008faf445fa05e436b9c8e0282 P 82f93d1d11364ceeb485585b4ae78871: Bootstrap starting.
I20260810 01:58:50.629283 5396 ts_tablet_manager.cc:1434] T c53fc4008faf445fa05e436b9c8e0282 P ca4469fc2dbc48488bc7ad7f482f129e: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260810 01:58:50.632319 5401 tablet_bootstrap.cc:654] T c53fc4008faf445fa05e436b9c8e0282 P 82f93d1d11364ceeb485585b4ae78871: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:50.642009 5153 raft_consensus.cc:493] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:58:50.642272 5153 raft_consensus.cc:515] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:50.643049 5153 leader_election.cc:290] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893), dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
I20260810 01:58:50.644371 5401 tablet_bootstrap.cc:492] T c53fc4008faf445fa05e436b9c8e0282 P 82f93d1d11364ceeb485585b4ae78871: No bootstrap required, opened a new log
I20260810 01:58:50.644616 5401 ts_tablet_manager.cc:1403] T c53fc4008faf445fa05e436b9c8e0282 P 82f93d1d11364ceeb485585b4ae78871: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.005s
I20260810 01:58:50.644632 3761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7207ea155ba44c0a9ba216acd22dc1b4" candidate_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc85be7d460a404f997177f57680850f" is_pre_election: true
I20260810 01:58:50.644891 3761 raft_consensus.cc:2468] T 7207ea155ba44c0a9ba216acd22dc1b4 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca4469fc2dbc48488bc7ad7f482f129e in term 0.
I20260810 01:58:50.645685 4219 leader_election.cc:304] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca4469fc2dbc48488bc7ad7f482f129e, dc85be7d460a404f997177f57680850f; no voters:
I20260810 01:58:50.644385 3944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7207ea155ba44c0a9ba216acd22dc1b4" candidate_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f93d1d11364ceeb485585b4ae78871" is_pre_election: true
I20260810 01:58:50.646167 3944 raft_consensus.cc:2468] T 7207ea155ba44c0a9ba216acd22dc1b4 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca4469fc2dbc48488bc7ad7f482f129e in term 0.
I20260810 01:58:50.646940 5153 raft_consensus.cc:2804] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:58:50.647080 5153 raft_consensus.cc:493] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:58:50.647179 5153 raft_consensus.cc:3060] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:50.648142 4313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53fc4008faf445fa05e436b9c8e0282" candidate_uuid: "17b49c694faf479ea2e5083470fc0302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" is_pre_election: true
I20260810 01:58:50.648454 4313 raft_consensus.cc:2468] T c53fc4008faf445fa05e436b9c8e0282 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17b49c694faf479ea2e5083470fc0302 in term 0.
I20260810 01:58:50.649282 4038 leader_election.cc:304] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17b49c694faf479ea2e5083470fc0302, ca4469fc2dbc48488bc7ad7f482f129e; no voters:
I20260810 01:58:50.645714 5401 raft_consensus.cc:359] T c53fc4008faf445fa05e436b9c8e0282 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:50.649714 5401 raft_consensus.cc:385] T c53fc4008faf445fa05e436b9c8e0282 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:50.649785 5312 raft_consensus.cc:2804] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:58:50.649827 5401 raft_consensus.cc:740] T c53fc4008faf445fa05e436b9c8e0282 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f93d1d11364ceeb485585b4ae78871, State: Initialized, Role: FOLLOWER
I20260810 01:58:50.649911 5312 raft_consensus.cc:493] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:58:50.649871 5153 raft_consensus.cc:515] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:50.650013 5312 raft_consensus.cc:3060] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:50.650153 5401 consensus_queue.cc:260] T c53fc4008faf445fa05e436b9c8e0282 P 82f93d1d11364ceeb485585b4ae78871 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:50.651197 3944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7207ea155ba44c0a9ba216acd22dc1b4" candidate_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f93d1d11364ceeb485585b4ae78871"
I20260810 01:58:50.651414 3944 raft_consensus.cc:3060] T 7207ea155ba44c0a9ba216acd22dc1b4 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:50.651703 3761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7207ea155ba44c0a9ba216acd22dc1b4" candidate_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc85be7d460a404f997177f57680850f"
I20260810 01:58:50.651906 3761 raft_consensus.cc:3060] T 7207ea155ba44c0a9ba216acd22dc1b4 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:50.653126 5312 raft_consensus.cc:515] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:50.653903 5312 leader_election.cc:290] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 1 election: Requested vote from peers 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893), ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943)
I20260810 01:58:50.654896 4313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53fc4008faf445fa05e436b9c8e0282" candidate_uuid: "17b49c694faf479ea2e5083470fc0302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca4469fc2dbc48488bc7ad7f482f129e"
I20260810 01:58:50.655117 4313 raft_consensus.cc:3060] T c53fc4008faf445fa05e436b9c8e0282 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:50.655102 3761 raft_consensus.cc:2468] T 7207ea155ba44c0a9ba216acd22dc1b4 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca4469fc2dbc48488bc7ad7f482f129e in term 1.
I20260810 01:58:50.655583 4219 leader_election.cc:304] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca4469fc2dbc48488bc7ad7f482f129e, dc85be7d460a404f997177f57680850f; no voters:
I20260810 01:58:50.655933 5378 raft_consensus.cc:2804] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:58:50.656100 5378 raft_consensus.cc:697] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Becoming Leader. State: Replica: ca4469fc2dbc48488bc7ad7f482f129e, State: Running, Role: LEADER
I20260810 01:58:50.656440 5378 consensus_queue.cc:237] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:50.658219 4313 raft_consensus.cc:2468] T c53fc4008faf445fa05e436b9c8e0282 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17b49c694faf479ea2e5083470fc0302 in term 1.
I20260810 01:58:50.658473 3943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53fc4008faf445fa05e436b9c8e0282" candidate_uuid: "17b49c694faf479ea2e5083470fc0302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f93d1d11364ceeb485585b4ae78871"
I20260810 01:58:50.658794 3943 raft_consensus.cc:3060] T c53fc4008faf445fa05e436b9c8e0282 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:50.659307 5153 leader_election.cc:290] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e [CANDIDATE]: Term 1 election: Requested vote from peers 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893), dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
I20260810 01:58:50.660966 3944 raft_consensus.cc:2468] T 7207ea155ba44c0a9ba216acd22dc1b4 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca4469fc2dbc48488bc7ad7f482f129e in term 1.
I20260810 01:58:50.661903 5401 ts_tablet_manager.cc:1434] T c53fc4008faf445fa05e436b9c8e0282 P 82f93d1d11364ceeb485585b4ae78871: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20260810 01:58:50.662680 3943 raft_consensus.cc:2468] T c53fc4008faf445fa05e436b9c8e0282 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17b49c694faf479ea2e5083470fc0302 in term 1.
I20260810 01:58:50.662931 4038 leader_election.cc:304] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17b49c694faf479ea2e5083470fc0302, ca4469fc2dbc48488bc7ad7f482f129e; no voters:
I20260810 01:58:50.663328 5312 raft_consensus.cc:2804] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:58:50.658773 3945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53fc4008faf445fa05e436b9c8e0282" candidate_uuid: "17b49c694faf479ea2e5083470fc0302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f93d1d11364ceeb485585b4ae78871" is_pre_election: true
I20260810 01:58:50.663864 3945 raft_consensus.cc:2376] T c53fc4008faf445fa05e436b9c8e0282 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 17b49c694faf479ea2e5083470fc0302 in term 1. Re-sending same reply.
I20260810 01:58:50.665617 5397 tablet_bootstrap.cc:492] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f: No bootstrap required, opened a new log
I20260810 01:58:50.665851 5397 ts_tablet_manager.cc:1403] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f: Time spent bootstrapping tablet: real 0.047s user 0.014s sys 0.028s
I20260810 01:58:50.666566 5397 raft_consensus.cc:359] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:50.666764 5397 raft_consensus.cc:385] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:50.666846 5397 raft_consensus.cc:740] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc85be7d460a404f997177f57680850f, State: Initialized, Role: FOLLOWER
I20260810 01:58:50.667135 5397 consensus_queue.cc:260] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:50.667675 5397 ts_tablet_manager.cc:1434] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 01:58:50.670338 3572 catalog_manager.cc:5719] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e reported cstate change: term changed from 0 to 1, leader changed from <none> to ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196). New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
I20260810 01:58:50.671533 5312 raft_consensus.cc:697] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 [term 1 LEADER]: Becoming Leader. State: Replica: 17b49c694faf479ea2e5083470fc0302, State: Running, Role: LEADER
I20260810 01:58:50.672627 5312 consensus_queue.cc:237] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:50.676186 3572 catalog_manager.cc:5719] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 reported cstate change: term changed from 0 to 1, leader changed from <none> to 17b49c694faf479ea2e5083470fc0302 (127.21.64.195). New cstate: current_term: 1 leader_uuid: "17b49c694faf479ea2e5083470fc0302" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
I20260810 01:58:50.891292 5180 raft_consensus.cc:493] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:58:50.891551 5180 raft_consensus.cc:515] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:50.892314 5180 leader_election.cc:290] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943), 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 01:58:50.892983 4313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df5b102a0b03406f9449cdd84dfd147e" candidate_uuid: "dc85be7d460a404f997177f57680850f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" is_pre_election: true
I20260810 01:58:50.893231 4313 raft_consensus.cc:2468] T df5b102a0b03406f9449cdd84dfd147e P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc85be7d460a404f997177f57680850f in term 0.
I20260810 01:58:50.893826 3672 leader_election.cc:304] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca4469fc2dbc48488bc7ad7f482f129e, dc85be7d460a404f997177f57680850f; no voters:
I20260810 01:58:50.894162 5180 raft_consensus.cc:2804] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:58:50.894317 5180 raft_consensus.cc:493] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:58:50.894438 5180 raft_consensus.cc:3060] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:50.896525 5180 raft_consensus.cc:515] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:50.897253 5180 leader_election.cc:290] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [CANDIDATE]: Term 1 election: Requested vote from peers ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943), 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 01:58:50.897758 4313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df5b102a0b03406f9449cdd84dfd147e" candidate_uuid: "dc85be7d460a404f997177f57680850f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca4469fc2dbc48488bc7ad7f482f129e"
I20260810 01:58:50.897955 4313 raft_consensus.cc:3060] T df5b102a0b03406f9449cdd84dfd147e P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:50.899274 3945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df5b102a0b03406f9449cdd84dfd147e" candidate_uuid: "dc85be7d460a404f997177f57680850f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f93d1d11364ceeb485585b4ae78871" is_pre_election: true
I20260810 01:58:50.899380 3943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df5b102a0b03406f9449cdd84dfd147e" candidate_uuid: "dc85be7d460a404f997177f57680850f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f93d1d11364ceeb485585b4ae78871"
I20260810 01:58:50.899537 3945 raft_consensus.cc:2468] T df5b102a0b03406f9449cdd84dfd147e P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc85be7d460a404f997177f57680850f in term 0.
I20260810 01:58:50.900419 4313 raft_consensus.cc:2468] T df5b102a0b03406f9449cdd84dfd147e P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc85be7d460a404f997177f57680850f in term 1.
I20260810 01:58:50.900867 3672 leader_election.cc:304] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca4469fc2dbc48488bc7ad7f482f129e, dc85be7d460a404f997177f57680850f; no voters: 82f93d1d11364ceeb485585b4ae78871
I20260810 01:58:50.901135 5180 raft_consensus.cc:2804] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:58:50.901561 5180 raft_consensus.cc:697] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Becoming Leader. State: Replica: dc85be7d460a404f997177f57680850f, State: Running, Role: LEADER
I20260810 01:58:50.901887 5180 consensus_queue.cc:237] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:50.904820 3563 catalog_manager.cc:5719] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f reported cstate change: term changed from 0 to 1, leader changed from <none> to dc85be7d460a404f997177f57680850f (127.21.64.193). New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 01:58:51.089969 5312 consensus_queue.cc:1048] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:58:51.098014 5414 consensus_queue.cc:1048] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:58:51.134531 5378 consensus_queue.cc:1048] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:58:51.139405 5378 consensus_queue.cc:1048] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:58:51.321669 5180 consensus_queue.cc:1048] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:58:51.326460 3943 raft_consensus.cc:3060] T df5b102a0b03406f9449cdd84dfd147e P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:51.329810 5180 consensus_queue.cc:1048] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 01:58:51.344280 5420 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:58:51.344688 5420 flags.cc:432] Enabled unsafe flag: --never_fsync=true
Using table 'rebalance_test_table_2'
INSERT report
rows total: 2000
time total: 263.418 ms
time per row: 0.131709 ms
I20260810 01:58:51.779237 3565 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51850:
name: "rebalance_test_table_3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260810 01:58:51.788736 3735 tablet_service.cc:1511] Processing CreateTablet for tablet da507bc24d964ce1a5835edad5177726 (DEFAULT_TABLE table=rebalance_test_table_3 [id=c515c90b2c71492f812b4df18501ee04]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:51.789278 3735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da507bc24d964ce1a5835edad5177726. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:51.789227 3917 tablet_service.cc:1511] Processing CreateTablet for tablet da507bc24d964ce1a5835edad5177726 (DEFAULT_TABLE table=rebalance_test_table_3 [id=c515c90b2c71492f812b4df18501ee04]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:51.789500 4105 tablet_service.cc:1511] Processing CreateTablet for tablet da507bc24d964ce1a5835edad5177726 (DEFAULT_TABLE table=rebalance_test_table_3 [id=c515c90b2c71492f812b4df18501ee04]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:51.789743 3917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da507bc24d964ce1a5835edad5177726. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:51.790009 4105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da507bc24d964ce1a5835edad5177726. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:51.790108 4102 tablet_service.cc:1511] Processing CreateTablet for tablet cf531b93380e43bfa103837bd6350834 (DEFAULT_TABLE table=rebalance_test_table_3 [id=c515c90b2c71492f812b4df18501ee04]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:51.790535 4102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf531b93380e43bfa103837bd6350834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:51.798471 4286 tablet_service.cc:1511] Processing CreateTablet for tablet cf531b93380e43bfa103837bd6350834 (DEFAULT_TABLE table=rebalance_test_table_3 [id=c515c90b2c71492f812b4df18501ee04]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:51.799049 4286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf531b93380e43bfa103837bd6350834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:51.799871 3737 tablet_service.cc:1511] Processing CreateTablet for tablet cf531b93380e43bfa103837bd6350834 (DEFAULT_TABLE table=rebalance_test_table_3 [id=c515c90b2c71492f812b4df18501ee04]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:51.800398 3737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf531b93380e43bfa103837bd6350834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:51.805950 4103 tablet_service.cc:1511] Processing CreateTablet for tablet eb90d508a0004daa8f10d562cefe5fd6 (DEFAULT_TABLE table=rebalance_test_table_3 [id=c515c90b2c71492f812b4df18501ee04]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:51.806252 5503 tablet_bootstrap.cc:492] T da507bc24d964ce1a5835edad5177726 P dc85be7d460a404f997177f57680850f: Bootstrap starting.
I20260810 01:58:51.806515 4103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb90d508a0004daa8f10d562cefe5fd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:51.809055 5503 tablet_bootstrap.cc:654] T da507bc24d964ce1a5835edad5177726 P dc85be7d460a404f997177f57680850f: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:51.813220 4284 tablet_service.cc:1511] Processing CreateTablet for tablet eb90d508a0004daa8f10d562cefe5fd6 (DEFAULT_TABLE table=rebalance_test_table_3 [id=c515c90b2c71492f812b4df18501ee04]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:51.813892 4284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb90d508a0004daa8f10d562cefe5fd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:51.817552 3917 tablet_service.cc:1511] Processing CreateTablet for tablet eb90d508a0004daa8f10d562cefe5fd6 (DEFAULT_TABLE table=rebalance_test_table_3 [id=c515c90b2c71492f812b4df18501ee04]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:51.819146 3917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb90d508a0004daa8f10d562cefe5fd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:51.820510 5504 tablet_bootstrap.cc:492] T da507bc24d964ce1a5835edad5177726 P 17b49c694faf479ea2e5083470fc0302: Bootstrap starting.
I20260810 01:58:51.823199 5504 tablet_bootstrap.cc:654] T da507bc24d964ce1a5835edad5177726 P 17b49c694faf479ea2e5083470fc0302: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:51.824347 5501 tablet_bootstrap.cc:492] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871: Bootstrap starting.
I20260810 01:58:51.827636 5501 tablet_bootstrap.cc:654] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:51.831594 5507 tablet_bootstrap.cc:492] T eb90d508a0004daa8f10d562cefe5fd6 P ca4469fc2dbc48488bc7ad7f482f129e: Bootstrap starting.
I20260810 01:58:51.831893 5503 tablet_bootstrap.cc:492] T da507bc24d964ce1a5835edad5177726 P dc85be7d460a404f997177f57680850f: No bootstrap required, opened a new log
I20260810 01:58:51.832152 5503 ts_tablet_manager.cc:1403] T da507bc24d964ce1a5835edad5177726 P dc85be7d460a404f997177f57680850f: Time spent bootstrapping tablet: real 0.026s user 0.008s sys 0.012s
I20260810 01:58:51.833088 5503 raft_consensus.cc:359] T da507bc24d964ce1a5835edad5177726 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:51.833401 5503 raft_consensus.cc:385] T da507bc24d964ce1a5835edad5177726 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:51.833559 5503 raft_consensus.cc:740] T da507bc24d964ce1a5835edad5177726 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc85be7d460a404f997177f57680850f, State: Initialized, Role: FOLLOWER
I20260810 01:58:51.833873 5503 consensus_queue.cc:260] T da507bc24d964ce1a5835edad5177726 P dc85be7d460a404f997177f57680850f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:51.834733 5503 ts_tablet_manager.cc:1434] T da507bc24d964ce1a5835edad5177726 P dc85be7d460a404f997177f57680850f: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 01:58:51.835182 5503 tablet_bootstrap.cc:492] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f: Bootstrap starting.
I20260810 01:58:51.837441 5503 tablet_bootstrap.cc:654] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:51.838383 5507 tablet_bootstrap.cc:654] T eb90d508a0004daa8f10d562cefe5fd6 P ca4469fc2dbc48488bc7ad7f482f129e: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:51.840147 5501 tablet_bootstrap.cc:492] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871: No bootstrap required, opened a new log
I20260810 01:58:51.840401 5501 ts_tablet_manager.cc:1403] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.008s
I20260810 01:58:51.841462 5501 raft_consensus.cc:359] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:51.841753 5501 raft_consensus.cc:385] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:51.841856 5504 tablet_bootstrap.cc:492] T da507bc24d964ce1a5835edad5177726 P 17b49c694faf479ea2e5083470fc0302: No bootstrap required, opened a new log
I20260810 01:58:51.841908 5501 raft_consensus.cc:740] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f93d1d11364ceeb485585b4ae78871, State: Initialized, Role: FOLLOWER
I20260810 01:58:51.842084 5503 tablet_bootstrap.cc:492] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f: No bootstrap required, opened a new log
I20260810 01:58:51.842119 5504 ts_tablet_manager.cc:1403] T da507bc24d964ce1a5835edad5177726 P 17b49c694faf479ea2e5083470fc0302: Time spent bootstrapping tablet: real 0.022s user 0.011s sys 0.007s
I20260810 01:58:51.842311 5503 ts_tablet_manager.cc:1403] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.005s
I20260810 01:58:51.842285 5501 consensus_queue.cc:260] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:51.843114 5501 ts_tablet_manager.cc:1434] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260810 01:58:51.843109 5504 raft_consensus.cc:359] T da507bc24d964ce1a5835edad5177726 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:51.843211 5503 raft_consensus.cc:359] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 01:58:51.843361 5504 raft_consensus.cc:385] T da507bc24d964ce1a5835edad5177726 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:51.843530 5503 raft_consensus.cc:385] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:51.843566 5504 raft_consensus.cc:740] T da507bc24d964ce1a5835edad5177726 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17b49c694faf479ea2e5083470fc0302, State: Initialized, Role: FOLLOWER
I20260810 01:58:51.843696 5503 raft_consensus.cc:740] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc85be7d460a404f997177f57680850f, State: Initialized, Role: FOLLOWER
I20260810 01:58:51.843918 5504 consensus_queue.cc:260] T da507bc24d964ce1a5835edad5177726 P 17b49c694faf479ea2e5083470fc0302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:51.844135 5503 consensus_queue.cc:260] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 01:58:51.844704 5504 ts_tablet_manager.cc:1434] T da507bc24d964ce1a5835edad5177726 P 17b49c694faf479ea2e5083470fc0302: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:58:51.844898 5503 ts_tablet_manager.cc:1434] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260810 01:58:51.846413 5504 tablet_bootstrap.cc:492] T eb90d508a0004daa8f10d562cefe5fd6 P 17b49c694faf479ea2e5083470fc0302: Bootstrap starting.
I20260810 01:58:51.847223 5507 tablet_bootstrap.cc:492] T eb90d508a0004daa8f10d562cefe5fd6 P ca4469fc2dbc48488bc7ad7f482f129e: No bootstrap required, opened a new log
I20260810 01:58:51.847433 5507 ts_tablet_manager.cc:1403] T eb90d508a0004daa8f10d562cefe5fd6 P ca4469fc2dbc48488bc7ad7f482f129e: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.003s
I20260810 01:58:51.848346 5501 tablet_bootstrap.cc:492] T eb90d508a0004daa8f10d562cefe5fd6 P 82f93d1d11364ceeb485585b4ae78871: Bootstrap starting.
I20260810 01:58:51.848482 5507 raft_consensus.cc:359] T eb90d508a0004daa8f10d562cefe5fd6 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:51.848735 5507 raft_consensus.cc:385] T eb90d508a0004daa8f10d562cefe5fd6 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:51.848898 5507 raft_consensus.cc:740] T eb90d508a0004daa8f10d562cefe5fd6 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca4469fc2dbc48488bc7ad7f482f129e, State: Initialized, Role: FOLLOWER
I20260810 01:58:51.849495 5507 consensus_queue.cc:260] T eb90d508a0004daa8f10d562cefe5fd6 P ca4469fc2dbc48488bc7ad7f482f129e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:51.850235 5507 ts_tablet_manager.cc:1434] T eb90d508a0004daa8f10d562cefe5fd6 P ca4469fc2dbc48488bc7ad7f482f129e: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260810 01:58:51.850572 5507 tablet_bootstrap.cc:492] T cf531b93380e43bfa103837bd6350834 P ca4469fc2dbc48488bc7ad7f482f129e: Bootstrap starting.
I20260810 01:58:51.850708 5501 tablet_bootstrap.cc:654] T eb90d508a0004daa8f10d562cefe5fd6 P 82f93d1d11364ceeb485585b4ae78871: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:51.851717 5504 tablet_bootstrap.cc:654] T eb90d508a0004daa8f10d562cefe5fd6 P 17b49c694faf479ea2e5083470fc0302: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:51.852674 5507 tablet_bootstrap.cc:654] T cf531b93380e43bfa103837bd6350834 P ca4469fc2dbc48488bc7ad7f482f129e: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:51.859251 5507 tablet_bootstrap.cc:492] T cf531b93380e43bfa103837bd6350834 P ca4469fc2dbc48488bc7ad7f482f129e: No bootstrap required, opened a new log
I20260810 01:58:51.859448 5507 ts_tablet_manager.cc:1403] T cf531b93380e43bfa103837bd6350834 P ca4469fc2dbc48488bc7ad7f482f129e: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.003s
I20260810 01:58:51.859525 5501 tablet_bootstrap.cc:492] T eb90d508a0004daa8f10d562cefe5fd6 P 82f93d1d11364ceeb485585b4ae78871: No bootstrap required, opened a new log
I20260810 01:58:51.859738 5501 ts_tablet_manager.cc:1403] T eb90d508a0004daa8f10d562cefe5fd6 P 82f93d1d11364ceeb485585b4ae78871: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.005s
I20260810 01:58:51.860153 5507 raft_consensus.cc:359] T cf531b93380e43bfa103837bd6350834 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 01:58:51.860360 5507 raft_consensus.cc:385] T cf531b93380e43bfa103837bd6350834 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:51.860450 5507 raft_consensus.cc:740] T cf531b93380e43bfa103837bd6350834 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca4469fc2dbc48488bc7ad7f482f129e, State: Initialized, Role: FOLLOWER
I20260810 01:58:51.860682 5507 consensus_queue.cc:260] T cf531b93380e43bfa103837bd6350834 P ca4469fc2dbc48488bc7ad7f482f129e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 01:58:51.860733 5501 raft_consensus.cc:359] T eb90d508a0004daa8f10d562cefe5fd6 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:51.861104 5501 raft_consensus.cc:385] T eb90d508a0004daa8f10d562cefe5fd6 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:51.861189 5507 ts_tablet_manager.cc:1434] T cf531b93380e43bfa103837bd6350834 P ca4469fc2dbc48488bc7ad7f482f129e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 01:58:51.861311 5501 raft_consensus.cc:740] T eb90d508a0004daa8f10d562cefe5fd6 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f93d1d11364ceeb485585b4ae78871, State: Initialized, Role: FOLLOWER
I20260810 01:58:51.861759 5501 consensus_queue.cc:260] T eb90d508a0004daa8f10d562cefe5fd6 P 82f93d1d11364ceeb485585b4ae78871 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:51.862323 5501 ts_tablet_manager.cc:1434] T eb90d508a0004daa8f10d562cefe5fd6 P 82f93d1d11364ceeb485585b4ae78871: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 01:58:51.863401 5504 tablet_bootstrap.cc:492] T eb90d508a0004daa8f10d562cefe5fd6 P 17b49c694faf479ea2e5083470fc0302: No bootstrap required, opened a new log
I20260810 01:58:51.863591 5504 ts_tablet_manager.cc:1403] T eb90d508a0004daa8f10d562cefe5fd6 P 17b49c694faf479ea2e5083470fc0302: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.010s
I20260810 01:58:51.864547 5504 raft_consensus.cc:359] T eb90d508a0004daa8f10d562cefe5fd6 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:51.864763 5504 raft_consensus.cc:385] T eb90d508a0004daa8f10d562cefe5fd6 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:51.864846 5504 raft_consensus.cc:740] T eb90d508a0004daa8f10d562cefe5fd6 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17b49c694faf479ea2e5083470fc0302, State: Initialized, Role: FOLLOWER
I20260810 01:58:51.865110 5504 consensus_queue.cc:260] T eb90d508a0004daa8f10d562cefe5fd6 P 17b49c694faf479ea2e5083470fc0302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:51.865638 5504 ts_tablet_manager.cc:1434] T eb90d508a0004daa8f10d562cefe5fd6 P 17b49c694faf479ea2e5083470fc0302: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260810 01:58:51.866026 5504 tablet_bootstrap.cc:492] T cf531b93380e43bfa103837bd6350834 P 17b49c694faf479ea2e5083470fc0302: Bootstrap starting.
I20260810 01:58:51.866379 5180 raft_consensus.cc:493] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:58:51.866570 5180 raft_consensus.cc:515] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 01:58:51.867256 5180 leader_election.cc:290] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189), ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943)
I20260810 01:58:51.867830 5504 tablet_bootstrap.cc:654] T cf531b93380e43bfa103837bd6350834 P 17b49c694faf479ea2e5083470fc0302: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:51.867831 4311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf531b93380e43bfa103837bd6350834" candidate_uuid: "dc85be7d460a404f997177f57680850f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" is_pre_election: true
I20260810 01:58:51.868096 4311 raft_consensus.cc:2468] T cf531b93380e43bfa103837bd6350834 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc85be7d460a404f997177f57680850f in term 0.
I20260810 01:58:51.868594 4132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf531b93380e43bfa103837bd6350834" candidate_uuid: "dc85be7d460a404f997177f57680850f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17b49c694faf479ea2e5083470fc0302" is_pre_election: true
I20260810 01:58:51.868865 3672 leader_election.cc:304] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca4469fc2dbc48488bc7ad7f482f129e, dc85be7d460a404f997177f57680850f; no voters:
W20260810 01:58:51.869691 3671 leader_election.cc:343] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189): Illegal state: must be running to vote when last-logged opid is not known
I20260810 01:58:51.870160 5180 raft_consensus.cc:2804] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:58:51.870271 5180 raft_consensus.cc:493] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:58:51.870386 5180 raft_consensus.cc:3060] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:51.870867 5504 tablet_bootstrap.cc:492] T cf531b93380e43bfa103837bd6350834 P 17b49c694faf479ea2e5083470fc0302: No bootstrap required, opened a new log
I20260810 01:58:51.871045 5504 ts_tablet_manager.cc:1403] T cf531b93380e43bfa103837bd6350834 P 17b49c694faf479ea2e5083470fc0302: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.001s
I20260810 01:58:51.872560 5504 raft_consensus.cc:359] T cf531b93380e43bfa103837bd6350834 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 01:58:51.872718 5504 raft_consensus.cc:385] T cf531b93380e43bfa103837bd6350834 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:51.872797 5504 raft_consensus.cc:740] T cf531b93380e43bfa103837bd6350834 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17b49c694faf479ea2e5083470fc0302, State: Initialized, Role: FOLLOWER
I20260810 01:58:51.873023 5504 consensus_queue.cc:260] T cf531b93380e43bfa103837bd6350834 P 17b49c694faf479ea2e5083470fc0302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 01:58:51.873291 5180 raft_consensus.cc:515] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 01:58:51.873656 5504 ts_tablet_manager.cc:1434] T cf531b93380e43bfa103837bd6350834 P 17b49c694faf479ea2e5083470fc0302: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:58:51.874090 5180 leader_election.cc:290] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f [CANDIDATE]: Term 1 election: Requested vote from peers 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189), ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943)
I20260810 01:58:51.874507 4129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf531b93380e43bfa103837bd6350834" candidate_uuid: "dc85be7d460a404f997177f57680850f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17b49c694faf479ea2e5083470fc0302"
I20260810 01:58:51.874611 4311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf531b93380e43bfa103837bd6350834" candidate_uuid: "dc85be7d460a404f997177f57680850f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca4469fc2dbc48488bc7ad7f482f129e"
I20260810 01:58:51.874712 4129 raft_consensus.cc:3060] T cf531b93380e43bfa103837bd6350834 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:51.874800 4311 raft_consensus.cc:3060] T cf531b93380e43bfa103837bd6350834 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:51.877866 4129 raft_consensus.cc:2468] T cf531b93380e43bfa103837bd6350834 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc85be7d460a404f997177f57680850f in term 1.
I20260810 01:58:51.877944 4311 raft_consensus.cc:2468] T cf531b93380e43bfa103837bd6350834 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc85be7d460a404f997177f57680850f in term 1.
I20260810 01:58:51.878348 3672 leader_election.cc:304] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca4469fc2dbc48488bc7ad7f482f129e, dc85be7d460a404f997177f57680850f; no voters:
I20260810 01:58:51.878625 5180 raft_consensus.cc:2804] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:58:51.878803 5180 raft_consensus.cc:697] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Becoming Leader. State: Replica: dc85be7d460a404f997177f57680850f, State: Running, Role: LEADER
I20260810 01:58:51.879108 5180 consensus_queue.cc:237] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 01:58:51.881891 3568 catalog_manager.cc:5719] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f reported cstate change: term changed from 0 to 1, leader changed from <none> to dc85be7d460a404f997177f57680850f (127.21.64.193). New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } }
I20260810 01:58:51.900743 5153 raft_consensus.cc:493] T eb90d508a0004daa8f10d562cefe5fd6 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:58:51.900990 5153 raft_consensus.cc:515] T eb90d508a0004daa8f10d562cefe5fd6 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:51.901906 5153 leader_election.cc:290] T eb90d508a0004daa8f10d562cefe5fd6 P ca4469fc2dbc48488bc7ad7f482f129e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189), 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 01:58:51.902459 4129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb90d508a0004daa8f10d562cefe5fd6" candidate_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17b49c694faf479ea2e5083470fc0302" is_pre_election: true
I20260810 01:58:51.902563 3943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb90d508a0004daa8f10d562cefe5fd6" candidate_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f93d1d11364ceeb485585b4ae78871" is_pre_election: true
I20260810 01:58:51.902725 4129 raft_consensus.cc:2468] T eb90d508a0004daa8f10d562cefe5fd6 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca4469fc2dbc48488bc7ad7f482f129e in term 0.
I20260810 01:58:51.902938 3943 raft_consensus.cc:2468] T eb90d508a0004daa8f10d562cefe5fd6 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca4469fc2dbc48488bc7ad7f482f129e in term 0.
I20260810 01:58:51.903268 4220 leader_election.cc:304] T eb90d508a0004daa8f10d562cefe5fd6 P ca4469fc2dbc48488bc7ad7f482f129e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17b49c694faf479ea2e5083470fc0302, ca4469fc2dbc48488bc7ad7f482f129e; no voters:
I20260810 01:58:51.903566 5153 raft_consensus.cc:2804] T eb90d508a0004daa8f10d562cefe5fd6 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:58:51.903689 5153 raft_consensus.cc:493] T eb90d508a0004daa8f10d562cefe5fd6 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:58:51.903781 5153 raft_consensus.cc:3060] T eb90d508a0004daa8f10d562cefe5fd6 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:51.905979 5153 raft_consensus.cc:515] T eb90d508a0004daa8f10d562cefe5fd6 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:51.906639 5153 leader_election.cc:290] T eb90d508a0004daa8f10d562cefe5fd6 P ca4469fc2dbc48488bc7ad7f482f129e [CANDIDATE]: Term 1 election: Requested vote from peers 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189), 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 01:58:51.907095 4129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb90d508a0004daa8f10d562cefe5fd6" candidate_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17b49c694faf479ea2e5083470fc0302"
I20260810 01:58:51.907231 3943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb90d508a0004daa8f10d562cefe5fd6" candidate_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f93d1d11364ceeb485585b4ae78871"
I20260810 01:58:51.907323 4129 raft_consensus.cc:3060] T eb90d508a0004daa8f10d562cefe5fd6 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:51.907451 3943 raft_consensus.cc:3060] T eb90d508a0004daa8f10d562cefe5fd6 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:51.909578 4129 raft_consensus.cc:2468] T eb90d508a0004daa8f10d562cefe5fd6 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca4469fc2dbc48488bc7ad7f482f129e in term 1.
I20260810 01:58:51.909739 3943 raft_consensus.cc:2468] T eb90d508a0004daa8f10d562cefe5fd6 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca4469fc2dbc48488bc7ad7f482f129e in term 1.
I20260810 01:58:51.910105 4220 leader_election.cc:304] T eb90d508a0004daa8f10d562cefe5fd6 P ca4469fc2dbc48488bc7ad7f482f129e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17b49c694faf479ea2e5083470fc0302, ca4469fc2dbc48488bc7ad7f482f129e; no voters:
I20260810 01:58:51.910399 5153 raft_consensus.cc:2804] T eb90d508a0004daa8f10d562cefe5fd6 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:58:51.910588 5153 raft_consensus.cc:697] T eb90d508a0004daa8f10d562cefe5fd6 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Becoming Leader. State: Replica: ca4469fc2dbc48488bc7ad7f482f129e, State: Running, Role: LEADER
I20260810 01:58:51.910952 5153 consensus_queue.cc:237] T eb90d508a0004daa8f10d562cefe5fd6 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:51.914000 3568 catalog_manager.cc:5719] T eb90d508a0004daa8f10d562cefe5fd6 P ca4469fc2dbc48488bc7ad7f482f129e reported cstate change: term changed from 0 to 1, leader changed from <none> to ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196). New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 01:58:52.018599 5235 raft_consensus.cc:493] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:58:52.018826 5235 raft_consensus.cc:515] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:52.019697 5235 leader_election.cc:290] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc85be7d460a404f997177f57680850f (127.21.64.193:36797), 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189)
I20260810 01:58:52.020355 3761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da507bc24d964ce1a5835edad5177726" candidate_uuid: "82f93d1d11364ceeb485585b4ae78871" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc85be7d460a404f997177f57680850f" is_pre_election: true
I20260810 01:58:52.020608 3761 raft_consensus.cc:2468] T da507bc24d964ce1a5835edad5177726 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82f93d1d11364ceeb485585b4ae78871 in term 0.
I20260810 01:58:52.021263 3855 leader_election.cc:304] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82f93d1d11364ceeb485585b4ae78871, dc85be7d460a404f997177f57680850f; no voters:
I20260810 01:58:52.021234 4129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da507bc24d964ce1a5835edad5177726" candidate_uuid: "82f93d1d11364ceeb485585b4ae78871" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17b49c694faf479ea2e5083470fc0302" is_pre_election: true
I20260810 01:58:52.021561 5235 raft_consensus.cc:2804] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:58:52.021696 5235 raft_consensus.cc:493] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:58:52.021823 5235 raft_consensus.cc:3060] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:52.024152 5235 raft_consensus.cc:515] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:52.024922 5235 leader_election.cc:290] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [CANDIDATE]: Term 1 election: Requested vote from peers dc85be7d460a404f997177f57680850f (127.21.64.193:36797), 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189)
I20260810 01:58:52.025288 3761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da507bc24d964ce1a5835edad5177726" candidate_uuid: "82f93d1d11364ceeb485585b4ae78871" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc85be7d460a404f997177f57680850f"
I20260810 01:58:52.025573 3761 raft_consensus.cc:3060] T da507bc24d964ce1a5835edad5177726 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:52.025668 4132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da507bc24d964ce1a5835edad5177726" candidate_uuid: "82f93d1d11364ceeb485585b4ae78871" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17b49c694faf479ea2e5083470fc0302"
I20260810 01:58:52.027994 3761 raft_consensus.cc:2468] T da507bc24d964ce1a5835edad5177726 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82f93d1d11364ceeb485585b4ae78871 in term 1.
I20260810 01:58:52.028292 4129 raft_consensus.cc:2468] T da507bc24d964ce1a5835edad5177726 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82f93d1d11364ceeb485585b4ae78871 in term 0.
I20260810 01:58:52.028478 3855 leader_election.cc:304] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 82f93d1d11364ceeb485585b4ae78871, dc85be7d460a404f997177f57680850f; no voters: 17b49c694faf479ea2e5083470fc0302
I20260810 01:58:52.028818 5235 raft_consensus.cc:2804] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:58:52.028998 5235 raft_consensus.cc:697] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Becoming Leader. State: Replica: 82f93d1d11364ceeb485585b4ae78871, State: Running, Role: LEADER
I20260810 01:58:52.029595 5235 consensus_queue.cc:237] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:52.032845 3568 catalog_manager.cc:5719] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 reported cstate change: term changed from 0 to 1, leader changed from <none> to 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194). New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } }
I20260810 01:58:52.396061 5180 consensus_queue.cc:1048] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:58:52.403404 5526 consensus_queue.cc:1048] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:58:52.408654 5153 consensus_queue.cc:1048] T eb90d508a0004daa8f10d562cefe5fd6 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:58:52.415006 5153 consensus_queue.cc:1048] T eb90d508a0004daa8f10d562cefe5fd6 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 01:58:52.451838 5524 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:58:52.452230 5524 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260810 01:58:52.457047 5235 consensus_queue.cc:1048] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:58:52.462015 4129 raft_consensus.cc:3060] T da507bc24d964ce1a5835edad5177726 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:52.465193 5235 consensus_queue.cc:1048] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
Using table 'rebalance_test_table_3'
INSERT report
rows total: 2000
time total: 281.706 ms
time per row: 0.140853 ms
I20260810 01:58:52.910267 3574 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51850:
name: "rebalance_test_table_4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260810 01:58:52.920493 3737 tablet_service.cc:1511] Processing CreateTablet for tablet fe8e1f0908234e46881258cfe79835f8 (DEFAULT_TABLE table=rebalance_test_table_4 [id=3e1f7b9b31614ed383207098de38230c]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:52.920840 3917 tablet_service.cc:1511] Processing CreateTablet for tablet fe8e1f0908234e46881258cfe79835f8 (DEFAULT_TABLE table=rebalance_test_table_4 [id=3e1f7b9b31614ed383207098de38230c]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:52.921053 3737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe8e1f0908234e46881258cfe79835f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:52.921123 4105 tablet_service.cc:1511] Processing CreateTablet for tablet fe8e1f0908234e46881258cfe79835f8 (DEFAULT_TABLE table=rebalance_test_table_4 [id=3e1f7b9b31614ed383207098de38230c]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:52.921329 3917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe8e1f0908234e46881258cfe79835f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:52.921698 4105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe8e1f0908234e46881258cfe79835f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:52.923410 3734 tablet_service.cc:1511] Processing CreateTablet for tablet 606ad043ee3344c39c9eef7cd1920d7e (DEFAULT_TABLE table=rebalance_test_table_4 [id=3e1f7b9b31614ed383207098de38230c]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:52.923873 3734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 606ad043ee3344c39c9eef7cd1920d7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:52.926111 4102 tablet_service.cc:1511] Processing CreateTablet for tablet 606ad043ee3344c39c9eef7cd1920d7e (DEFAULT_TABLE table=rebalance_test_table_4 [id=3e1f7b9b31614ed383207098de38230c]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:52.926532 4102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 606ad043ee3344c39c9eef7cd1920d7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:52.927050 3735 tablet_service.cc:1511] Processing CreateTablet for tablet b6c5892f4de449fb8cb7f4cff7eb2e20 (DEFAULT_TABLE table=rebalance_test_table_4 [id=3e1f7b9b31614ed383207098de38230c]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:52.927446 3735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6c5892f4de449fb8cb7f4cff7eb2e20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:52.931149 4284 tablet_service.cc:1511] Processing CreateTablet for tablet b6c5892f4de449fb8cb7f4cff7eb2e20 (DEFAULT_TABLE table=rebalance_test_table_4 [id=3e1f7b9b31614ed383207098de38230c]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:52.931385 3916 tablet_service.cc:1511] Processing CreateTablet for tablet b6c5892f4de449fb8cb7f4cff7eb2e20 (DEFAULT_TABLE table=rebalance_test_table_4 [id=3e1f7b9b31614ed383207098de38230c]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:52.931700 4284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6c5892f4de449fb8cb7f4cff7eb2e20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:52.931757 3916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6c5892f4de449fb8cb7f4cff7eb2e20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:52.937780 4286 tablet_service.cc:1511] Processing CreateTablet for tablet 606ad043ee3344c39c9eef7cd1920d7e (DEFAULT_TABLE table=rebalance_test_table_4 [id=3e1f7b9b31614ed383207098de38230c]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:52.938182 4286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 606ad043ee3344c39c9eef7cd1920d7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:52.938560 5614 tablet_bootstrap.cc:492] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871: Bootstrap starting.
I20260810 01:58:52.940472 5614 tablet_bootstrap.cc:654] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:52.948495 5615 tablet_bootstrap.cc:492] T 606ad043ee3344c39c9eef7cd1920d7e P 17b49c694faf479ea2e5083470fc0302: Bootstrap starting.
I20260810 01:58:52.949030 5614 tablet_bootstrap.cc:492] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871: No bootstrap required, opened a new log
I20260810 01:58:52.949158 5617 tablet_bootstrap.cc:492] T b6c5892f4de449fb8cb7f4cff7eb2e20 P ca4469fc2dbc48488bc7ad7f482f129e: Bootstrap starting.
I20260810 01:58:52.949225 5614 ts_tablet_manager.cc:1403] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.004s
I20260810 01:58:52.950325 5614 raft_consensus.cc:359] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:52.950618 5614 raft_consensus.cc:385] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:52.950740 5614 raft_consensus.cc:740] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f93d1d11364ceeb485585b4ae78871, State: Initialized, Role: FOLLOWER
I20260810 01:58:52.951102 5614 consensus_queue.cc:260] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:52.952035 5614 ts_tablet_manager.cc:1434] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260810 01:58:52.952385 5614 tablet_bootstrap.cc:492] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871: Bootstrap starting.
I20260810 01:58:52.951457 5617 tablet_bootstrap.cc:654] T b6c5892f4de449fb8cb7f4cff7eb2e20 P ca4469fc2dbc48488bc7ad7f482f129e: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:52.952927 5615 tablet_bootstrap.cc:654] T 606ad043ee3344c39c9eef7cd1920d7e P 17b49c694faf479ea2e5083470fc0302: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:52.954998 5613 tablet_bootstrap.cc:492] T fe8e1f0908234e46881258cfe79835f8 P dc85be7d460a404f997177f57680850f: Bootstrap starting.
I20260810 01:58:52.957180 5614 tablet_bootstrap.cc:654] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:52.957921 5613 tablet_bootstrap.cc:654] T fe8e1f0908234e46881258cfe79835f8 P dc85be7d460a404f997177f57680850f: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:52.964028 5613 tablet_bootstrap.cc:492] T fe8e1f0908234e46881258cfe79835f8 P dc85be7d460a404f997177f57680850f: No bootstrap required, opened a new log
I20260810 01:58:52.964044 5615 tablet_bootstrap.cc:492] T 606ad043ee3344c39c9eef7cd1920d7e P 17b49c694faf479ea2e5083470fc0302: No bootstrap required, opened a new log
I20260810 01:58:52.964207 5615 ts_tablet_manager.cc:1403] T 606ad043ee3344c39c9eef7cd1920d7e P 17b49c694faf479ea2e5083470fc0302: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.008s
I20260810 01:58:52.964330 5613 ts_tablet_manager.cc:1403] T fe8e1f0908234e46881258cfe79835f8 P dc85be7d460a404f997177f57680850f: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.003s
I20260810 01:58:52.965157 5615 raft_consensus.cc:359] T 606ad043ee3344c39c9eef7cd1920d7e P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 01:58:52.965449 5615 raft_consensus.cc:385] T 606ad043ee3344c39c9eef7cd1920d7e P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:52.965230 5613 raft_consensus.cc:359] T fe8e1f0908234e46881258cfe79835f8 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:52.965564 5615 raft_consensus.cc:740] T 606ad043ee3344c39c9eef7cd1920d7e P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17b49c694faf479ea2e5083470fc0302, State: Initialized, Role: FOLLOWER
I20260810 01:58:52.965694 5613 raft_consensus.cc:385] T fe8e1f0908234e46881258cfe79835f8 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:52.965857 5613 raft_consensus.cc:740] T fe8e1f0908234e46881258cfe79835f8 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc85be7d460a404f997177f57680850f, State: Initialized, Role: FOLLOWER
I20260810 01:58:52.965893 5615 consensus_queue.cc:260] T 606ad043ee3344c39c9eef7cd1920d7e P 17b49c694faf479ea2e5083470fc0302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 01:58:52.966281 5613 consensus_queue.cc:260] T fe8e1f0908234e46881258cfe79835f8 P dc85be7d460a404f997177f57680850f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:52.967978 5613 ts_tablet_manager.cc:1434] T fe8e1f0908234e46881258cfe79835f8 P dc85be7d460a404f997177f57680850f: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 01:58:52.968364 5613 tablet_bootstrap.cc:492] T 606ad043ee3344c39c9eef7cd1920d7e P dc85be7d460a404f997177f57680850f: Bootstrap starting.
I20260810 01:58:52.968799 5615 ts_tablet_manager.cc:1434] T 606ad043ee3344c39c9eef7cd1920d7e P 17b49c694faf479ea2e5083470fc0302: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
I20260810 01:58:52.969148 5615 tablet_bootstrap.cc:492] T fe8e1f0908234e46881258cfe79835f8 P 17b49c694faf479ea2e5083470fc0302: Bootstrap starting.
I20260810 01:58:52.970927 5613 tablet_bootstrap.cc:654] T 606ad043ee3344c39c9eef7cd1920d7e P dc85be7d460a404f997177f57680850f: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:52.971681 5615 tablet_bootstrap.cc:654] T fe8e1f0908234e46881258cfe79835f8 P 17b49c694faf479ea2e5083470fc0302: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:52.975337 5614 tablet_bootstrap.cc:492] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871: No bootstrap required, opened a new log
I20260810 01:58:52.975543 5614 ts_tablet_manager.cc:1403] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871: Time spent bootstrapping tablet: real 0.023s user 0.004s sys 0.014s
I20260810 01:58:52.976586 5617 tablet_bootstrap.cc:492] T b6c5892f4de449fb8cb7f4cff7eb2e20 P ca4469fc2dbc48488bc7ad7f482f129e: No bootstrap required, opened a new log
I20260810 01:58:52.976684 5613 tablet_bootstrap.cc:492] T 606ad043ee3344c39c9eef7cd1920d7e P dc85be7d460a404f997177f57680850f: No bootstrap required, opened a new log
I20260810 01:58:52.976576 5614 raft_consensus.cc:359] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:52.976758 5617 ts_tablet_manager.cc:1403] T b6c5892f4de449fb8cb7f4cff7eb2e20 P ca4469fc2dbc48488bc7ad7f482f129e: Time spent bootstrapping tablet: real 0.028s user 0.003s sys 0.010s
I20260810 01:58:52.976843 5613 ts_tablet_manager.cc:1403] T 606ad043ee3344c39c9eef7cd1920d7e P dc85be7d460a404f997177f57680850f: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.003s
I20260810 01:58:52.976823 5614 raft_consensus.cc:385] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:52.976946 5614 raft_consensus.cc:740] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f93d1d11364ceeb485585b4ae78871, State: Initialized, Role: FOLLOWER
I20260810 01:58:52.977233 5614 consensus_queue.cc:260] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:52.977698 5617 raft_consensus.cc:359] T b6c5892f4de449fb8cb7f4cff7eb2e20 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:52.977883 5614 ts_tablet_manager.cc:1434] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:58:52.977910 5617 raft_consensus.cc:385] T b6c5892f4de449fb8cb7f4cff7eb2e20 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:52.978022 5617 raft_consensus.cc:740] T b6c5892f4de449fb8cb7f4cff7eb2e20 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca4469fc2dbc48488bc7ad7f482f129e, State: Initialized, Role: FOLLOWER
I20260810 01:58:52.978173 5615 tablet_bootstrap.cc:492] T fe8e1f0908234e46881258cfe79835f8 P 17b49c694faf479ea2e5083470fc0302: No bootstrap required, opened a new log
I20260810 01:58:52.978253 5617 consensus_queue.cc:260] T b6c5892f4de449fb8cb7f4cff7eb2e20 P ca4469fc2dbc48488bc7ad7f482f129e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:52.978415 5615 ts_tablet_manager.cc:1403] T fe8e1f0908234e46881258cfe79835f8 P 17b49c694faf479ea2e5083470fc0302: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.001s
I20260810 01:58:52.978832 5617 ts_tablet_manager.cc:1434] T b6c5892f4de449fb8cb7f4cff7eb2e20 P ca4469fc2dbc48488bc7ad7f482f129e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 01:58:52.979148 5617 tablet_bootstrap.cc:492] T 606ad043ee3344c39c9eef7cd1920d7e P ca4469fc2dbc48488bc7ad7f482f129e: Bootstrap starting.
I20260810 01:58:52.979493 5615 raft_consensus.cc:359] T fe8e1f0908234e46881258cfe79835f8 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:52.979774 5615 raft_consensus.cc:385] T fe8e1f0908234e46881258cfe79835f8 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:52.979884 5615 raft_consensus.cc:740] T fe8e1f0908234e46881258cfe79835f8 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17b49c694faf479ea2e5083470fc0302, State: Initialized, Role: FOLLOWER
I20260810 01:58:52.980177 5615 consensus_queue.cc:260] T fe8e1f0908234e46881258cfe79835f8 P 17b49c694faf479ea2e5083470fc0302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:52.980865 5615 ts_tablet_manager.cc:1434] T fe8e1f0908234e46881258cfe79835f8 P 17b49c694faf479ea2e5083470fc0302: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 01:58:52.981103 5617 tablet_bootstrap.cc:654] T 606ad043ee3344c39c9eef7cd1920d7e P ca4469fc2dbc48488bc7ad7f482f129e: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:52.982518 5613 raft_consensus.cc:359] T 606ad043ee3344c39c9eef7cd1920d7e P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 01:58:52.982782 5613 raft_consensus.cc:385] T 606ad043ee3344c39c9eef7cd1920d7e P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:52.982862 5613 raft_consensus.cc:740] T 606ad043ee3344c39c9eef7cd1920d7e P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc85be7d460a404f997177f57680850f, State: Initialized, Role: FOLLOWER
I20260810 01:58:52.983230 5613 consensus_queue.cc:260] T 606ad043ee3344c39c9eef7cd1920d7e P dc85be7d460a404f997177f57680850f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 01:58:52.983852 5613 ts_tablet_manager.cc:1434] T 606ad043ee3344c39c9eef7cd1920d7e P dc85be7d460a404f997177f57680850f: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260810 01:58:52.986312 5613 tablet_bootstrap.cc:492] T b6c5892f4de449fb8cb7f4cff7eb2e20 P dc85be7d460a404f997177f57680850f: Bootstrap starting.
I20260810 01:58:52.988349 5617 tablet_bootstrap.cc:492] T 606ad043ee3344c39c9eef7cd1920d7e P ca4469fc2dbc48488bc7ad7f482f129e: No bootstrap required, opened a new log
I20260810 01:58:52.988526 5617 ts_tablet_manager.cc:1403] T 606ad043ee3344c39c9eef7cd1920d7e P ca4469fc2dbc48488bc7ad7f482f129e: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.004s
I20260810 01:58:52.988801 5613 tablet_bootstrap.cc:654] T b6c5892f4de449fb8cb7f4cff7eb2e20 P dc85be7d460a404f997177f57680850f: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:52.989303 5617 raft_consensus.cc:359] T 606ad043ee3344c39c9eef7cd1920d7e P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 01:58:52.989549 5617 raft_consensus.cc:385] T 606ad043ee3344c39c9eef7cd1920d7e P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:52.989630 5617 raft_consensus.cc:740] T 606ad043ee3344c39c9eef7cd1920d7e P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca4469fc2dbc48488bc7ad7f482f129e, State: Initialized, Role: FOLLOWER
I20260810 01:58:52.989892 5617 consensus_queue.cc:260] T 606ad043ee3344c39c9eef7cd1920d7e P ca4469fc2dbc48488bc7ad7f482f129e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 01:58:52.990520 5617 ts_tablet_manager.cc:1434] T 606ad043ee3344c39c9eef7cd1920d7e P ca4469fc2dbc48488bc7ad7f482f129e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:58:52.991389 5613 tablet_bootstrap.cc:492] T b6c5892f4de449fb8cb7f4cff7eb2e20 P dc85be7d460a404f997177f57680850f: No bootstrap required, opened a new log
I20260810 01:58:52.991531 5613 ts_tablet_manager.cc:1403] T b6c5892f4de449fb8cb7f4cff7eb2e20 P dc85be7d460a404f997177f57680850f: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260810 01:58:52.992184 5613 raft_consensus.cc:359] T b6c5892f4de449fb8cb7f4cff7eb2e20 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:52.992388 5613 raft_consensus.cc:385] T b6c5892f4de449fb8cb7f4cff7eb2e20 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:52.992492 5613 raft_consensus.cc:740] T b6c5892f4de449fb8cb7f4cff7eb2e20 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc85be7d460a404f997177f57680850f, State: Initialized, Role: FOLLOWER
I20260810 01:58:52.992763 5613 consensus_queue.cc:260] T b6c5892f4de449fb8cb7f4cff7eb2e20 P dc85be7d460a404f997177f57680850f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:52.993311 5613 ts_tablet_manager.cc:1434] T b6c5892f4de449fb8cb7f4cff7eb2e20 P dc85be7d460a404f997177f57680850f: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 01:58:53.112735 5536 raft_consensus.cc:493] T 606ad043ee3344c39c9eef7cd1920d7e P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:58:53.112944 5536 raft_consensus.cc:515] T 606ad043ee3344c39c9eef7cd1920d7e P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 01:58:53.113785 5536 leader_election.cc:290] T 606ad043ee3344c39c9eef7cd1920d7e P ca4469fc2dbc48488bc7ad7f482f129e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189), dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
I20260810 01:58:53.114302 4129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606ad043ee3344c39c9eef7cd1920d7e" candidate_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17b49c694faf479ea2e5083470fc0302" is_pre_election: true
I20260810 01:58:53.114372 3761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606ad043ee3344c39c9eef7cd1920d7e" candidate_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc85be7d460a404f997177f57680850f" is_pre_election: true
I20260810 01:58:53.114569 4129 raft_consensus.cc:2468] T 606ad043ee3344c39c9eef7cd1920d7e P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca4469fc2dbc48488bc7ad7f482f129e in term 0.
I20260810 01:58:53.114615 3761 raft_consensus.cc:2468] T 606ad043ee3344c39c9eef7cd1920d7e P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca4469fc2dbc48488bc7ad7f482f129e in term 0.
I20260810 01:58:53.115103 4220 leader_election.cc:304] T 606ad043ee3344c39c9eef7cd1920d7e P ca4469fc2dbc48488bc7ad7f482f129e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17b49c694faf479ea2e5083470fc0302, ca4469fc2dbc48488bc7ad7f482f129e; no voters:
I20260810 01:58:53.115401 5536 raft_consensus.cc:2804] T 606ad043ee3344c39c9eef7cd1920d7e P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:58:53.115568 5536 raft_consensus.cc:493] T 606ad043ee3344c39c9eef7cd1920d7e P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:58:53.115669 5536 raft_consensus.cc:3060] T 606ad043ee3344c39c9eef7cd1920d7e P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:53.117857 5536 raft_consensus.cc:515] T 606ad043ee3344c39c9eef7cd1920d7e P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 01:58:53.118512 5536 leader_election.cc:290] T 606ad043ee3344c39c9eef7cd1920d7e P ca4469fc2dbc48488bc7ad7f482f129e [CANDIDATE]: Term 1 election: Requested vote from peers 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189), dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
I20260810 01:58:53.118999 4129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606ad043ee3344c39c9eef7cd1920d7e" candidate_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17b49c694faf479ea2e5083470fc0302"
I20260810 01:58:53.119226 4129 raft_consensus.cc:3060] T 606ad043ee3344c39c9eef7cd1920d7e P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:53.119194 3761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606ad043ee3344c39c9eef7cd1920d7e" candidate_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc85be7d460a404f997177f57680850f"
I20260810 01:58:53.119390 3761 raft_consensus.cc:3060] T 606ad043ee3344c39c9eef7cd1920d7e P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:53.122365 4129 raft_consensus.cc:2468] T 606ad043ee3344c39c9eef7cd1920d7e P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca4469fc2dbc48488bc7ad7f482f129e in term 1.
I20260810 01:58:53.122475 3761 raft_consensus.cc:2468] T 606ad043ee3344c39c9eef7cd1920d7e P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca4469fc2dbc48488bc7ad7f482f129e in term 1.
I20260810 01:58:53.122942 4219 leader_election.cc:304] T 606ad043ee3344c39c9eef7cd1920d7e P ca4469fc2dbc48488bc7ad7f482f129e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca4469fc2dbc48488bc7ad7f482f129e, dc85be7d460a404f997177f57680850f; no voters:
I20260810 01:58:53.123310 5536 raft_consensus.cc:2804] T 606ad043ee3344c39c9eef7cd1920d7e P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:58:53.123524 5536 raft_consensus.cc:697] T 606ad043ee3344c39c9eef7cd1920d7e P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Becoming Leader. State: Replica: ca4469fc2dbc48488bc7ad7f482f129e, State: Running, Role: LEADER
I20260810 01:58:53.123821 5536 consensus_queue.cc:237] T 606ad043ee3344c39c9eef7cd1920d7e P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 01:58:53.127002 3565 catalog_manager.cc:5719] T 606ad043ee3344c39c9eef7cd1920d7e P ca4469fc2dbc48488bc7ad7f482f129e reported cstate change: term changed from 0 to 1, leader changed from <none> to ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196). New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } }
I20260810 01:58:53.148944 5235 raft_consensus.cc:493] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:58:53.149231 5235 raft_consensus.cc:515] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:53.150172 5235 leader_election.cc:290] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc85be7d460a404f997177f57680850f (127.21.64.193:36797), ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943)
I20260810 01:58:53.150846 3761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c5892f4de449fb8cb7f4cff7eb2e20" candidate_uuid: "82f93d1d11364ceeb485585b4ae78871" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc85be7d460a404f997177f57680850f" is_pre_election: true
I20260810 01:58:53.151182 3761 raft_consensus.cc:2468] T b6c5892f4de449fb8cb7f4cff7eb2e20 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82f93d1d11364ceeb485585b4ae78871 in term 0.
I20260810 01:58:53.151362 5522 raft_consensus.cc:493] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:58:53.151551 5522 raft_consensus.cc:515] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:53.151808 3855 leader_election.cc:304] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82f93d1d11364ceeb485585b4ae78871, dc85be7d460a404f997177f57680850f; no voters:
I20260810 01:58:53.152184 5235 raft_consensus.cc:2804] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:58:53.152386 5522 leader_election.cc:290] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc85be7d460a404f997177f57680850f (127.21.64.193:36797), 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189)
I20260810 01:58:53.152940 5235 raft_consensus.cc:493] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:58:53.153014 4129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe8e1f0908234e46881258cfe79835f8" candidate_uuid: "82f93d1d11364ceeb485585b4ae78871" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17b49c694faf479ea2e5083470fc0302" is_pre_election: true
I20260810 01:58:53.153066 3759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe8e1f0908234e46881258cfe79835f8" candidate_uuid: "82f93d1d11364ceeb485585b4ae78871" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc85be7d460a404f997177f57680850f" is_pre_election: true
I20260810 01:58:53.153240 5235 raft_consensus.cc:3060] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:53.153275 4129 raft_consensus.cc:2468] T fe8e1f0908234e46881258cfe79835f8 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82f93d1d11364ceeb485585b4ae78871 in term 0.
I20260810 01:58:53.153270 3759 raft_consensus.cc:2468] T fe8e1f0908234e46881258cfe79835f8 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82f93d1d11364ceeb485585b4ae78871 in term 0.
I20260810 01:58:53.153705 3855 leader_election.cc:304] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82f93d1d11364ceeb485585b4ae78871, dc85be7d460a404f997177f57680850f; no voters:
I20260810 01:58:53.154295 5522 raft_consensus.cc:2804] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:58:53.154467 5522 raft_consensus.cc:493] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:58:53.154567 5522 raft_consensus.cc:3060] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:53.156638 5235 raft_consensus.cc:515] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:53.156847 5522 raft_consensus.cc:515] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:53.157444 5235 leader_election.cc:290] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [CANDIDATE]: Term 1 election: Requested vote from peers dc85be7d460a404f997177f57680850f (127.21.64.193:36797), ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943)
I20260810 01:58:53.158352 4129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe8e1f0908234e46881258cfe79835f8" candidate_uuid: "82f93d1d11364ceeb485585b4ae78871" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17b49c694faf479ea2e5083470fc0302"
I20260810 01:58:53.158370 3759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe8e1f0908234e46881258cfe79835f8" candidate_uuid: "82f93d1d11364ceeb485585b4ae78871" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc85be7d460a404f997177f57680850f"
I20260810 01:58:53.158569 4129 raft_consensus.cc:3060] T fe8e1f0908234e46881258cfe79835f8 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:53.158591 3759 raft_consensus.cc:3060] T fe8e1f0908234e46881258cfe79835f8 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:53.159495 3761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c5892f4de449fb8cb7f4cff7eb2e20" candidate_uuid: "82f93d1d11364ceeb485585b4ae78871" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc85be7d460a404f997177f57680850f"
I20260810 01:58:53.159729 3761 raft_consensus.cc:3060] T b6c5892f4de449fb8cb7f4cff7eb2e20 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:53.161692 5522 leader_election.cc:290] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [CANDIDATE]: Term 1 election: Requested vote from peers dc85be7d460a404f997177f57680850f (127.21.64.193:36797), 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189)
I20260810 01:58:53.161629 4311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c5892f4de449fb8cb7f4cff7eb2e20" candidate_uuid: "82f93d1d11364ceeb485585b4ae78871" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" is_pre_election: true
I20260810 01:58:53.161809 4313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c5892f4de449fb8cb7f4cff7eb2e20" candidate_uuid: "82f93d1d11364ceeb485585b4ae78871" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca4469fc2dbc48488bc7ad7f482f129e"
I20260810 01:58:53.161876 3759 raft_consensus.cc:2468] T fe8e1f0908234e46881258cfe79835f8 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82f93d1d11364ceeb485585b4ae78871 in term 1.
I20260810 01:58:53.161903 4311 raft_consensus.cc:2468] T b6c5892f4de449fb8cb7f4cff7eb2e20 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82f93d1d11364ceeb485585b4ae78871 in term 0.
I20260810 01:58:53.162094 4313 raft_consensus.cc:3060] T b6c5892f4de449fb8cb7f4cff7eb2e20 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:53.162664 3855 leader_election.cc:304] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82f93d1d11364ceeb485585b4ae78871, dc85be7d460a404f997177f57680850f; no voters:
I20260810 01:58:53.162966 5522 raft_consensus.cc:2804] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:58:53.163051 4129 raft_consensus.cc:2468] T fe8e1f0908234e46881258cfe79835f8 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82f93d1d11364ceeb485585b4ae78871 in term 1.
I20260810 01:58:53.163210 5522 raft_consensus.cc:697] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Becoming Leader. State: Replica: 82f93d1d11364ceeb485585b4ae78871, State: Running, Role: LEADER
I20260810 01:58:53.163479 3761 raft_consensus.cc:2468] T b6c5892f4de449fb8cb7f4cff7eb2e20 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82f93d1d11364ceeb485585b4ae78871 in term 1.
I20260810 01:58:53.163662 5522 consensus_queue.cc:237] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:53.165236 4313 raft_consensus.cc:2468] T b6c5892f4de449fb8cb7f4cff7eb2e20 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82f93d1d11364ceeb485585b4ae78871 in term 1.
I20260810 01:58:53.163959 3855 leader_election.cc:304] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82f93d1d11364ceeb485585b4ae78871, dc85be7d460a404f997177f57680850f; no voters:
I20260810 01:58:53.165813 5633 raft_consensus.cc:2804] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:58:53.165993 5633 raft_consensus.cc:697] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Becoming Leader. State: Replica: 82f93d1d11364ceeb485585b4ae78871, State: Running, Role: LEADER
I20260810 01:58:53.166389 5633 consensus_queue.cc:237] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:53.168318 3565 catalog_manager.cc:5719] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 reported cstate change: term changed from 0 to 1, leader changed from <none> to 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194). New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } }
I20260810 01:58:53.173182 3574 catalog_manager.cc:5719] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 reported cstate change: term changed from 0 to 1, leader changed from <none> to 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194). New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 01:58:53.511996 5536 consensus_queue.cc:1048] T 606ad043ee3344c39c9eef7cd1920d7e P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:58:53.521817 5153 consensus_queue.cc:1048] T 606ad043ee3344c39c9eef7cd1920d7e P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 01:58:53.643783 5637 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:58:53.644157 5637 flags.cc:432] Enabled unsafe flag: --never_fsync=true
Using table 'rebalance_test_table_4'
I20260810 01:58:53.722486 5633 consensus_queue.cc:1048] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:58:53.726984 5633 consensus_queue.cc:1048] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:58:53.773473 5633 consensus_queue.cc:1048] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:58:53.779115 5633 consensus_queue.cc:1048] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 257.744 ms
time per row: 0.128872 ms
I20260810 01:58:54.081318 3565 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51850:
name: "rebalance_test_table_5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260810 01:58:54.092180 4284 tablet_service.cc:1511] Processing CreateTablet for tablet 1d377b919f4748c88efb249dfc964f17 (DEFAULT_TABLE table=rebalance_test_table_5 [id=e211628d46b64734960dfd60d86708ce]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:54.092752 4284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d377b919f4748c88efb249dfc964f17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:54.092868 4102 tablet_service.cc:1511] Processing CreateTablet for tablet 1d377b919f4748c88efb249dfc964f17 (DEFAULT_TABLE table=rebalance_test_table_5 [id=e211628d46b64734960dfd60d86708ce]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:54.093379 4102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d377b919f4748c88efb249dfc964f17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:54.093500 3916 tablet_service.cc:1511] Processing CreateTablet for tablet 18a93b1a1ce1440b99bdd7a3bcf49064 (DEFAULT_TABLE table=rebalance_test_table_5 [id=e211628d46b64734960dfd60d86708ce]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:54.094038 3916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18a93b1a1ce1440b99bdd7a3bcf49064. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:54.095722 4105 tablet_service.cc:1511] Processing CreateTablet for tablet 18a93b1a1ce1440b99bdd7a3bcf49064 (DEFAULT_TABLE table=rebalance_test_table_5 [id=e211628d46b64734960dfd60d86708ce]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:54.096153 4105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18a93b1a1ce1440b99bdd7a3bcf49064. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:54.097376 3920 tablet_service.cc:1511] Processing CreateTablet for tablet 57f6f22d97c14ed98960e27ce2c8f3fb (DEFAULT_TABLE table=rebalance_test_table_5 [id=e211628d46b64734960dfd60d86708ce]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:54.097805 3920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57f6f22d97c14ed98960e27ce2c8f3fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:54.097760 3917 tablet_service.cc:1511] Processing CreateTablet for tablet 1d377b919f4748c88efb249dfc964f17 (DEFAULT_TABLE table=rebalance_test_table_5 [id=e211628d46b64734960dfd60d86708ce]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:54.098140 3917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d377b919f4748c88efb249dfc964f17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:54.098559 4286 tablet_service.cc:1511] Processing CreateTablet for tablet 18a93b1a1ce1440b99bdd7a3bcf49064 (DEFAULT_TABLE table=rebalance_test_table_5 [id=e211628d46b64734960dfd60d86708ce]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:54.098995 4286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18a93b1a1ce1440b99bdd7a3bcf49064. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:54.101308 4103 tablet_service.cc:1511] Processing CreateTablet for tablet 57f6f22d97c14ed98960e27ce2c8f3fb (DEFAULT_TABLE table=rebalance_test_table_5 [id=e211628d46b64734960dfd60d86708ce]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:54.101840 4103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57f6f22d97c14ed98960e27ce2c8f3fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:54.101754 3737 tablet_service.cc:1511] Processing CreateTablet for tablet 57f6f22d97c14ed98960e27ce2c8f3fb (DEFAULT_TABLE table=rebalance_test_table_5 [id=e211628d46b64734960dfd60d86708ce]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:54.102279 3737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57f6f22d97c14ed98960e27ce2c8f3fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:54.117704 5729 tablet_bootstrap.cc:492] T 18a93b1a1ce1440b99bdd7a3bcf49064 P ca4469fc2dbc48488bc7ad7f482f129e: Bootstrap starting.
I20260810 01:58:54.119625 5731 tablet_bootstrap.cc:492] T 57f6f22d97c14ed98960e27ce2c8f3fb P 82f93d1d11364ceeb485585b4ae78871: Bootstrap starting.
I20260810 01:58:54.119906 5729 tablet_bootstrap.cc:654] T 18a93b1a1ce1440b99bdd7a3bcf49064 P ca4469fc2dbc48488bc7ad7f482f129e: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:54.123260 5731 tablet_bootstrap.cc:654] T 57f6f22d97c14ed98960e27ce2c8f3fb P 82f93d1d11364ceeb485585b4ae78871: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:54.132350 5736 tablet_bootstrap.cc:492] T 57f6f22d97c14ed98960e27ce2c8f3fb P dc85be7d460a404f997177f57680850f: Bootstrap starting.
I20260810 01:58:54.133535 5731 tablet_bootstrap.cc:492] T 57f6f22d97c14ed98960e27ce2c8f3fb P 82f93d1d11364ceeb485585b4ae78871: No bootstrap required, opened a new log
I20260810 01:58:54.133857 5731 ts_tablet_manager.cc:1403] T 57f6f22d97c14ed98960e27ce2c8f3fb P 82f93d1d11364ceeb485585b4ae78871: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.005s
I20260810 01:58:54.135218 5731 raft_consensus.cc:359] T 57f6f22d97c14ed98960e27ce2c8f3fb P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:54.135710 5731 raft_consensus.cc:385] T 57f6f22d97c14ed98960e27ce2c8f3fb P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:54.135919 5731 raft_consensus.cc:740] T 57f6f22d97c14ed98960e27ce2c8f3fb P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f93d1d11364ceeb485585b4ae78871, State: Initialized, Role: FOLLOWER
I20260810 01:58:54.136047 5736 tablet_bootstrap.cc:654] T 57f6f22d97c14ed98960e27ce2c8f3fb P dc85be7d460a404f997177f57680850f: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:54.136472 5731 consensus_queue.cc:260] T 57f6f22d97c14ed98960e27ce2c8f3fb P 82f93d1d11364ceeb485585b4ae78871 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:54.137734 5731 ts_tablet_manager.cc:1434] T 57f6f22d97c14ed98960e27ce2c8f3fb P 82f93d1d11364ceeb485585b4ae78871: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260810 01:58:54.138301 5731 tablet_bootstrap.cc:492] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871: Bootstrap starting.
I20260810 01:58:54.139523 5728 tablet_bootstrap.cc:492] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302: Bootstrap starting.
I20260810 01:58:54.140496 5729 tablet_bootstrap.cc:492] T 18a93b1a1ce1440b99bdd7a3bcf49064 P ca4469fc2dbc48488bc7ad7f482f129e: No bootstrap required, opened a new log
I20260810 01:58:54.140709 5729 ts_tablet_manager.cc:1403] T 18a93b1a1ce1440b99bdd7a3bcf49064 P ca4469fc2dbc48488bc7ad7f482f129e: Time spent bootstrapping tablet: real 0.023s user 0.007s sys 0.015s
I20260810 01:58:54.140841 5731 tablet_bootstrap.cc:654] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:54.141719 5729 raft_consensus.cc:359] T 18a93b1a1ce1440b99bdd7a3bcf49064 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:54.141922 5728 tablet_bootstrap.cc:654] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:54.141994 5729 raft_consensus.cc:385] T 18a93b1a1ce1440b99bdd7a3bcf49064 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:54.142155 5729 raft_consensus.cc:740] T 18a93b1a1ce1440b99bdd7a3bcf49064 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca4469fc2dbc48488bc7ad7f482f129e, State: Initialized, Role: FOLLOWER
I20260810 01:58:54.142498 5729 consensus_queue.cc:260] T 18a93b1a1ce1440b99bdd7a3bcf49064 P ca4469fc2dbc48488bc7ad7f482f129e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:54.143972 5729 ts_tablet_manager.cc:1434] T 18a93b1a1ce1440b99bdd7a3bcf49064 P ca4469fc2dbc48488bc7ad7f482f129e: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260810 01:58:54.144317 5729 tablet_bootstrap.cc:492] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e: Bootstrap starting.
I20260810 01:58:54.145192 5736 tablet_bootstrap.cc:492] T 57f6f22d97c14ed98960e27ce2c8f3fb P dc85be7d460a404f997177f57680850f: No bootstrap required, opened a new log
I20260810 01:58:54.145468 5736 ts_tablet_manager.cc:1403] T 57f6f22d97c14ed98960e27ce2c8f3fb P dc85be7d460a404f997177f57680850f: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.000s
I20260810 01:58:54.145941 5729 tablet_bootstrap.cc:654] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:54.146641 5736 raft_consensus.cc:359] T 57f6f22d97c14ed98960e27ce2c8f3fb P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:54.146951 5736 raft_consensus.cc:385] T 57f6f22d97c14ed98960e27ce2c8f3fb P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:54.147131 5736 raft_consensus.cc:740] T 57f6f22d97c14ed98960e27ce2c8f3fb P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc85be7d460a404f997177f57680850f, State: Initialized, Role: FOLLOWER
I20260810 01:58:54.147594 5736 consensus_queue.cc:260] T 57f6f22d97c14ed98960e27ce2c8f3fb P dc85be7d460a404f997177f57680850f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:54.148578 5736 ts_tablet_manager.cc:1434] T 57f6f22d97c14ed98960e27ce2c8f3fb P dc85be7d460a404f997177f57680850f: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 01:58:54.149899 5728 tablet_bootstrap.cc:492] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302: No bootstrap required, opened a new log
I20260810 01:58:54.150137 5728 ts_tablet_manager.cc:1403] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.001s
I20260810 01:58:54.150285 5731 tablet_bootstrap.cc:492] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871: No bootstrap required, opened a new log
I20260810 01:58:54.150468 5731 ts_tablet_manager.cc:1403] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.003s
I20260810 01:58:54.151316 5728 raft_consensus.cc:359] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:54.151372 5731 raft_consensus.cc:359] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:54.151584 5731 raft_consensus.cc:385] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:54.151681 5731 raft_consensus.cc:740] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f93d1d11364ceeb485585b4ae78871, State: Initialized, Role: FOLLOWER
I20260810 01:58:54.151647 5728 raft_consensus.cc:385] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:54.151839 5729 tablet_bootstrap.cc:492] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e: No bootstrap required, opened a new log
I20260810 01:58:54.151947 5728 raft_consensus.cc:740] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17b49c694faf479ea2e5083470fc0302, State: Initialized, Role: FOLLOWER
I20260810 01:58:54.151962 5731 consensus_queue.cc:260] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:54.152012 5729 ts_tablet_manager.cc:1403] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.001s
I20260810 01:58:54.152282 5728 consensus_queue.cc:260] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:54.152498 5731 ts_tablet_manager.cc:1434] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 01:58:54.152810 5731 tablet_bootstrap.cc:492] T 1d377b919f4748c88efb249dfc964f17 P 82f93d1d11364ceeb485585b4ae78871: Bootstrap starting.
I20260810 01:58:54.153198 5729 raft_consensus.cc:359] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:54.153462 5729 raft_consensus.cc:385] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:54.153544 5729 raft_consensus.cc:740] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca4469fc2dbc48488bc7ad7f482f129e, State: Initialized, Role: FOLLOWER
I20260810 01:58:54.154047 5729 consensus_queue.cc:260] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:54.154683 5731 tablet_bootstrap.cc:654] T 1d377b919f4748c88efb249dfc964f17 P 82f93d1d11364ceeb485585b4ae78871: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:54.154903 5728 ts_tablet_manager.cc:1434] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260810 01:58:54.155076 5729 ts_tablet_manager.cc:1434] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 01:58:54.155241 5728 tablet_bootstrap.cc:492] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302: Bootstrap starting.
I20260810 01:58:54.160055 5728 tablet_bootstrap.cc:654] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:54.163621 5731 tablet_bootstrap.cc:492] T 1d377b919f4748c88efb249dfc964f17 P 82f93d1d11364ceeb485585b4ae78871: No bootstrap required, opened a new log
I20260810 01:58:54.163861 5731 ts_tablet_manager.cc:1403] T 1d377b919f4748c88efb249dfc964f17 P 82f93d1d11364ceeb485585b4ae78871: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.003s
I20260810 01:58:54.164808 5731 raft_consensus.cc:359] T 1d377b919f4748c88efb249dfc964f17 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:54.164964 5731 raft_consensus.cc:385] T 1d377b919f4748c88efb249dfc964f17 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:54.165071 5731 raft_consensus.cc:740] T 1d377b919f4748c88efb249dfc964f17 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f93d1d11364ceeb485585b4ae78871, State: Initialized, Role: FOLLOWER
I20260810 01:58:54.165177 5728 tablet_bootstrap.cc:492] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302: No bootstrap required, opened a new log
I20260810 01:58:54.165408 5731 consensus_queue.cc:260] T 1d377b919f4748c88efb249dfc964f17 P 82f93d1d11364ceeb485585b4ae78871 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:54.165499 5728 ts_tablet_manager.cc:1403] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.005s
I20260810 01:58:54.165978 5731 ts_tablet_manager.cc:1434] T 1d377b919f4748c88efb249dfc964f17 P 82f93d1d11364ceeb485585b4ae78871: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 01:58:54.166345 5728 raft_consensus.cc:359] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:54.166790 5728 raft_consensus.cc:385] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:54.166904 5728 raft_consensus.cc:740] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17b49c694faf479ea2e5083470fc0302, State: Initialized, Role: FOLLOWER
I20260810 01:58:54.167197 5728 consensus_queue.cc:260] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:54.167740 5728 ts_tablet_manager.cc:1434] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 01:58:54.168174 5728 tablet_bootstrap.cc:492] T 57f6f22d97c14ed98960e27ce2c8f3fb P 17b49c694faf479ea2e5083470fc0302: Bootstrap starting.
I20260810 01:58:54.169898 5728 tablet_bootstrap.cc:654] T 57f6f22d97c14ed98960e27ce2c8f3fb P 17b49c694faf479ea2e5083470fc0302: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:54.172382 5728 tablet_bootstrap.cc:492] T 57f6f22d97c14ed98960e27ce2c8f3fb P 17b49c694faf479ea2e5083470fc0302: No bootstrap required, opened a new log
I20260810 01:58:54.172542 5728 ts_tablet_manager.cc:1403] T 57f6f22d97c14ed98960e27ce2c8f3fb P 17b49c694faf479ea2e5083470fc0302: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260810 01:58:54.173275 5728 raft_consensus.cc:359] T 57f6f22d97c14ed98960e27ce2c8f3fb P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:54.173489 5728 raft_consensus.cc:385] T 57f6f22d97c14ed98960e27ce2c8f3fb P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:54.173605 5728 raft_consensus.cc:740] T 57f6f22d97c14ed98960e27ce2c8f3fb P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17b49c694faf479ea2e5083470fc0302, State: Initialized, Role: FOLLOWER
I20260810 01:58:54.173941 5728 consensus_queue.cc:260] T 57f6f22d97c14ed98960e27ce2c8f3fb P 17b49c694faf479ea2e5083470fc0302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:54.174512 5728 ts_tablet_manager.cc:1434] T 57f6f22d97c14ed98960e27ce2c8f3fb P 17b49c694faf479ea2e5083470fc0302: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:58:54.225754 5704 raft_consensus.cc:493] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:58:54.226011 5704 raft_consensus.cc:515] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:54.226951 5704 leader_election.cc:290] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189), ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943)
I20260810 01:58:54.227703 4129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a93b1a1ce1440b99bdd7a3bcf49064" candidate_uuid: "82f93d1d11364ceeb485585b4ae78871" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17b49c694faf479ea2e5083470fc0302" is_pre_election: true
I20260810 01:58:54.227725 4313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a93b1a1ce1440b99bdd7a3bcf49064" candidate_uuid: "82f93d1d11364ceeb485585b4ae78871" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" is_pre_election: true
I20260810 01:58:54.228011 4313 raft_consensus.cc:2468] T 18a93b1a1ce1440b99bdd7a3bcf49064 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82f93d1d11364ceeb485585b4ae78871 in term 0.
I20260810 01:58:54.228006 4129 raft_consensus.cc:2468] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82f93d1d11364ceeb485585b4ae78871 in term 0.
I20260810 01:58:54.228644 3856 leader_election.cc:304] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 17b49c694faf479ea2e5083470fc0302, 82f93d1d11364ceeb485585b4ae78871, ca4469fc2dbc48488bc7ad7f482f129e; no voters:
I20260810 01:58:54.229060 5704 raft_consensus.cc:2804] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:58:54.229202 5704 raft_consensus.cc:493] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:58:54.229316 5704 raft_consensus.cc:3060] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:54.231448 5704 raft_consensus.cc:515] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:54.232061 5704 leader_election.cc:290] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871 [CANDIDATE]: Term 1 election: Requested vote from peers 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189), ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943)
I20260810 01:58:54.232563 4129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a93b1a1ce1440b99bdd7a3bcf49064" candidate_uuid: "82f93d1d11364ceeb485585b4ae78871" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17b49c694faf479ea2e5083470fc0302"
I20260810 01:58:54.232599 4313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a93b1a1ce1440b99bdd7a3bcf49064" candidate_uuid: "82f93d1d11364ceeb485585b4ae78871" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca4469fc2dbc48488bc7ad7f482f129e"
I20260810 01:58:54.232774 4129 raft_consensus.cc:3060] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:54.232776 4313 raft_consensus.cc:3060] T 18a93b1a1ce1440b99bdd7a3bcf49064 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:54.235183 4129 raft_consensus.cc:2468] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82f93d1d11364ceeb485585b4ae78871 in term 1.
I20260810 01:58:54.235249 4313 raft_consensus.cc:2468] T 18a93b1a1ce1440b99bdd7a3bcf49064 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82f93d1d11364ceeb485585b4ae78871 in term 1.
I20260810 01:58:54.235641 3856 leader_election.cc:304] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17b49c694faf479ea2e5083470fc0302, 82f93d1d11364ceeb485585b4ae78871; no voters:
I20260810 01:58:54.235970 5704 raft_consensus.cc:2804] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:58:54.236123 5704 raft_consensus.cc:697] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Becoming Leader. State: Replica: 82f93d1d11364ceeb485585b4ae78871, State: Running, Role: LEADER
I20260810 01:58:54.236414 5704 consensus_queue.cc:237] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:54.239627 3568 catalog_manager.cc:5719] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871 reported cstate change: term changed from 0 to 1, leader changed from <none> to 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194). New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
I20260810 01:58:54.272486 5526 raft_consensus.cc:493] T 57f6f22d97c14ed98960e27ce2c8f3fb P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:58:54.272733 5526 raft_consensus.cc:515] T 57f6f22d97c14ed98960e27ce2c8f3fb P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:54.273432 5526 leader_election.cc:290] T 57f6f22d97c14ed98960e27ce2c8f3fb P dc85be7d460a404f997177f57680850f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893), 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189)
I20260810 01:58:54.274109 4129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6f22d97c14ed98960e27ce2c8f3fb" candidate_uuid: "dc85be7d460a404f997177f57680850f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17b49c694faf479ea2e5083470fc0302" is_pre_election: true
I20260810 01:58:54.274091 3943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6f22d97c14ed98960e27ce2c8f3fb" candidate_uuid: "dc85be7d460a404f997177f57680850f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f93d1d11364ceeb485585b4ae78871" is_pre_election: true
I20260810 01:58:54.274382 3943 raft_consensus.cc:2468] T 57f6f22d97c14ed98960e27ce2c8f3fb P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc85be7d460a404f997177f57680850f in term 0.
I20260810 01:58:54.274380 4129 raft_consensus.cc:2468] T 57f6f22d97c14ed98960e27ce2c8f3fb P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc85be7d460a404f997177f57680850f in term 0.
I20260810 01:58:54.274931 3672 leader_election.cc:304] T 57f6f22d97c14ed98960e27ce2c8f3fb P dc85be7d460a404f997177f57680850f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82f93d1d11364ceeb485585b4ae78871, dc85be7d460a404f997177f57680850f; no voters:
I20260810 01:58:54.275267 5526 raft_consensus.cc:2804] T 57f6f22d97c14ed98960e27ce2c8f3fb P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:58:54.275380 5526 raft_consensus.cc:493] T 57f6f22d97c14ed98960e27ce2c8f3fb P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:58:54.275462 5526 raft_consensus.cc:3060] T 57f6f22d97c14ed98960e27ce2c8f3fb P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:54.277720 5526 raft_consensus.cc:515] T 57f6f22d97c14ed98960e27ce2c8f3fb P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:54.278345 5526 leader_election.cc:290] T 57f6f22d97c14ed98960e27ce2c8f3fb P dc85be7d460a404f997177f57680850f [CANDIDATE]: Term 1 election: Requested vote from peers 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893), 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189)
I20260810 01:58:54.278795 3943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6f22d97c14ed98960e27ce2c8f3fb" candidate_uuid: "dc85be7d460a404f997177f57680850f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f93d1d11364ceeb485585b4ae78871"
I20260810 01:58:54.278945 4129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6f22d97c14ed98960e27ce2c8f3fb" candidate_uuid: "dc85be7d460a404f997177f57680850f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17b49c694faf479ea2e5083470fc0302"
I20260810 01:58:54.279019 3943 raft_consensus.cc:3060] T 57f6f22d97c14ed98960e27ce2c8f3fb P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:54.279146 4129 raft_consensus.cc:3060] T 57f6f22d97c14ed98960e27ce2c8f3fb P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:54.281432 4129 raft_consensus.cc:2468] T 57f6f22d97c14ed98960e27ce2c8f3fb P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc85be7d460a404f997177f57680850f in term 1.
I20260810 01:58:54.281692 3943 raft_consensus.cc:2468] T 57f6f22d97c14ed98960e27ce2c8f3fb P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc85be7d460a404f997177f57680850f in term 1.
I20260810 01:58:54.281976 3671 leader_election.cc:304] T 57f6f22d97c14ed98960e27ce2c8f3fb P dc85be7d460a404f997177f57680850f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17b49c694faf479ea2e5083470fc0302, dc85be7d460a404f997177f57680850f; no voters:
I20260810 01:58:54.282346 5526 raft_consensus.cc:2804] T 57f6f22d97c14ed98960e27ce2c8f3fb P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:58:54.282931 5526 raft_consensus.cc:697] T 57f6f22d97c14ed98960e27ce2c8f3fb P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Becoming Leader. State: Replica: dc85be7d460a404f997177f57680850f, State: Running, Role: LEADER
I20260810 01:58:54.283320 5526 consensus_queue.cc:237] T 57f6f22d97c14ed98960e27ce2c8f3fb P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:54.286631 3568 catalog_manager.cc:5719] T 57f6f22d97c14ed98960e27ce2c8f3fb P dc85be7d460a404f997177f57680850f reported cstate change: term changed from 0 to 1, leader changed from <none> to dc85be7d460a404f997177f57680850f (127.21.64.193). New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } }
I20260810 01:58:54.353324 5153 raft_consensus.cc:493] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:58:54.353608 5153 raft_consensus.cc:515] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:54.354351 5153 leader_election.cc:290] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893), 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189)
I20260810 01:58:54.354825 4129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d377b919f4748c88efb249dfc964f17" candidate_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17b49c694faf479ea2e5083470fc0302" is_pre_election: true
I20260810 01:58:54.354928 3943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d377b919f4748c88efb249dfc964f17" candidate_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f93d1d11364ceeb485585b4ae78871" is_pre_election: true
I20260810 01:58:54.355055 4129 raft_consensus.cc:2468] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca4469fc2dbc48488bc7ad7f482f129e in term 0.
I20260810 01:58:54.355240 3943 raft_consensus.cc:2468] T 1d377b919f4748c88efb249dfc964f17 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca4469fc2dbc48488bc7ad7f482f129e in term 0.
I20260810 01:58:54.355579 4220 leader_election.cc:304] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17b49c694faf479ea2e5083470fc0302, ca4469fc2dbc48488bc7ad7f482f129e; no voters:
I20260810 01:58:54.355875 5153 raft_consensus.cc:2804] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:58:54.356003 5153 raft_consensus.cc:493] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:58:54.356113 5153 raft_consensus.cc:3060] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:54.358717 5153 raft_consensus.cc:515] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:54.359428 5153 leader_election.cc:290] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e [CANDIDATE]: Term 1 election: Requested vote from peers 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893), 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189)
I20260810 01:58:54.359808 3943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d377b919f4748c88efb249dfc964f17" candidate_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f93d1d11364ceeb485585b4ae78871"
I20260810 01:58:54.359886 4129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d377b919f4748c88efb249dfc964f17" candidate_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17b49c694faf479ea2e5083470fc0302"
I20260810 01:58:54.360078 3943 raft_consensus.cc:3060] T 1d377b919f4748c88efb249dfc964f17 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:54.360097 4129 raft_consensus.cc:3060] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:54.363135 4129 raft_consensus.cc:2468] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca4469fc2dbc48488bc7ad7f482f129e in term 1.
I20260810 01:58:54.363135 3943 raft_consensus.cc:2468] T 1d377b919f4748c88efb249dfc964f17 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca4469fc2dbc48488bc7ad7f482f129e in term 1.
I20260810 01:58:54.363560 4222 leader_election.cc:304] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82f93d1d11364ceeb485585b4ae78871, ca4469fc2dbc48488bc7ad7f482f129e; no voters:
I20260810 01:58:54.363873 5153 raft_consensus.cc:2804] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:58:54.364027 5153 raft_consensus.cc:697] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Becoming Leader. State: Replica: ca4469fc2dbc48488bc7ad7f482f129e, State: Running, Role: LEADER
I20260810 01:58:54.364298 5153 consensus_queue.cc:237] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:54.367312 3568 catalog_manager.cc:5719] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e reported cstate change: term changed from 0 to 1, leader changed from <none> to ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196). New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } }
I20260810 01:58:54.675781 5522 consensus_queue.cc:1048] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:58:54.682257 5704 consensus_queue.cc:1048] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:58:54.761893 5526 consensus_queue.cc:1048] T 57f6f22d97c14ed98960e27ce2c8f3fb P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:58:54.768941 5746 consensus_queue.cc:1048] T 57f6f22d97c14ed98960e27ce2c8f3fb P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 01:58:54.816493 5750 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:58:54.816938 5750 flags.cc:432] Enabled unsafe flag: --never_fsync=true
Using table 'rebalance_test_table_5'
I20260810 01:58:54.880751 5153 consensus_queue.cc:1048] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:58:54.887234 5153 consensus_queue.cc:1048] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 327.67 ms
time per row: 0.163835 ms
I20260810 01:58:55.320053 3565 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51850:
name: "rebalance_test_table_6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260810 01:58:55.330735 3737 tablet_service.cc:1511] Processing CreateTablet for tablet 8308d63e9002418b876c3d3ae0095d9f (DEFAULT_TABLE table=rebalance_test_table_6 [id=5b2df46262b142169af9a32c47535432]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:55.331024 4284 tablet_service.cc:1511] Processing CreateTablet for tablet 8308d63e9002418b876c3d3ae0095d9f (DEFAULT_TABLE table=rebalance_test_table_6 [id=5b2df46262b142169af9a32c47535432]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:55.331418 3737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8308d63e9002418b876c3d3ae0095d9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:55.331357 4286 tablet_service.cc:1511] Processing CreateTablet for tablet abf302f27a12414a8647dab82ab8101f (DEFAULT_TABLE table=rebalance_test_table_6 [id=5b2df46262b142169af9a32c47535432]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:55.331523 4284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8308d63e9002418b876c3d3ae0095d9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:55.331784 4286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abf302f27a12414a8647dab82ab8101f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:55.337774 3920 tablet_service.cc:1511] Processing CreateTablet for tablet 8308d63e9002418b876c3d3ae0095d9f (DEFAULT_TABLE table=rebalance_test_table_6 [id=5b2df46262b142169af9a32c47535432]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:55.338212 3920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8308d63e9002418b876c3d3ae0095d9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:55.342868 3735 tablet_service.cc:1511] Processing CreateTablet for tablet abf302f27a12414a8647dab82ab8101f (DEFAULT_TABLE table=rebalance_test_table_6 [id=5b2df46262b142169af9a32c47535432]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:55.343339 3735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abf302f27a12414a8647dab82ab8101f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:55.343449 4102 tablet_service.cc:1511] Processing CreateTablet for tablet abf302f27a12414a8647dab82ab8101f (DEFAULT_TABLE table=rebalance_test_table_6 [id=5b2df46262b142169af9a32c47535432]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:55.344007 4102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abf302f27a12414a8647dab82ab8101f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:55.346906 5843 tablet_bootstrap.cc:492] T 8308d63e9002418b876c3d3ae0095d9f P 82f93d1d11364ceeb485585b4ae78871: Bootstrap starting.
I20260810 01:58:55.348886 5843 tablet_bootstrap.cc:654] T 8308d63e9002418b876c3d3ae0095d9f P 82f93d1d11364ceeb485585b4ae78871: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:55.352523 3920 tablet_service.cc:1511] Processing CreateTablet for tablet f7a36f7ebd5d4342a259b093e45d4c32 (DEFAULT_TABLE table=rebalance_test_table_6 [id=5b2df46262b142169af9a32c47535432]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:55.352844 3734 tablet_service.cc:1511] Processing CreateTablet for tablet f7a36f7ebd5d4342a259b093e45d4c32 (DEFAULT_TABLE table=rebalance_test_table_6 [id=5b2df46262b142169af9a32c47535432]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:55.353143 3920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7a36f7ebd5d4342a259b093e45d4c32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:55.353284 3734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7a36f7ebd5d4342a259b093e45d4c32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:55.362577 5842 tablet_bootstrap.cc:492] T 8308d63e9002418b876c3d3ae0095d9f P dc85be7d460a404f997177f57680850f: Bootstrap starting.
I20260810 01:58:55.364184 5843 tablet_bootstrap.cc:492] T 8308d63e9002418b876c3d3ae0095d9f P 82f93d1d11364ceeb485585b4ae78871: No bootstrap required, opened a new log
I20260810 01:58:55.364339 5843 ts_tablet_manager.cc:1403] T 8308d63e9002418b876c3d3ae0095d9f P 82f93d1d11364ceeb485585b4ae78871: Time spent bootstrapping tablet: real 0.018s user 0.008s sys 0.000s
I20260810 01:58:55.364540 5842 tablet_bootstrap.cc:654] T 8308d63e9002418b876c3d3ae0095d9f P dc85be7d460a404f997177f57680850f: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:55.365160 5843 raft_consensus.cc:359] T 8308d63e9002418b876c3d3ae0095d9f P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:55.365401 5843 raft_consensus.cc:385] T 8308d63e9002418b876c3d3ae0095d9f P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:55.365547 5843 raft_consensus.cc:740] T 8308d63e9002418b876c3d3ae0095d9f P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f93d1d11364ceeb485585b4ae78871, State: Initialized, Role: FOLLOWER
I20260810 01:58:55.365870 5843 consensus_queue.cc:260] T 8308d63e9002418b876c3d3ae0095d9f P 82f93d1d11364ceeb485585b4ae78871 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:55.366255 4286 tablet_service.cc:1511] Processing CreateTablet for tablet f7a36f7ebd5d4342a259b093e45d4c32 (DEFAULT_TABLE table=rebalance_test_table_6 [id=5b2df46262b142169af9a32c47535432]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:55.366726 4286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7a36f7ebd5d4342a259b093e45d4c32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:55.366737 5843 ts_tablet_manager.cc:1434] T 8308d63e9002418b876c3d3ae0095d9f P 82f93d1d11364ceeb485585b4ae78871: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260810 01:58:55.367540 5843 tablet_bootstrap.cc:492] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871: Bootstrap starting.
I20260810 01:58:55.368176 5842 tablet_bootstrap.cc:492] T 8308d63e9002418b876c3d3ae0095d9f P dc85be7d460a404f997177f57680850f: No bootstrap required, opened a new log
I20260810 01:58:55.368357 5842 ts_tablet_manager.cc:1403] T 8308d63e9002418b876c3d3ae0095d9f P dc85be7d460a404f997177f57680850f: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260810 01:58:55.369297 5842 raft_consensus.cc:359] T 8308d63e9002418b876c3d3ae0095d9f P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:55.369558 5842 raft_consensus.cc:385] T 8308d63e9002418b876c3d3ae0095d9f P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:55.369567 5843 tablet_bootstrap.cc:654] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:55.369679 5842 raft_consensus.cc:740] T 8308d63e9002418b876c3d3ae0095d9f P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc85be7d460a404f997177f57680850f, State: Initialized, Role: FOLLOWER
I20260810 01:58:55.369957 5842 consensus_queue.cc:260] T 8308d63e9002418b876c3d3ae0095d9f P dc85be7d460a404f997177f57680850f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:55.371558 5842 ts_tablet_manager.cc:1434] T 8308d63e9002418b876c3d3ae0095d9f P dc85be7d460a404f997177f57680850f: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 01:58:55.371876 5842 tablet_bootstrap.cc:492] T f7a36f7ebd5d4342a259b093e45d4c32 P dc85be7d460a404f997177f57680850f: Bootstrap starting.
I20260810 01:58:55.373502 5842 tablet_bootstrap.cc:654] T f7a36f7ebd5d4342a259b093e45d4c32 P dc85be7d460a404f997177f57680850f: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:55.373502 5846 tablet_bootstrap.cc:492] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e: Bootstrap starting.
I20260810 01:58:55.377261 5846 tablet_bootstrap.cc:654] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:55.378123 5848 tablet_bootstrap.cc:492] T abf302f27a12414a8647dab82ab8101f P 17b49c694faf479ea2e5083470fc0302: Bootstrap starting.
I20260810 01:58:55.382838 5848 tablet_bootstrap.cc:654] T abf302f27a12414a8647dab82ab8101f P 17b49c694faf479ea2e5083470fc0302: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:55.384073 5842 tablet_bootstrap.cc:492] T f7a36f7ebd5d4342a259b093e45d4c32 P dc85be7d460a404f997177f57680850f: No bootstrap required, opened a new log
I20260810 01:58:55.384331 5842 ts_tablet_manager.cc:1403] T f7a36f7ebd5d4342a259b093e45d4c32 P dc85be7d460a404f997177f57680850f: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.008s
I20260810 01:58:55.385421 5842 raft_consensus.cc:359] T f7a36f7ebd5d4342a259b093e45d4c32 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:55.385737 5842 raft_consensus.cc:385] T f7a36f7ebd5d4342a259b093e45d4c32 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:55.385870 5842 raft_consensus.cc:740] T f7a36f7ebd5d4342a259b093e45d4c32 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc85be7d460a404f997177f57680850f, State: Initialized, Role: FOLLOWER
I20260810 01:58:55.386292 5842 consensus_queue.cc:260] T f7a36f7ebd5d4342a259b093e45d4c32 P dc85be7d460a404f997177f57680850f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:55.387598 5846 tablet_bootstrap.cc:492] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e: No bootstrap required, opened a new log
I20260810 01:58:55.387701 5842 ts_tablet_manager.cc:1434] T f7a36f7ebd5d4342a259b093e45d4c32 P dc85be7d460a404f997177f57680850f: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 01:58:55.387795 5846 ts_tablet_manager.cc:1403] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.000s
I20260810 01:58:55.388038 5842 tablet_bootstrap.cc:492] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f: Bootstrap starting.
I20260810 01:58:55.388643 5846 raft_consensus.cc:359] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:55.388928 5846 raft_consensus.cc:385] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:55.389075 5846 raft_consensus.cc:740] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca4469fc2dbc48488bc7ad7f482f129e, State: Initialized, Role: FOLLOWER
I20260810 01:58:55.389380 5846 consensus_queue.cc:260] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:55.390640 5842 tablet_bootstrap.cc:654] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:55.390759 5846 ts_tablet_manager.cc:1434] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 01:58:55.391083 5846 tablet_bootstrap.cc:492] T abf302f27a12414a8647dab82ab8101f P ca4469fc2dbc48488bc7ad7f482f129e: Bootstrap starting.
I20260810 01:58:55.393391 5846 tablet_bootstrap.cc:654] T abf302f27a12414a8647dab82ab8101f P ca4469fc2dbc48488bc7ad7f482f129e: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:55.395931 5848 tablet_bootstrap.cc:492] T abf302f27a12414a8647dab82ab8101f P 17b49c694faf479ea2e5083470fc0302: No bootstrap required, opened a new log
I20260810 01:58:55.396202 5848 ts_tablet_manager.cc:1403] T abf302f27a12414a8647dab82ab8101f P 17b49c694faf479ea2e5083470fc0302: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.006s
I20260810 01:58:55.397312 5848 raft_consensus.cc:359] T abf302f27a12414a8647dab82ab8101f P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:55.397708 5848 raft_consensus.cc:385] T abf302f27a12414a8647dab82ab8101f P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:55.397881 5848 raft_consensus.cc:740] T abf302f27a12414a8647dab82ab8101f P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17b49c694faf479ea2e5083470fc0302, State: Initialized, Role: FOLLOWER
I20260810 01:58:55.398283 5848 consensus_queue.cc:260] T abf302f27a12414a8647dab82ab8101f P 17b49c694faf479ea2e5083470fc0302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:55.400736 5848 ts_tablet_manager.cc:1434] T abf302f27a12414a8647dab82ab8101f P 17b49c694faf479ea2e5083470fc0302: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260810 01:58:55.407802 5846 tablet_bootstrap.cc:492] T abf302f27a12414a8647dab82ab8101f P ca4469fc2dbc48488bc7ad7f482f129e: No bootstrap required, opened a new log
I20260810 01:58:55.408097 5846 ts_tablet_manager.cc:1403] T abf302f27a12414a8647dab82ab8101f P ca4469fc2dbc48488bc7ad7f482f129e: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.003s
I20260810 01:58:55.409196 5846 raft_consensus.cc:359] T abf302f27a12414a8647dab82ab8101f P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:55.409605 5846 raft_consensus.cc:385] T abf302f27a12414a8647dab82ab8101f P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:55.409744 5846 raft_consensus.cc:740] T abf302f27a12414a8647dab82ab8101f P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca4469fc2dbc48488bc7ad7f482f129e, State: Initialized, Role: FOLLOWER
I20260810 01:58:55.410079 5846 consensus_queue.cc:260] T abf302f27a12414a8647dab82ab8101f P ca4469fc2dbc48488bc7ad7f482f129e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:55.410805 5846 ts_tablet_manager.cc:1434] T abf302f27a12414a8647dab82ab8101f P ca4469fc2dbc48488bc7ad7f482f129e: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 01:58:55.411281 5846 tablet_bootstrap.cc:492] T f7a36f7ebd5d4342a259b093e45d4c32 P ca4469fc2dbc48488bc7ad7f482f129e: Bootstrap starting.
I20260810 01:58:55.411943 5795 raft_consensus.cc:493] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:58:55.412139 5795 raft_consensus.cc:515] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:55.413102 5795 leader_election.cc:290] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893), dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
I20260810 01:58:55.413858 5846 tablet_bootstrap.cc:654] T f7a36f7ebd5d4342a259b093e45d4c32 P ca4469fc2dbc48488bc7ad7f482f129e: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:55.416940 3945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8308d63e9002418b876c3d3ae0095d9f" candidate_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f93d1d11364ceeb485585b4ae78871" is_pre_election: true
I20260810 01:58:55.417233 3945 raft_consensus.cc:2468] T 8308d63e9002418b876c3d3ae0095d9f P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca4469fc2dbc48488bc7ad7f482f129e in term 0.
I20260810 01:58:55.417790 3757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8308d63e9002418b876c3d3ae0095d9f" candidate_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc85be7d460a404f997177f57680850f" is_pre_election: true
I20260810 01:58:55.417876 4222 leader_election.cc:304] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82f93d1d11364ceeb485585b4ae78871, ca4469fc2dbc48488bc7ad7f482f129e; no voters:
I20260810 01:58:55.418040 3757 raft_consensus.cc:2468] T 8308d63e9002418b876c3d3ae0095d9f P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca4469fc2dbc48488bc7ad7f482f129e in term 0.
I20260810 01:58:55.418222 5795 raft_consensus.cc:2804] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:58:55.418347 5795 raft_consensus.cc:493] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:58:55.418444 5795 raft_consensus.cc:3060] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:55.422005 5795 raft_consensus.cc:515] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:55.422653 5795 leader_election.cc:290] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [CANDIDATE]: Term 1 election: Requested vote from peers 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893), dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
I20260810 01:58:55.423578 3757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8308d63e9002418b876c3d3ae0095d9f" candidate_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc85be7d460a404f997177f57680850f"
I20260810 01:58:55.433743 3945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8308d63e9002418b876c3d3ae0095d9f" candidate_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f93d1d11364ceeb485585b4ae78871"
I20260810 01:58:55.434041 3945 raft_consensus.cc:3060] T 8308d63e9002418b876c3d3ae0095d9f P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:55.443442 5762 raft_consensus.cc:493] T f7a36f7ebd5d4342a259b093e45d4c32 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:58:55.443595 3757 raft_consensus.cc:3060] T 8308d63e9002418b876c3d3ae0095d9f P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:55.443696 5762 raft_consensus.cc:515] T f7a36f7ebd5d4342a259b093e45d4c32 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:55.444813 5762 leader_election.cc:290] T f7a36f7ebd5d4342a259b093e45d4c32 P dc85be7d460a404f997177f57680850f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893), ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943)
I20260810 01:58:55.446039 3943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a36f7ebd5d4342a259b093e45d4c32" candidate_uuid: "dc85be7d460a404f997177f57680850f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f93d1d11364ceeb485585b4ae78871" is_pre_election: true
I20260810 01:58:55.447013 4313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a36f7ebd5d4342a259b093e45d4c32" candidate_uuid: "dc85be7d460a404f997177f57680850f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" is_pre_election: true
W20260810 01:58:55.447410 3672 leader_election.cc:343] T f7a36f7ebd5d4342a259b093e45d4c32 P dc85be7d460a404f997177f57680850f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): Illegal state: must be running to vote when last-logged opid is not known
I20260810 01:58:55.448089 3757 raft_consensus.cc:2468] T 8308d63e9002418b876c3d3ae0095d9f P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca4469fc2dbc48488bc7ad7f482f129e in term 1.
I20260810 01:58:55.449265 3945 raft_consensus.cc:2468] T 8308d63e9002418b876c3d3ae0095d9f P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca4469fc2dbc48488bc7ad7f482f129e in term 1.
I20260810 01:58:55.450105 4222 leader_election.cc:304] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82f93d1d11364ceeb485585b4ae78871, ca4469fc2dbc48488bc7ad7f482f129e; no voters:
I20260810 01:58:55.450721 5795 raft_consensus.cc:2804] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:58:55.450901 5795 raft_consensus.cc:697] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Becoming Leader. State: Replica: ca4469fc2dbc48488bc7ad7f482f129e, State: Running, Role: LEADER
I20260810 01:58:55.451273 5795 consensus_queue.cc:237] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:55.459486 5842 tablet_bootstrap.cc:492] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f: No bootstrap required, opened a new log
I20260810 01:58:55.459781 5842 ts_tablet_manager.cc:1403] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f: Time spent bootstrapping tablet: real 0.072s user 0.028s sys 0.026s
I20260810 01:58:55.459836 5843 tablet_bootstrap.cc:492] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871: No bootstrap required, opened a new log
I20260810 01:58:55.460078 5843 ts_tablet_manager.cc:1403] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871: Time spent bootstrapping tablet: real 0.093s user 0.020s sys 0.054s
I20260810 01:58:55.460945 5843 raft_consensus.cc:359] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:55.460973 5842 raft_consensus.cc:359] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:55.461253 5843 raft_consensus.cc:385] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:55.461375 5843 raft_consensus.cc:740] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f93d1d11364ceeb485585b4ae78871, State: Initialized, Role: FOLLOWER
I20260810 01:58:55.461422 5842 raft_consensus.cc:385] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:55.461647 5842 raft_consensus.cc:740] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc85be7d460a404f997177f57680850f, State: Initialized, Role: FOLLOWER
I20260810 01:58:55.461679 5843 consensus_queue.cc:260] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:55.462102 5842 consensus_queue.cc:260] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:55.462271 5843 ts_tablet_manager.cc:1434] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 01:58:55.463280 5842 ts_tablet_manager.cc:1434] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 01:58:55.463421 5846 tablet_bootstrap.cc:492] T f7a36f7ebd5d4342a259b093e45d4c32 P ca4469fc2dbc48488bc7ad7f482f129e: No bootstrap required, opened a new log
I20260810 01:58:55.463609 5846 ts_tablet_manager.cc:1403] T f7a36f7ebd5d4342a259b093e45d4c32 P ca4469fc2dbc48488bc7ad7f482f129e: Time spent bootstrapping tablet: real 0.052s user 0.007s sys 0.004s
W20260810 01:58:55.463970 3672 leader_election.cc:343] T f7a36f7ebd5d4342a259b093e45d4c32 P dc85be7d460a404f997177f57680850f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): Illegal state: must be running to vote when last-logged opid is not known
I20260810 01:58:55.464164 3672 leader_election.cc:304] T f7a36f7ebd5d4342a259b093e45d4c32 P dc85be7d460a404f997177f57680850f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc85be7d460a404f997177f57680850f; no voters: 82f93d1d11364ceeb485585b4ae78871, ca4469fc2dbc48488bc7ad7f482f129e
I20260810 01:58:55.464484 5762 raft_consensus.cc:2749] T f7a36f7ebd5d4342a259b093e45d4c32 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 01:58:55.464452 5846 raft_consensus.cc:359] T f7a36f7ebd5d4342a259b093e45d4c32 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:55.464640 5846 raft_consensus.cc:385] T f7a36f7ebd5d4342a259b093e45d4c32 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:55.464744 5846 raft_consensus.cc:740] T f7a36f7ebd5d4342a259b093e45d4c32 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca4469fc2dbc48488bc7ad7f482f129e, State: Initialized, Role: FOLLOWER
I20260810 01:58:55.465027 5846 consensus_queue.cc:260] T f7a36f7ebd5d4342a259b093e45d4c32 P ca4469fc2dbc48488bc7ad7f482f129e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:55.465638 5846 ts_tablet_manager.cc:1434] T f7a36f7ebd5d4342a259b093e45d4c32 P ca4469fc2dbc48488bc7ad7f482f129e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:58:55.469455 3565 catalog_manager.cc:5719] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e reported cstate change: term changed from 0 to 1, leader changed from <none> to ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196). New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
I20260810 01:58:55.502223 5522 raft_consensus.cc:493] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:58:55.502475 5522 raft_consensus.cc:515] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:55.503151 5522 leader_election.cc:290] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc85be7d460a404f997177f57680850f (127.21.64.193:36797), ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943)
I20260810 01:58:55.503831 4313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a36f7ebd5d4342a259b093e45d4c32" candidate_uuid: "82f93d1d11364ceeb485585b4ae78871" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" is_pre_election: true
I20260810 01:58:55.503816 3757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a36f7ebd5d4342a259b093e45d4c32" candidate_uuid: "82f93d1d11364ceeb485585b4ae78871" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc85be7d460a404f997177f57680850f" is_pre_election: true
I20260810 01:58:55.504088 4313 raft_consensus.cc:2468] T f7a36f7ebd5d4342a259b093e45d4c32 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82f93d1d11364ceeb485585b4ae78871 in term 0.
I20260810 01:58:55.504109 3757 raft_consensus.cc:2468] T f7a36f7ebd5d4342a259b093e45d4c32 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82f93d1d11364ceeb485585b4ae78871 in term 0.
I20260810 01:58:55.504621 3857 leader_election.cc:304] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 82f93d1d11364ceeb485585b4ae78871, ca4469fc2dbc48488bc7ad7f482f129e, dc85be7d460a404f997177f57680850f; no voters:
I20260810 01:58:55.505000 5522 raft_consensus.cc:2804] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:58:55.505141 5522 raft_consensus.cc:493] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:58:55.505270 5522 raft_consensus.cc:3060] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:55.507577 5522 raft_consensus.cc:515] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:55.508155 5522 leader_election.cc:290] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [CANDIDATE]: Term 1 election: Requested vote from peers dc85be7d460a404f997177f57680850f (127.21.64.193:36797), ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943)
I20260810 01:58:55.508682 3757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a36f7ebd5d4342a259b093e45d4c32" candidate_uuid: "82f93d1d11364ceeb485585b4ae78871" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc85be7d460a404f997177f57680850f"
I20260810 01:58:55.508713 4313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a36f7ebd5d4342a259b093e45d4c32" candidate_uuid: "82f93d1d11364ceeb485585b4ae78871" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca4469fc2dbc48488bc7ad7f482f129e"
I20260810 01:58:55.508894 4313 raft_consensus.cc:3060] T f7a36f7ebd5d4342a259b093e45d4c32 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:55.508916 3757 raft_consensus.cc:3060] T f7a36f7ebd5d4342a259b093e45d4c32 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:55.512094 3757 raft_consensus.cc:2468] T f7a36f7ebd5d4342a259b093e45d4c32 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82f93d1d11364ceeb485585b4ae78871 in term 1.
I20260810 01:58:55.512125 4313 raft_consensus.cc:2468] T f7a36f7ebd5d4342a259b093e45d4c32 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82f93d1d11364ceeb485585b4ae78871 in term 1.
I20260810 01:58:55.512656 3855 leader_election.cc:304] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 82f93d1d11364ceeb485585b4ae78871, ca4469fc2dbc48488bc7ad7f482f129e, dc85be7d460a404f997177f57680850f; no voters:
I20260810 01:58:55.512974 5522 raft_consensus.cc:2804] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:58:55.513145 5522 raft_consensus.cc:697] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Becoming Leader. State: Replica: 82f93d1d11364ceeb485585b4ae78871, State: Running, Role: LEADER
I20260810 01:58:55.513485 5522 consensus_queue.cc:237] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:55.516736 3565 catalog_manager.cc:5719] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 reported cstate change: term changed from 0 to 1, leader changed from <none> to 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194). New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
I20260810 01:58:55.520141 5762 raft_consensus.cc:493] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:58:55.520309 5762 raft_consensus.cc:515] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:55.520964 5762 leader_election.cc:290] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943), 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189)
I20260810 01:58:55.521467 4313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf302f27a12414a8647dab82ab8101f" candidate_uuid: "dc85be7d460a404f997177f57680850f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" is_pre_election: true
I20260810 01:58:55.521570 4132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf302f27a12414a8647dab82ab8101f" candidate_uuid: "dc85be7d460a404f997177f57680850f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17b49c694faf479ea2e5083470fc0302" is_pre_election: true
I20260810 01:58:55.521763 4313 raft_consensus.cc:2468] T abf302f27a12414a8647dab82ab8101f P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc85be7d460a404f997177f57680850f in term 0.
I20260810 01:58:55.521790 4132 raft_consensus.cc:2468] T abf302f27a12414a8647dab82ab8101f P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc85be7d460a404f997177f57680850f in term 0.
I20260810 01:58:55.522238 3672 leader_election.cc:304] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca4469fc2dbc48488bc7ad7f482f129e, dc85be7d460a404f997177f57680850f; no voters:
I20260810 01:58:55.522562 5762 raft_consensus.cc:2804] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:58:55.522660 5762 raft_consensus.cc:493] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:58:55.522722 5762 raft_consensus.cc:3060] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:55.525300 5762 raft_consensus.cc:515] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:55.526000 5762 leader_election.cc:290] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [CANDIDATE]: Term 1 election: Requested vote from peers ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943), 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189)
I20260810 01:58:55.526418 4313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf302f27a12414a8647dab82ab8101f" candidate_uuid: "dc85be7d460a404f997177f57680850f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca4469fc2dbc48488bc7ad7f482f129e"
I20260810 01:58:55.526584 4132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf302f27a12414a8647dab82ab8101f" candidate_uuid: "dc85be7d460a404f997177f57680850f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17b49c694faf479ea2e5083470fc0302"
I20260810 01:58:55.526657 4313 raft_consensus.cc:3060] T abf302f27a12414a8647dab82ab8101f P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:55.526799 4132 raft_consensus.cc:3060] T abf302f27a12414a8647dab82ab8101f P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:55.528863 4313 raft_consensus.cc:2468] T abf302f27a12414a8647dab82ab8101f P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc85be7d460a404f997177f57680850f in term 1.
I20260810 01:58:55.529048 4132 raft_consensus.cc:2468] T abf302f27a12414a8647dab82ab8101f P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc85be7d460a404f997177f57680850f in term 1.
I20260810 01:58:55.529337 3672 leader_election.cc:304] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca4469fc2dbc48488bc7ad7f482f129e, dc85be7d460a404f997177f57680850f; no voters:
I20260810 01:58:55.529706 5762 raft_consensus.cc:2804] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:58:55.529889 5762 raft_consensus.cc:697] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Becoming Leader. State: Replica: dc85be7d460a404f997177f57680850f, State: Running, Role: LEADER
I20260810 01:58:55.530176 5762 consensus_queue.cc:237] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:55.533643 3565 catalog_manager.cc:5719] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f reported cstate change: term changed from 0 to 1, leader changed from <none> to dc85be7d460a404f997177f57680850f (127.21.64.193). New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } }
I20260810 01:58:55.854590 5795 consensus_queue.cc:1048] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:58:55.861230 5795 consensus_queue.cc:1048] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 01:58:55.967144 5866 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:58:55.967514 5866 flags.cc:432] Enabled unsafe flag: --never_fsync=true
Using table 'rebalance_test_table_6'
I20260810 01:58:56.015861 5762 consensus_queue.cc:1048] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:58:56.018441 5522 consensus_queue.cc:1048] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:58:56.021391 5762 consensus_queue.cc:1048] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:58:56.028944 5522 consensus_queue.cc:1048] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 255.101 ms
time per row: 0.12755 ms
I20260810 01:58:56.423192 3565 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51850:
name: "rebalance_test_table_7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260810 01:58:56.433004 4102 tablet_service.cc:1511] Processing CreateTablet for tablet d05e147199e44b8ca712e18d22e7cce7 (DEFAULT_TABLE table=rebalance_test_table_7 [id=b572363d270a4bfda571d46e96d0bfda]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:56.433537 4102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d05e147199e44b8ca712e18d22e7cce7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:56.434105 3735 tablet_service.cc:1511] Processing CreateTablet for tablet d05e147199e44b8ca712e18d22e7cce7 (DEFAULT_TABLE table=rebalance_test_table_7 [id=b572363d270a4bfda571d46e96d0bfda]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:56.434278 3920 tablet_service.cc:1511] Processing CreateTablet for tablet d05e147199e44b8ca712e18d22e7cce7 (DEFAULT_TABLE table=rebalance_test_table_7 [id=b572363d270a4bfda571d46e96d0bfda]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:56.434598 3735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d05e147199e44b8ca712e18d22e7cce7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:56.434728 3920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d05e147199e44b8ca712e18d22e7cce7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:56.438437 4286 tablet_service.cc:1511] Processing CreateTablet for tablet f3d04e9457c944a8a72861680bdf9b7c (DEFAULT_TABLE table=rebalance_test_table_7 [id=b572363d270a4bfda571d46e96d0bfda]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:56.438910 4286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3d04e9457c944a8a72861680bdf9b7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:56.442209 3737 tablet_service.cc:1511] Processing CreateTablet for tablet f3d04e9457c944a8a72861680bdf9b7c (DEFAULT_TABLE table=rebalance_test_table_7 [id=b572363d270a4bfda571d46e96d0bfda]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:56.442760 3737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3d04e9457c944a8a72861680bdf9b7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:56.445756 4284 tablet_service.cc:1511] Processing CreateTablet for tablet e70193bd4055469d870a76542eaef524 (DEFAULT_TABLE table=rebalance_test_table_7 [id=b572363d270a4bfda571d46e96d0bfda]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:56.446164 4284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e70193bd4055469d870a76542eaef524. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:56.447139 4105 tablet_service.cc:1511] Processing CreateTablet for tablet f3d04e9457c944a8a72861680bdf9b7c (DEFAULT_TABLE table=rebalance_test_table_7 [id=b572363d270a4bfda571d46e96d0bfda]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:56.447682 4105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3d04e9457c944a8a72861680bdf9b7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:56.448751 5955 tablet_bootstrap.cc:492] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302: Bootstrap starting.
I20260810 01:58:56.449741 4103 tablet_service.cc:1511] Processing CreateTablet for tablet e70193bd4055469d870a76542eaef524 (DEFAULT_TABLE table=rebalance_test_table_7 [id=b572363d270a4bfda571d46e96d0bfda]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:56.450166 4103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e70193bd4055469d870a76542eaef524. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:56.451134 5955 tablet_bootstrap.cc:654] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:56.454643 3917 tablet_service.cc:1511] Processing CreateTablet for tablet e70193bd4055469d870a76542eaef524 (DEFAULT_TABLE table=rebalance_test_table_7 [id=b572363d270a4bfda571d46e96d0bfda]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:56.455075 3917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e70193bd4055469d870a76542eaef524. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:56.459933 5958 tablet_bootstrap.cc:492] T e70193bd4055469d870a76542eaef524 P ca4469fc2dbc48488bc7ad7f482f129e: Bootstrap starting.
I20260810 01:58:56.460215 5955 tablet_bootstrap.cc:492] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302: No bootstrap required, opened a new log
I20260810 01:58:56.460366 5955 ts_tablet_manager.cc:1403] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.007s
I20260810 01:58:56.461539 5955 raft_consensus.cc:359] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 01:58:56.461758 5955 raft_consensus.cc:385] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:56.461869 5955 raft_consensus.cc:740] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17b49c694faf479ea2e5083470fc0302, State: Initialized, Role: FOLLOWER
I20260810 01:58:56.462105 5955 consensus_queue.cc:260] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 01:58:56.462316 5958 tablet_bootstrap.cc:654] T e70193bd4055469d870a76542eaef524 P ca4469fc2dbc48488bc7ad7f482f129e: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:56.464537 5955 ts_tablet_manager.cc:1434] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260810 01:58:56.470852 5955 tablet_bootstrap.cc:492] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302: Bootstrap starting.
I20260810 01:58:56.473440 5955 tablet_bootstrap.cc:654] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:56.474260 5961 tablet_bootstrap.cc:492] T d05e147199e44b8ca712e18d22e7cce7 P 82f93d1d11364ceeb485585b4ae78871: Bootstrap starting.
I20260810 01:58:56.476845 5958 tablet_bootstrap.cc:492] T e70193bd4055469d870a76542eaef524 P ca4469fc2dbc48488bc7ad7f482f129e: No bootstrap required, opened a new log
I20260810 01:58:56.476872 5961 tablet_bootstrap.cc:654] T d05e147199e44b8ca712e18d22e7cce7 P 82f93d1d11364ceeb485585b4ae78871: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:56.477175 5958 ts_tablet_manager.cc:1403] T e70193bd4055469d870a76542eaef524 P ca4469fc2dbc48488bc7ad7f482f129e: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.011s
I20260810 01:58:56.478430 5958 raft_consensus.cc:359] T e70193bd4055469d870a76542eaef524 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:56.478715 5958 raft_consensus.cc:385] T e70193bd4055469d870a76542eaef524 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:56.478792 5956 tablet_bootstrap.cc:492] T d05e147199e44b8ca712e18d22e7cce7 P dc85be7d460a404f997177f57680850f: Bootstrap starting.
I20260810 01:58:56.478856 5958 raft_consensus.cc:740] T e70193bd4055469d870a76542eaef524 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca4469fc2dbc48488bc7ad7f482f129e, State: Initialized, Role: FOLLOWER
I20260810 01:58:56.479458 5958 consensus_queue.cc:260] T e70193bd4055469d870a76542eaef524 P ca4469fc2dbc48488bc7ad7f482f129e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:56.480080 5958 ts_tablet_manager.cc:1434] T e70193bd4055469d870a76542eaef524 P ca4469fc2dbc48488bc7ad7f482f129e: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 01:58:56.480538 5958 tablet_bootstrap.cc:492] T f3d04e9457c944a8a72861680bdf9b7c P ca4469fc2dbc48488bc7ad7f482f129e: Bootstrap starting.
I20260810 01:58:56.481426 5956 tablet_bootstrap.cc:654] T d05e147199e44b8ca712e18d22e7cce7 P dc85be7d460a404f997177f57680850f: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:56.483330 5958 tablet_bootstrap.cc:654] T f3d04e9457c944a8a72861680bdf9b7c P ca4469fc2dbc48488bc7ad7f482f129e: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:56.485656 5961 tablet_bootstrap.cc:492] T d05e147199e44b8ca712e18d22e7cce7 P 82f93d1d11364ceeb485585b4ae78871: No bootstrap required, opened a new log
I20260810 01:58:56.485885 5961 ts_tablet_manager.cc:1403] T d05e147199e44b8ca712e18d22e7cce7 P 82f93d1d11364ceeb485585b4ae78871: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.001s
I20260810 01:58:56.486239 5955 tablet_bootstrap.cc:492] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302: No bootstrap required, opened a new log
I20260810 01:58:56.486549 5955 ts_tablet_manager.cc:1403] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302: Time spent bootstrapping tablet: real 0.016s user 0.006s sys 0.005s
I20260810 01:58:56.486857 5961 raft_consensus.cc:359] T d05e147199e44b8ca712e18d22e7cce7 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 01:58:56.487144 5961 raft_consensus.cc:385] T d05e147199e44b8ca712e18d22e7cce7 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:56.487299 5961 raft_consensus.cc:740] T d05e147199e44b8ca712e18d22e7cce7 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f93d1d11364ceeb485585b4ae78871, State: Initialized, Role: FOLLOWER
I20260810 01:58:56.487528 5955 raft_consensus.cc:359] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:56.487634 5961 consensus_queue.cc:260] T d05e147199e44b8ca712e18d22e7cce7 P 82f93d1d11364ceeb485585b4ae78871 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 01:58:56.487757 5955 raft_consensus.cc:385] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:56.487838 5955 raft_consensus.cc:740] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17b49c694faf479ea2e5083470fc0302, State: Initialized, Role: FOLLOWER
I20260810 01:58:56.488178 5958 tablet_bootstrap.cc:492] T f3d04e9457c944a8a72861680bdf9b7c P ca4469fc2dbc48488bc7ad7f482f129e: No bootstrap required, opened a new log
I20260810 01:58:56.488121 5955 consensus_queue.cc:260] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:56.488325 5961 ts_tablet_manager.cc:1434] T d05e147199e44b8ca712e18d22e7cce7 P 82f93d1d11364ceeb485585b4ae78871: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260810 01:58:56.488457 5958 ts_tablet_manager.cc:1403] T f3d04e9457c944a8a72861680bdf9b7c P ca4469fc2dbc48488bc7ad7f482f129e: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.005s
I20260810 01:58:56.488896 5956 tablet_bootstrap.cc:492] T d05e147199e44b8ca712e18d22e7cce7 P dc85be7d460a404f997177f57680850f: No bootstrap required, opened a new log
I20260810 01:58:56.489250 5961 tablet_bootstrap.cc:492] T e70193bd4055469d870a76542eaef524 P 82f93d1d11364ceeb485585b4ae78871: Bootstrap starting.
I20260810 01:58:56.489305 5958 raft_consensus.cc:359] T f3d04e9457c944a8a72861680bdf9b7c P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:56.489652 5958 raft_consensus.cc:385] T f3d04e9457c944a8a72861680bdf9b7c P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:56.490198 5958 raft_consensus.cc:740] T f3d04e9457c944a8a72861680bdf9b7c P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca4469fc2dbc48488bc7ad7f482f129e, State: Initialized, Role: FOLLOWER
I20260810 01:58:56.490540 5958 consensus_queue.cc:260] T f3d04e9457c944a8a72861680bdf9b7c P ca4469fc2dbc48488bc7ad7f482f129e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:56.491209 5961 tablet_bootstrap.cc:654] T e70193bd4055469d870a76542eaef524 P 82f93d1d11364ceeb485585b4ae78871: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:56.491271 5958 ts_tablet_manager.cc:1434] T f3d04e9457c944a8a72861680bdf9b7c P ca4469fc2dbc48488bc7ad7f482f129e: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 01:58:56.491447 5956 ts_tablet_manager.cc:1403] T d05e147199e44b8ca712e18d22e7cce7 P dc85be7d460a404f997177f57680850f: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.004s
I20260810 01:58:56.491876 5955 ts_tablet_manager.cc:1434] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260810 01:58:56.492296 5956 raft_consensus.cc:359] T d05e147199e44b8ca712e18d22e7cce7 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 01:58:56.493149 5955 tablet_bootstrap.cc:492] T f3d04e9457c944a8a72861680bdf9b7c P 17b49c694faf479ea2e5083470fc0302: Bootstrap starting.
I20260810 01:58:56.493618 5956 raft_consensus.cc:385] T d05e147199e44b8ca712e18d22e7cce7 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:56.493783 5956 raft_consensus.cc:740] T d05e147199e44b8ca712e18d22e7cce7 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc85be7d460a404f997177f57680850f, State: Initialized, Role: FOLLOWER
I20260810 01:58:56.494169 5956 consensus_queue.cc:260] T d05e147199e44b8ca712e18d22e7cce7 P dc85be7d460a404f997177f57680850f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 01:58:56.495116 5955 tablet_bootstrap.cc:654] T f3d04e9457c944a8a72861680bdf9b7c P 17b49c694faf479ea2e5083470fc0302: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:56.496263 5956 ts_tablet_manager.cc:1434] T d05e147199e44b8ca712e18d22e7cce7 P dc85be7d460a404f997177f57680850f: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260810 01:58:56.496740 5956 tablet_bootstrap.cc:492] T f3d04e9457c944a8a72861680bdf9b7c P dc85be7d460a404f997177f57680850f: Bootstrap starting.
I20260810 01:58:56.500586 5956 tablet_bootstrap.cc:654] T f3d04e9457c944a8a72861680bdf9b7c P dc85be7d460a404f997177f57680850f: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:56.500597 5955 tablet_bootstrap.cc:492] T f3d04e9457c944a8a72861680bdf9b7c P 17b49c694faf479ea2e5083470fc0302: No bootstrap required, opened a new log
I20260810 01:58:56.500749 5955 ts_tablet_manager.cc:1403] T f3d04e9457c944a8a72861680bdf9b7c P 17b49c694faf479ea2e5083470fc0302: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.005s
I20260810 01:58:56.501472 5961 tablet_bootstrap.cc:492] T e70193bd4055469d870a76542eaef524 P 82f93d1d11364ceeb485585b4ae78871: No bootstrap required, opened a new log
I20260810 01:58:56.501669 5961 ts_tablet_manager.cc:1403] T e70193bd4055469d870a76542eaef524 P 82f93d1d11364ceeb485585b4ae78871: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.004s
I20260810 01:58:56.501638 5955 raft_consensus.cc:359] T f3d04e9457c944a8a72861680bdf9b7c P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:56.501928 5955 raft_consensus.cc:385] T f3d04e9457c944a8a72861680bdf9b7c P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:56.502086 5955 raft_consensus.cc:740] T f3d04e9457c944a8a72861680bdf9b7c P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17b49c694faf479ea2e5083470fc0302, State: Initialized, Role: FOLLOWER
I20260810 01:58:56.502460 5955 consensus_queue.cc:260] T f3d04e9457c944a8a72861680bdf9b7c P 17b49c694faf479ea2e5083470fc0302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:56.502684 5961 raft_consensus.cc:359] T e70193bd4055469d870a76542eaef524 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:56.502995 5961 raft_consensus.cc:385] T e70193bd4055469d870a76542eaef524 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:56.503096 5955 ts_tablet_manager.cc:1434] T f3d04e9457c944a8a72861680bdf9b7c P 17b49c694faf479ea2e5083470fc0302: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:58:56.503124 5961 raft_consensus.cc:740] T e70193bd4055469d870a76542eaef524 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f93d1d11364ceeb485585b4ae78871, State: Initialized, Role: FOLLOWER
I20260810 01:58:56.503544 5956 tablet_bootstrap.cc:492] T f3d04e9457c944a8a72861680bdf9b7c P dc85be7d460a404f997177f57680850f: No bootstrap required, opened a new log
I20260810 01:58:56.503424 5961 consensus_queue.cc:260] T e70193bd4055469d870a76542eaef524 P 82f93d1d11364ceeb485585b4ae78871 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:56.503772 5956 ts_tablet_manager.cc:1403] T f3d04e9457c944a8a72861680bdf9b7c P dc85be7d460a404f997177f57680850f: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.005s
I20260810 01:58:56.504005 5961 ts_tablet_manager.cc:1434] T e70193bd4055469d870a76542eaef524 P 82f93d1d11364ceeb485585b4ae78871: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 01:58:56.504655 5956 raft_consensus.cc:359] T f3d04e9457c944a8a72861680bdf9b7c P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:56.504884 5956 raft_consensus.cc:385] T f3d04e9457c944a8a72861680bdf9b7c P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:56.505000 5956 raft_consensus.cc:740] T f3d04e9457c944a8a72861680bdf9b7c P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc85be7d460a404f997177f57680850f, State: Initialized, Role: FOLLOWER
I20260810 01:58:56.505299 5956 consensus_queue.cc:260] T f3d04e9457c944a8a72861680bdf9b7c P dc85be7d460a404f997177f57680850f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:56.506716 5956 ts_tablet_manager.cc:1434] T f3d04e9457c944a8a72861680bdf9b7c P dc85be7d460a404f997177f57680850f: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 01:58:56.512279 5414 raft_consensus.cc:493] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:58:56.512458 5414 raft_consensus.cc:515] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 01:58:56.513154 5414 leader_election.cc:290] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893), dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
I20260810 01:58:56.513703 3945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05e147199e44b8ca712e18d22e7cce7" candidate_uuid: "17b49c694faf479ea2e5083470fc0302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f93d1d11364ceeb485585b4ae78871" is_pre_election: true
I20260810 01:58:56.514004 3945 raft_consensus.cc:2468] T d05e147199e44b8ca712e18d22e7cce7 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17b49c694faf479ea2e5083470fc0302 in term 0.
I20260810 01:58:56.514554 4038 leader_election.cc:304] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17b49c694faf479ea2e5083470fc0302, 82f93d1d11364ceeb485585b4ae78871; no voters:
I20260810 01:58:56.515059 5414 raft_consensus.cc:2804] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:58:56.515208 5414 raft_consensus.cc:493] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:58:56.515355 5414 raft_consensus.cc:3060] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:56.517853 5414 raft_consensus.cc:515] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 01:58:56.518507 5414 leader_election.cc:290] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 1 election: Requested vote from peers 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893), dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
I20260810 01:58:56.518834 3945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05e147199e44b8ca712e18d22e7cce7" candidate_uuid: "17b49c694faf479ea2e5083470fc0302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f93d1d11364ceeb485585b4ae78871"
I20260810 01:58:56.519063 3945 raft_consensus.cc:3060] T d05e147199e44b8ca712e18d22e7cce7 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:56.520356 3757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05e147199e44b8ca712e18d22e7cce7" candidate_uuid: "17b49c694faf479ea2e5083470fc0302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc85be7d460a404f997177f57680850f" is_pre_election: true
I20260810 01:58:56.520416 3761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05e147199e44b8ca712e18d22e7cce7" candidate_uuid: "17b49c694faf479ea2e5083470fc0302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc85be7d460a404f997177f57680850f"
I20260810 01:58:56.520605 3757 raft_consensus.cc:2468] T d05e147199e44b8ca712e18d22e7cce7 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17b49c694faf479ea2e5083470fc0302 in term 0.
I20260810 01:58:56.521643 3945 raft_consensus.cc:2468] T d05e147199e44b8ca712e18d22e7cce7 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17b49c694faf479ea2e5083470fc0302 in term 1.
I20260810 01:58:56.522058 4038 leader_election.cc:304] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17b49c694faf479ea2e5083470fc0302, 82f93d1d11364ceeb485585b4ae78871; no voters: dc85be7d460a404f997177f57680850f
I20260810 01:58:56.522364 5414 raft_consensus.cc:2804] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:58:56.522871 5414 raft_consensus.cc:697] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302 [term 1 LEADER]: Becoming Leader. State: Replica: 17b49c694faf479ea2e5083470fc0302, State: Running, Role: LEADER
I20260810 01:58:56.523502 5414 consensus_queue.cc:237] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 01:58:56.526503 3572 catalog_manager.cc:5719] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302 reported cstate change: term changed from 0 to 1, leader changed from <none> to 17b49c694faf479ea2e5083470fc0302 (127.21.64.195). New cstate: current_term: 1 leader_uuid: "17b49c694faf479ea2e5083470fc0302" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } }
I20260810 01:58:56.571578 5414 raft_consensus.cc:493] T f3d04e9457c944a8a72861680bdf9b7c P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:58:56.571794 5414 raft_consensus.cc:515] T f3d04e9457c944a8a72861680bdf9b7c P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:56.572578 5414 leader_election.cc:290] T f3d04e9457c944a8a72861680bdf9b7c P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc85be7d460a404f997177f57680850f (127.21.64.193:36797), ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943)
I20260810 01:58:56.573248 3761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d04e9457c944a8a72861680bdf9b7c" candidate_uuid: "17b49c694faf479ea2e5083470fc0302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc85be7d460a404f997177f57680850f" is_pre_election: true
I20260810 01:58:56.573313 4313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d04e9457c944a8a72861680bdf9b7c" candidate_uuid: "17b49c694faf479ea2e5083470fc0302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" is_pre_election: true
I20260810 01:58:56.573598 3761 raft_consensus.cc:2468] T f3d04e9457c944a8a72861680bdf9b7c P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17b49c694faf479ea2e5083470fc0302 in term 0.
I20260810 01:58:56.573658 4313 raft_consensus.cc:2468] T f3d04e9457c944a8a72861680bdf9b7c P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17b49c694faf479ea2e5083470fc0302 in term 0.
I20260810 01:58:56.574101 4036 leader_election.cc:304] T f3d04e9457c944a8a72861680bdf9b7c P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17b49c694faf479ea2e5083470fc0302, dc85be7d460a404f997177f57680850f; no voters:
I20260810 01:58:56.574410 5414 raft_consensus.cc:2804] T f3d04e9457c944a8a72861680bdf9b7c P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:58:56.574514 5414 raft_consensus.cc:493] T f3d04e9457c944a8a72861680bdf9b7c P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:58:56.574658 5414 raft_consensus.cc:3060] T f3d04e9457c944a8a72861680bdf9b7c P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:56.576718 5414 raft_consensus.cc:515] T f3d04e9457c944a8a72861680bdf9b7c P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:56.577423 5414 leader_election.cc:290] T f3d04e9457c944a8a72861680bdf9b7c P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 1 election: Requested vote from peers dc85be7d460a404f997177f57680850f (127.21.64.193:36797), ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943)
I20260810 01:58:56.577839 3761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d04e9457c944a8a72861680bdf9b7c" candidate_uuid: "17b49c694faf479ea2e5083470fc0302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc85be7d460a404f997177f57680850f"
I20260810 01:58:56.577963 4313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d04e9457c944a8a72861680bdf9b7c" candidate_uuid: "17b49c694faf479ea2e5083470fc0302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca4469fc2dbc48488bc7ad7f482f129e"
I20260810 01:58:56.578099 3761 raft_consensus.cc:3060] T f3d04e9457c944a8a72861680bdf9b7c P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:56.578154 4313 raft_consensus.cc:3060] T f3d04e9457c944a8a72861680bdf9b7c P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:56.581247 3761 raft_consensus.cc:2468] T f3d04e9457c944a8a72861680bdf9b7c P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17b49c694faf479ea2e5083470fc0302 in term 1.
I20260810 01:58:56.581287 4313 raft_consensus.cc:2468] T f3d04e9457c944a8a72861680bdf9b7c P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17b49c694faf479ea2e5083470fc0302 in term 1.
I20260810 01:58:56.581722 4036 leader_election.cc:304] T f3d04e9457c944a8a72861680bdf9b7c P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17b49c694faf479ea2e5083470fc0302, dc85be7d460a404f997177f57680850f; no voters:
I20260810 01:58:56.582016 5414 raft_consensus.cc:2804] T f3d04e9457c944a8a72861680bdf9b7c P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:58:56.582221 5414 raft_consensus.cc:697] T f3d04e9457c944a8a72861680bdf9b7c P 17b49c694faf479ea2e5083470fc0302 [term 1 LEADER]: Becoming Leader. State: Replica: 17b49c694faf479ea2e5083470fc0302, State: Running, Role: LEADER
I20260810 01:58:56.582760 5414 consensus_queue.cc:237] T f3d04e9457c944a8a72861680bdf9b7c P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:56.586122 3572 catalog_manager.cc:5719] T f3d04e9457c944a8a72861680bdf9b7c P 17b49c694faf479ea2e5083470fc0302 reported cstate change: term changed from 0 to 1, leader changed from <none> to 17b49c694faf479ea2e5083470fc0302 (127.21.64.195). New cstate: current_term: 1 leader_uuid: "17b49c694faf479ea2e5083470fc0302" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
I20260810 01:58:56.599268 5414 raft_consensus.cc:493] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:58:56.599506 5414 raft_consensus.cc:515] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:56.600106 5414 leader_election.cc:290] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943), 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 01:58:56.600692 4313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70193bd4055469d870a76542eaef524" candidate_uuid: "17b49c694faf479ea2e5083470fc0302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" is_pre_election: true
I20260810 01:58:56.600772 3945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70193bd4055469d870a76542eaef524" candidate_uuid: "17b49c694faf479ea2e5083470fc0302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f93d1d11364ceeb485585b4ae78871" is_pre_election: true
I20260810 01:58:56.600996 3945 raft_consensus.cc:2468] T e70193bd4055469d870a76542eaef524 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17b49c694faf479ea2e5083470fc0302 in term 0.
I20260810 01:58:56.601023 4313 raft_consensus.cc:2468] T e70193bd4055469d870a76542eaef524 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17b49c694faf479ea2e5083470fc0302 in term 0.
I20260810 01:58:56.601545 4038 leader_election.cc:304] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17b49c694faf479ea2e5083470fc0302, 82f93d1d11364ceeb485585b4ae78871; no voters:
I20260810 01:58:56.601894 5414 raft_consensus.cc:2804] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:58:56.602023 5414 raft_consensus.cc:493] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:58:56.602144 5414 raft_consensus.cc:3060] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:56.605227 5414 raft_consensus.cc:515] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:56.605852 5414 leader_election.cc:290] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 1 election: Requested vote from peers ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943), 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 01:58:56.606381 4313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70193bd4055469d870a76542eaef524" candidate_uuid: "17b49c694faf479ea2e5083470fc0302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca4469fc2dbc48488bc7ad7f482f129e"
I20260810 01:58:56.606594 4313 raft_consensus.cc:3060] T e70193bd4055469d870a76542eaef524 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:56.606825 3945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70193bd4055469d870a76542eaef524" candidate_uuid: "17b49c694faf479ea2e5083470fc0302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f93d1d11364ceeb485585b4ae78871"
I20260810 01:58:56.607049 3945 raft_consensus.cc:3060] T e70193bd4055469d870a76542eaef524 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:56.609790 4313 raft_consensus.cc:2468] T e70193bd4055469d870a76542eaef524 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17b49c694faf479ea2e5083470fc0302 in term 1.
I20260810 01:58:56.610016 3945 raft_consensus.cc:2468] T e70193bd4055469d870a76542eaef524 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17b49c694faf479ea2e5083470fc0302 in term 1.
I20260810 01:58:56.610232 4038 leader_election.cc:304] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17b49c694faf479ea2e5083470fc0302, ca4469fc2dbc48488bc7ad7f482f129e; no voters:
I20260810 01:58:56.610675 5414 raft_consensus.cc:2804] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:58:56.610872 5414 raft_consensus.cc:697] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302 [term 1 LEADER]: Becoming Leader. State: Replica: 17b49c694faf479ea2e5083470fc0302, State: Running, Role: LEADER
I20260810 01:58:56.611142 5414 consensus_queue.cc:237] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:56.614789 3572 catalog_manager.cc:5719] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302 reported cstate change: term changed from 0 to 1, leader changed from <none> to 17b49c694faf479ea2e5083470fc0302 (127.21.64.195). New cstate: current_term: 1 leader_uuid: "17b49c694faf479ea2e5083470fc0302" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 01:58:56.933621 3761 raft_consensus.cc:3060] T d05e147199e44b8ca712e18d22e7cce7 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:56.936748 5414 consensus_queue.cc:1048] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:58:56.946448 5414 consensus_queue.cc:1048] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:58:57.006695 5983 consensus_queue.cc:1048] T f3d04e9457c944a8a72861680bdf9b7c P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:58:57.012199 5983 consensus_queue.cc:1048] T f3d04e9457c944a8a72861680bdf9b7c P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:58:57.015208 5975 consensus_queue.cc:1048] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:58:57.030361 5983 consensus_queue.cc:1048] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 01:58:57.076790 5979 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:58:57.077265 5979 flags.cc:432] Enabled unsafe flag: --never_fsync=true
Using table 'rebalance_test_table_7'
W20260810 01:58:57.292495 4038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.194:43893, user_credentials={real_user=slave}} blocked reactor thread for 45926us
INSERT report
rows total: 2000
time total: 273.372 ms
time per row: 0.136686 ms
-----------------------------------------------------
Suppressions used:
count bytes template
2 596 libcrypto.so.1.1
-----------------------------------------------------
I20260810 01:58:58.686278 3572 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51850:
name: "rebalance_test_table_8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260810 01:58:58.696956 3735 tablet_service.cc:1511] Processing CreateTablet for tablet 252899385eaa45b392974d2768e3cf01 (DEFAULT_TABLE table=rebalance_test_table_8 [id=afa71147917d44a585bcbaa37497a2b1]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:58.697544 3735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 252899385eaa45b392974d2768e3cf01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:58.697620 3920 tablet_service.cc:1511] Processing CreateTablet for tablet 252899385eaa45b392974d2768e3cf01 (DEFAULT_TABLE table=rebalance_test_table_8 [id=afa71147917d44a585bcbaa37497a2b1]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:58.697891 4105 tablet_service.cc:1511] Processing CreateTablet for tablet 252899385eaa45b392974d2768e3cf01 (DEFAULT_TABLE table=rebalance_test_table_8 [id=afa71147917d44a585bcbaa37497a2b1]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:58.698038 3920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 252899385eaa45b392974d2768e3cf01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:58.698427 4105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 252899385eaa45b392974d2768e3cf01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:58.700840 3734 tablet_service.cc:1511] Processing CreateTablet for tablet 4fc45932b9634d6d98d8a0204d4b121a (DEFAULT_TABLE table=rebalance_test_table_8 [id=afa71147917d44a585bcbaa37497a2b1]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:58.700812 4103 tablet_service.cc:1511] Processing CreateTablet for tablet 4fc45932b9634d6d98d8a0204d4b121a (DEFAULT_TABLE table=rebalance_test_table_8 [id=afa71147917d44a585bcbaa37497a2b1]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:58.701259 4103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fc45932b9634d6d98d8a0204d4b121a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:58.701278 3734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fc45932b9634d6d98d8a0204d4b121a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:58.701436 3737 tablet_service.cc:1511] Processing CreateTablet for tablet 4a4350cf2ece4769b8547620ac5bedcb (DEFAULT_TABLE table=rebalance_test_table_8 [id=afa71147917d44a585bcbaa37497a2b1]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:58.701875 3737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a4350cf2ece4769b8547620ac5bedcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:58.705727 3917 tablet_service.cc:1511] Processing CreateTablet for tablet 4a4350cf2ece4769b8547620ac5bedcb (DEFAULT_TABLE table=rebalance_test_table_8 [id=afa71147917d44a585bcbaa37497a2b1]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:58.705905 4284 tablet_service.cc:1511] Processing CreateTablet for tablet 4a4350cf2ece4769b8547620ac5bedcb (DEFAULT_TABLE table=rebalance_test_table_8 [id=afa71147917d44a585bcbaa37497a2b1]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:58.706223 3917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a4350cf2ece4769b8547620ac5bedcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:58.706353 4284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a4350cf2ece4769b8547620ac5bedcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:58.709748 4286 tablet_service.cc:1511] Processing CreateTablet for tablet 4fc45932b9634d6d98d8a0204d4b121a (DEFAULT_TABLE table=rebalance_test_table_8 [id=afa71147917d44a585bcbaa37497a2b1]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:58.710144 4286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fc45932b9634d6d98d8a0204d4b121a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:58.713809 6064 tablet_bootstrap.cc:492] T 252899385eaa45b392974d2768e3cf01 P 17b49c694faf479ea2e5083470fc0302: Bootstrap starting.
I20260810 01:58:58.716053 6064 tablet_bootstrap.cc:654] T 252899385eaa45b392974d2768e3cf01 P 17b49c694faf479ea2e5083470fc0302: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:58.725458 6065 tablet_bootstrap.cc:492] T 252899385eaa45b392974d2768e3cf01 P 82f93d1d11364ceeb485585b4ae78871: Bootstrap starting.
I20260810 01:58:58.728199 6065 tablet_bootstrap.cc:654] T 252899385eaa45b392974d2768e3cf01 P 82f93d1d11364ceeb485585b4ae78871: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:58.728368 6069 tablet_bootstrap.cc:492] T 4a4350cf2ece4769b8547620ac5bedcb P dc85be7d460a404f997177f57680850f: Bootstrap starting.
I20260810 01:58:58.730123 6064 tablet_bootstrap.cc:492] T 252899385eaa45b392974d2768e3cf01 P 17b49c694faf479ea2e5083470fc0302: No bootstrap required, opened a new log
I20260810 01:58:58.730371 6064 ts_tablet_manager.cc:1403] T 252899385eaa45b392974d2768e3cf01 P 17b49c694faf479ea2e5083470fc0302: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.009s
I20260810 01:58:58.730729 6069 tablet_bootstrap.cc:654] T 4a4350cf2ece4769b8547620ac5bedcb P dc85be7d460a404f997177f57680850f: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:58.731638 6064 raft_consensus.cc:359] T 252899385eaa45b392974d2768e3cf01 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:58.731907 6064 raft_consensus.cc:385] T 252899385eaa45b392974d2768e3cf01 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:58.732084 6064 raft_consensus.cc:740] T 252899385eaa45b392974d2768e3cf01 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17b49c694faf479ea2e5083470fc0302, State: Initialized, Role: FOLLOWER
I20260810 01:58:58.732547 6064 consensus_queue.cc:260] T 252899385eaa45b392974d2768e3cf01 P 17b49c694faf479ea2e5083470fc0302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:58.733366 6064 ts_tablet_manager.cc:1434] T 252899385eaa45b392974d2768e3cf01 P 17b49c694faf479ea2e5083470fc0302: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 01:58:58.734483 6064 tablet_bootstrap.cc:492] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302: Bootstrap starting.
I20260810 01:58:58.738453 6064 tablet_bootstrap.cc:654] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:58.739590 6065 tablet_bootstrap.cc:492] T 252899385eaa45b392974d2768e3cf01 P 82f93d1d11364ceeb485585b4ae78871: No bootstrap required, opened a new log
I20260810 01:58:58.739828 6065 ts_tablet_manager.cc:1403] T 252899385eaa45b392974d2768e3cf01 P 82f93d1d11364ceeb485585b4ae78871: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.007s
I20260810 01:58:58.740379 6068 tablet_bootstrap.cc:492] T 4fc45932b9634d6d98d8a0204d4b121a P ca4469fc2dbc48488bc7ad7f482f129e: Bootstrap starting.
I20260810 01:58:58.740764 6065 raft_consensus.cc:359] T 252899385eaa45b392974d2768e3cf01 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:58.741067 6065 raft_consensus.cc:385] T 252899385eaa45b392974d2768e3cf01 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:58.741258 6065 raft_consensus.cc:740] T 252899385eaa45b392974d2768e3cf01 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f93d1d11364ceeb485585b4ae78871, State: Initialized, Role: FOLLOWER
I20260810 01:58:58.741638 6065 consensus_queue.cc:260] T 252899385eaa45b392974d2768e3cf01 P 82f93d1d11364ceeb485585b4ae78871 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:58.743191 6065 ts_tablet_manager.cc:1434] T 252899385eaa45b392974d2768e3cf01 P 82f93d1d11364ceeb485585b4ae78871: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260810 01:58:58.743562 6065 tablet_bootstrap.cc:492] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871: Bootstrap starting.
I20260810 01:58:58.742987 6068 tablet_bootstrap.cc:654] T 4fc45932b9634d6d98d8a0204d4b121a P ca4469fc2dbc48488bc7ad7f482f129e: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:58.752041 6065 tablet_bootstrap.cc:654] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:58.752648 6069 tablet_bootstrap.cc:492] T 4a4350cf2ece4769b8547620ac5bedcb P dc85be7d460a404f997177f57680850f: No bootstrap required, opened a new log
I20260810 01:58:58.752904 6069 ts_tablet_manager.cc:1403] T 4a4350cf2ece4769b8547620ac5bedcb P dc85be7d460a404f997177f57680850f: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.018s
I20260810 01:58:58.754042 6069 raft_consensus.cc:359] T 4a4350cf2ece4769b8547620ac5bedcb P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:58.754319 6069 raft_consensus.cc:385] T 4a4350cf2ece4769b8547620ac5bedcb P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:58.754484 6069 raft_consensus.cc:740] T 4a4350cf2ece4769b8547620ac5bedcb P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc85be7d460a404f997177f57680850f, State: Initialized, Role: FOLLOWER
I20260810 01:58:58.754806 6069 consensus_queue.cc:260] T 4a4350cf2ece4769b8547620ac5bedcb P dc85be7d460a404f997177f57680850f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:58.755455 6069 ts_tablet_manager.cc:1434] T 4a4350cf2ece4769b8547620ac5bedcb P dc85be7d460a404f997177f57680850f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:58:58.755854 6069 tablet_bootstrap.cc:492] T 4fc45932b9634d6d98d8a0204d4b121a P dc85be7d460a404f997177f57680850f: Bootstrap starting.
I20260810 01:58:58.757382 6068 tablet_bootstrap.cc:492] T 4fc45932b9634d6d98d8a0204d4b121a P ca4469fc2dbc48488bc7ad7f482f129e: No bootstrap required, opened a new log
I20260810 01:58:58.757642 6068 ts_tablet_manager.cc:1403] T 4fc45932b9634d6d98d8a0204d4b121a P ca4469fc2dbc48488bc7ad7f482f129e: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.007s
I20260810 01:58:58.758023 6065 tablet_bootstrap.cc:492] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871: No bootstrap required, opened a new log
I20260810 01:58:58.758213 6065 ts_tablet_manager.cc:1403] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.007s
I20260810 01:58:58.758872 6069 tablet_bootstrap.cc:654] T 4fc45932b9634d6d98d8a0204d4b121a P dc85be7d460a404f997177f57680850f: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:58.759064 6065 raft_consensus.cc:359] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:58.759027 6068 raft_consensus.cc:359] T 4fc45932b9634d6d98d8a0204d4b121a P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:58.759264 6068 raft_consensus.cc:385] T 4fc45932b9634d6d98d8a0204d4b121a P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:58.759335 6065 raft_consensus.cc:385] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:58.759426 6065 raft_consensus.cc:740] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f93d1d11364ceeb485585b4ae78871, State: Initialized, Role: FOLLOWER
I20260810 01:58:58.759534 6068 raft_consensus.cc:740] T 4fc45932b9634d6d98d8a0204d4b121a P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca4469fc2dbc48488bc7ad7f482f129e, State: Initialized, Role: FOLLOWER
I20260810 01:58:58.759727 6065 consensus_queue.cc:260] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:58.760010 6068 consensus_queue.cc:260] T 4fc45932b9634d6d98d8a0204d4b121a P ca4469fc2dbc48488bc7ad7f482f129e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:58.760344 6065 ts_tablet_manager.cc:1434] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:58:58.760738 6068 ts_tablet_manager.cc:1434] T 4fc45932b9634d6d98d8a0204d4b121a P ca4469fc2dbc48488bc7ad7f482f129e: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260810 01:58:58.761126 6068 tablet_bootstrap.cc:492] T 4a4350cf2ece4769b8547620ac5bedcb P ca4469fc2dbc48488bc7ad7f482f129e: Bootstrap starting.
I20260810 01:58:58.763767 6068 tablet_bootstrap.cc:654] T 4a4350cf2ece4769b8547620ac5bedcb P ca4469fc2dbc48488bc7ad7f482f129e: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:58.763836 6042 raft_consensus.cc:493] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:58:58.763990 6042 raft_consensus.cc:515] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:58.764768 6042 leader_election.cc:290] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943), dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
I20260810 01:58:58.765005 6064 tablet_bootstrap.cc:492] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302: No bootstrap required, opened a new log
I20260810 01:58:58.765219 6064 ts_tablet_manager.cc:1403] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302: Time spent bootstrapping tablet: real 0.031s user 0.004s sys 0.014s
I20260810 01:58:58.765483 3761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4350cf2ece4769b8547620ac5bedcb" candidate_uuid: "82f93d1d11364ceeb485585b4ae78871" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc85be7d460a404f997177f57680850f" is_pre_election: true
I20260810 01:58:58.766222 6064 raft_consensus.cc:359] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:58.766577 6064 raft_consensus.cc:385] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:58.766741 6064 raft_consensus.cc:740] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17b49c694faf479ea2e5083470fc0302, State: Initialized, Role: FOLLOWER
I20260810 01:58:58.766789 3761 raft_consensus.cc:2468] T 4a4350cf2ece4769b8547620ac5bedcb P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82f93d1d11364ceeb485585b4ae78871 in term 0.
I20260810 01:58:58.767084 6064 consensus_queue.cc:260] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:58.767369 3855 leader_election.cc:304] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82f93d1d11364ceeb485585b4ae78871, dc85be7d460a404f997177f57680850f; no voters:
I20260810 01:58:58.767705 6064 ts_tablet_manager.cc:1434] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:58:58.767813 6042 raft_consensus.cc:2804] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:58:58.767922 6042 raft_consensus.cc:493] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:58:58.768008 6042 raft_consensus.cc:3060] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:58.769273 4310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4350cf2ece4769b8547620ac5bedcb" candidate_uuid: "82f93d1d11364ceeb485585b4ae78871" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" is_pre_election: true
I20260810 01:58:58.771925 6069 tablet_bootstrap.cc:492] T 4fc45932b9634d6d98d8a0204d4b121a P dc85be7d460a404f997177f57680850f: No bootstrap required, opened a new log
I20260810 01:58:58.771862 6042 raft_consensus.cc:515] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:58.772154 6069 ts_tablet_manager.cc:1403] T 4fc45932b9634d6d98d8a0204d4b121a P dc85be7d460a404f997177f57680850f: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.004s
W20260810 01:58:58.772029 3857 leader_election.cc:343] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): Illegal state: must be running to vote when last-logged opid is not known
I20260810 01:58:58.773061 4310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4350cf2ece4769b8547620ac5bedcb" candidate_uuid: "82f93d1d11364ceeb485585b4ae78871" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca4469fc2dbc48488bc7ad7f482f129e"
I20260810 01:58:58.773074 6069 raft_consensus.cc:359] T 4fc45932b9634d6d98d8a0204d4b121a P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:58.773272 6069 raft_consensus.cc:385] T 4fc45932b9634d6d98d8a0204d4b121a P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:58.773379 6069 raft_consensus.cc:740] T 4fc45932b9634d6d98d8a0204d4b121a P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc85be7d460a404f997177f57680850f, State: Initialized, Role: FOLLOWER
I20260810 01:58:58.773721 6069 consensus_queue.cc:260] T 4fc45932b9634d6d98d8a0204d4b121a P dc85be7d460a404f997177f57680850f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
W20260810 01:58:58.773813 3857 leader_election.cc:343] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): Illegal state: must be running to vote when last-logged opid is not known
I20260810 01:58:58.774628 3761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4350cf2ece4769b8547620ac5bedcb" candidate_uuid: "82f93d1d11364ceeb485585b4ae78871" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc85be7d460a404f997177f57680850f"
I20260810 01:58:58.774833 3761 raft_consensus.cc:3060] T 4a4350cf2ece4769b8547620ac5bedcb P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:58.778084 3761 raft_consensus.cc:2468] T 4a4350cf2ece4769b8547620ac5bedcb P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82f93d1d11364ceeb485585b4ae78871 in term 1.
I20260810 01:58:58.779347 6069 ts_tablet_manager.cc:1434] T 4fc45932b9634d6d98d8a0204d4b121a P dc85be7d460a404f997177f57680850f: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260810 01:58:58.780361 3855 leader_election.cc:304] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 82f93d1d11364ceeb485585b4ae78871, dc85be7d460a404f997177f57680850f; no voters: ca4469fc2dbc48488bc7ad7f482f129e
I20260810 01:58:58.780510 6069 tablet_bootstrap.cc:492] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f: Bootstrap starting.
I20260810 01:58:58.781963 6042 leader_election.cc:290] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [CANDIDATE]: Term 1 election: Requested vote from peers ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943), dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
I20260810 01:58:58.782501 6042 raft_consensus.cc:2804] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:58:58.783396 6042 raft_consensus.cc:697] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Becoming Leader. State: Replica: 82f93d1d11364ceeb485585b4ae78871, State: Running, Role: LEADER
I20260810 01:58:58.783954 6042 consensus_queue.cc:237] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:58.784335 6069 tablet_bootstrap.cc:654] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:58.791793 6068 tablet_bootstrap.cc:492] T 4a4350cf2ece4769b8547620ac5bedcb P ca4469fc2dbc48488bc7ad7f482f129e: No bootstrap required, opened a new log
I20260810 01:58:58.792042 6068 ts_tablet_manager.cc:1403] T 4a4350cf2ece4769b8547620ac5bedcb P ca4469fc2dbc48488bc7ad7f482f129e: Time spent bootstrapping tablet: real 0.031s user 0.008s sys 0.016s
I20260810 01:58:58.793071 6068 raft_consensus.cc:359] T 4a4350cf2ece4769b8547620ac5bedcb P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:58.793567 6068 raft_consensus.cc:385] T 4a4350cf2ece4769b8547620ac5bedcb P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:58.793723 6068 raft_consensus.cc:740] T 4a4350cf2ece4769b8547620ac5bedcb P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca4469fc2dbc48488bc7ad7f482f129e, State: Initialized, Role: FOLLOWER
I20260810 01:58:58.794103 6069 tablet_bootstrap.cc:492] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f: No bootstrap required, opened a new log
I20260810 01:58:58.794070 6068 consensus_queue.cc:260] T 4a4350cf2ece4769b8547620ac5bedcb P ca4469fc2dbc48488bc7ad7f482f129e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:58.794337 6069 ts_tablet_manager.cc:1403] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.006s
I20260810 01:58:58.795262 6069 raft_consensus.cc:359] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:58.795521 6069 raft_consensus.cc:385] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:58.795696 6069 raft_consensus.cc:740] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc85be7d460a404f997177f57680850f, State: Initialized, Role: FOLLOWER
I20260810 01:58:58.795851 3568 catalog_manager.cc:5719] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 reported cstate change: term changed from 0 to 1, leader changed from <none> to 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194). New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 01:58:58.796057 6069 consensus_queue.cc:260] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:58.796746 6069 ts_tablet_manager.cc:1434] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:58:58.797355 6068 ts_tablet_manager.cc:1434] T 4a4350cf2ece4769b8547620ac5bedcb P ca4469fc2dbc48488bc7ad7f482f129e: Time spent starting tablet: real 0.005s user 0.001s sys 0.002s
I20260810 01:58:58.852473 6056 raft_consensus.cc:493] T 4a4350cf2ece4769b8547620ac5bedcb P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:58:58.852660 6056 raft_consensus.cc:515] T 4a4350cf2ece4769b8547620ac5bedcb P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:58.853451 6056 leader_election.cc:290] T 4a4350cf2ece4769b8547620ac5bedcb P ca4469fc2dbc48488bc7ad7f482f129e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc85be7d460a404f997177f57680850f (127.21.64.193:36797), 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 01:58:58.853973 3761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4350cf2ece4769b8547620ac5bedcb" candidate_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc85be7d460a404f997177f57680850f" is_pre_election: true
I20260810 01:58:58.854269 3944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4350cf2ece4769b8547620ac5bedcb" candidate_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f93d1d11364ceeb485585b4ae78871" is_pre_election: true
I20260810 01:58:58.854414 3761 raft_consensus.cc:2393] T 4a4350cf2ece4769b8547620ac5bedcb P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca4469fc2dbc48488bc7ad7f482f129e in current term 1: Already voted for candidate 82f93d1d11364ceeb485585b4ae78871 in this term.
I20260810 01:58:58.855042 4219 leader_election.cc:304] T 4a4350cf2ece4769b8547620ac5bedcb P ca4469fc2dbc48488bc7ad7f482f129e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca4469fc2dbc48488bc7ad7f482f129e; no voters: 82f93d1d11364ceeb485585b4ae78871, dc85be7d460a404f997177f57680850f
I20260810 01:58:58.855367 6056 raft_consensus.cc:3060] T 4a4350cf2ece4769b8547620ac5bedcb P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:58.857653 6056 raft_consensus.cc:2749] T 4a4350cf2ece4769b8547620ac5bedcb P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 01:58:58.978012 5762 raft_consensus.cc:493] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:58:58.978232 5762 raft_consensus.cc:515] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:58.978961 5762 leader_election.cc:290] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893), 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189)
I20260810 01:58:58.979648 4129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252899385eaa45b392974d2768e3cf01" candidate_uuid: "dc85be7d460a404f997177f57680850f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17b49c694faf479ea2e5083470fc0302" is_pre_election: true
I20260810 01:58:58.979656 3944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252899385eaa45b392974d2768e3cf01" candidate_uuid: "dc85be7d460a404f997177f57680850f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f93d1d11364ceeb485585b4ae78871" is_pre_election: true
I20260810 01:58:58.979874 4129 raft_consensus.cc:2468] T 252899385eaa45b392974d2768e3cf01 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc85be7d460a404f997177f57680850f in term 0.
I20260810 01:58:58.979897 3944 raft_consensus.cc:2468] T 252899385eaa45b392974d2768e3cf01 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc85be7d460a404f997177f57680850f in term 0.
I20260810 01:58:58.980371 3672 leader_election.cc:304] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82f93d1d11364ceeb485585b4ae78871, dc85be7d460a404f997177f57680850f; no voters:
I20260810 01:58:58.980675 5762 raft_consensus.cc:2804] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:58:58.980762 5762 raft_consensus.cc:493] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:58:58.980924 5762 raft_consensus.cc:3060] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:58.983180 5762 raft_consensus.cc:515] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:58.983822 5762 leader_election.cc:290] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [CANDIDATE]: Term 1 election: Requested vote from peers 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893), 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189)
I20260810 01:58:58.984365 4129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252899385eaa45b392974d2768e3cf01" candidate_uuid: "dc85be7d460a404f997177f57680850f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17b49c694faf479ea2e5083470fc0302"
I20260810 01:58:58.984338 3944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252899385eaa45b392974d2768e3cf01" candidate_uuid: "dc85be7d460a404f997177f57680850f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f93d1d11364ceeb485585b4ae78871"
I20260810 01:58:58.984575 4129 raft_consensus.cc:3060] T 252899385eaa45b392974d2768e3cf01 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:58.984575 3944 raft_consensus.cc:3060] T 252899385eaa45b392974d2768e3cf01 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:58.987769 3944 raft_consensus.cc:2468] T 252899385eaa45b392974d2768e3cf01 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc85be7d460a404f997177f57680850f in term 1.
I20260810 01:58:58.987771 4129 raft_consensus.cc:2468] T 252899385eaa45b392974d2768e3cf01 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc85be7d460a404f997177f57680850f in term 1.
I20260810 01:58:58.988260 3672 leader_election.cc:304] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82f93d1d11364ceeb485585b4ae78871, dc85be7d460a404f997177f57680850f; no voters:
I20260810 01:58:58.988610 5762 raft_consensus.cc:2804] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:58:58.989064 5762 raft_consensus.cc:697] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Becoming Leader. State: Replica: dc85be7d460a404f997177f57680850f, State: Running, Role: LEADER
I20260810 01:58:58.989449 5762 consensus_queue.cc:237] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:58:58.992404 3572 catalog_manager.cc:5719] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f reported cstate change: term changed from 0 to 1, leader changed from <none> to dc85be7d460a404f997177f57680850f (127.21.64.193). New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } }
I20260810 01:58:59.014560 5983 raft_consensus.cc:493] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:58:59.014783 5983 raft_consensus.cc:515] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:59.015523 5983 leader_election.cc:290] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc85be7d460a404f997177f57680850f (127.21.64.193:36797), ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943)
I20260810 01:58:59.015981 3761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc45932b9634d6d98d8a0204d4b121a" candidate_uuid: "17b49c694faf479ea2e5083470fc0302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc85be7d460a404f997177f57680850f" is_pre_election: true
I20260810 01:58:59.016196 3761 raft_consensus.cc:2468] T 4fc45932b9634d6d98d8a0204d4b121a P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17b49c694faf479ea2e5083470fc0302 in term 0.
I20260810 01:58:59.016152 4310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc45932b9634d6d98d8a0204d4b121a" candidate_uuid: "17b49c694faf479ea2e5083470fc0302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" is_pre_election: true
I20260810 01:58:59.016405 4310 raft_consensus.cc:2468] T 4fc45932b9634d6d98d8a0204d4b121a P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17b49c694faf479ea2e5083470fc0302 in term 0.
I20260810 01:58:59.016829 4036 leader_election.cc:304] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17b49c694faf479ea2e5083470fc0302, dc85be7d460a404f997177f57680850f; no voters:
I20260810 01:58:59.017199 5983 raft_consensus.cc:2804] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:58:59.017325 5983 raft_consensus.cc:493] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:58:59.017508 5983 raft_consensus.cc:3060] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:59.020607 5983 raft_consensus.cc:515] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:59.021281 5983 leader_election.cc:290] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 1 election: Requested vote from peers dc85be7d460a404f997177f57680850f (127.21.64.193:36797), ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943)
I20260810 01:58:59.021713 3761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc45932b9634d6d98d8a0204d4b121a" candidate_uuid: "17b49c694faf479ea2e5083470fc0302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc85be7d460a404f997177f57680850f"
I20260810 01:58:59.021908 3761 raft_consensus.cc:3060] T 4fc45932b9634d6d98d8a0204d4b121a P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:59.021881 4310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc45932b9634d6d98d8a0204d4b121a" candidate_uuid: "17b49c694faf479ea2e5083470fc0302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca4469fc2dbc48488bc7ad7f482f129e"
I20260810 01:58:59.022096 4310 raft_consensus.cc:3060] T 4fc45932b9634d6d98d8a0204d4b121a P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:58:59.024302 4310 raft_consensus.cc:2468] T 4fc45932b9634d6d98d8a0204d4b121a P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17b49c694faf479ea2e5083470fc0302 in term 1.
I20260810 01:58:59.024752 4038 leader_election.cc:304] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17b49c694faf479ea2e5083470fc0302, ca4469fc2dbc48488bc7ad7f482f129e; no voters:
I20260810 01:58:59.025085 5983 raft_consensus.cc:2804] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:58:59.025164 3761 raft_consensus.cc:2468] T 4fc45932b9634d6d98d8a0204d4b121a P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17b49c694faf479ea2e5083470fc0302 in term 1.
I20260810 01:58:59.025271 5983 raft_consensus.cc:697] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [term 1 LEADER]: Becoming Leader. State: Replica: 17b49c694faf479ea2e5083470fc0302, State: Running, Role: LEADER
I20260810 01:58:59.025940 5983 consensus_queue.cc:237] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:59.029271 3572 catalog_manager.cc:5719] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 reported cstate change: term changed from 0 to 1, leader changed from <none> to 17b49c694faf479ea2e5083470fc0302 (127.21.64.195). New cstate: current_term: 1 leader_uuid: "17b49c694faf479ea2e5083470fc0302" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
I20260810 01:58:59.288076 6084 consensus_queue.cc:1048] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:58:59.296008 6084 consensus_queue.cc:1048] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:58:59.415091 6085 consensus_queue.cc:1048] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:58:59.415266 5983 consensus_queue.cc:1048] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:58:59.432139 5762 consensus_queue.cc:1048] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:58:59.442830 6076 consensus_queue.cc:1048] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 01:58:59.497740 6088 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:58:59.498072 6088 flags.cc:432] Enabled unsafe flag: --never_fsync=true
Using table 'rebalance_test_table_8'
INSERT report
rows total: 2000
time total: 232.25 ms
time per row: 0.116125 ms
I20260810 01:58:59.907603 3568 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51850:
name: "rebalance_test_table_9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260810 01:58:59.917646 3917 tablet_service.cc:1511] Processing CreateTablet for tablet 5528e3ba51a640eaa614f141440bb90b (DEFAULT_TABLE table=rebalance_test_table_9 [id=372310cb713644ada1071e8eb628b0c9]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:59.917918 4103 tablet_service.cc:1511] Processing CreateTablet for tablet 5528e3ba51a640eaa614f141440bb90b (DEFAULT_TABLE table=rebalance_test_table_9 [id=372310cb713644ada1071e8eb628b0c9]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:59.918195 3917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5528e3ba51a640eaa614f141440bb90b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:59.918251 4286 tablet_service.cc:1511] Processing CreateTablet for tablet 5528e3ba51a640eaa614f141440bb90b (DEFAULT_TABLE table=rebalance_test_table_9 [id=372310cb713644ada1071e8eb628b0c9]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:59.918411 4103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5528e3ba51a640eaa614f141440bb90b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:59.918746 4286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5528e3ba51a640eaa614f141440bb90b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:59.920920 4102 tablet_service.cc:1511] Processing CreateTablet for tablet 389d3abfeadd4fe6a4efa74427d71c4d (DEFAULT_TABLE table=rebalance_test_table_9 [id=372310cb713644ada1071e8eb628b0c9]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:59.921372 4102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 389d3abfeadd4fe6a4efa74427d71c4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:59.921272 4105 tablet_service.cc:1511] Processing CreateTablet for tablet 8e8d13caf8054b1daf09b2b114843766 (DEFAULT_TABLE table=rebalance_test_table_9 [id=372310cb713644ada1071e8eb628b0c9]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:59.921701 4105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e8d13caf8054b1daf09b2b114843766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:59.924463 3735 tablet_service.cc:1511] Processing CreateTablet for tablet 389d3abfeadd4fe6a4efa74427d71c4d (DEFAULT_TABLE table=rebalance_test_table_9 [id=372310cb713644ada1071e8eb628b0c9]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:59.924975 3735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 389d3abfeadd4fe6a4efa74427d71c4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:59.935683 3920 tablet_service.cc:1511] Processing CreateTablet for tablet 8e8d13caf8054b1daf09b2b114843766 (DEFAULT_TABLE table=rebalance_test_table_9 [id=372310cb713644ada1071e8eb628b0c9]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:59.935758 3916 tablet_service.cc:1511] Processing CreateTablet for tablet 389d3abfeadd4fe6a4efa74427d71c4d (DEFAULT_TABLE table=rebalance_test_table_9 [id=372310cb713644ada1071e8eb628b0c9]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:59.935781 4284 tablet_service.cc:1511] Processing CreateTablet for tablet 8e8d13caf8054b1daf09b2b114843766 (DEFAULT_TABLE table=rebalance_test_table_9 [id=372310cb713644ada1071e8eb628b0c9]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260810 01:58:59.936060 6178 tablet_bootstrap.cc:492] T 8e8d13caf8054b1daf09b2b114843766 P 17b49c694faf479ea2e5083470fc0302: Bootstrap starting.
I20260810 01:58:59.936242 4284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e8d13caf8054b1daf09b2b114843766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:59.936307 3920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e8d13caf8054b1daf09b2b114843766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:59.938195 6178 tablet_bootstrap.cc:654] T 8e8d13caf8054b1daf09b2b114843766 P 17b49c694faf479ea2e5083470fc0302: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:59.941670 3916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 389d3abfeadd4fe6a4efa74427d71c4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:58:59.950073 6176 tablet_bootstrap.cc:492] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871: Bootstrap starting.
I20260810 01:58:59.950754 6180 tablet_bootstrap.cc:492] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f: Bootstrap starting.
I20260810 01:58:59.951624 6179 tablet_bootstrap.cc:492] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e: Bootstrap starting.
I20260810 01:58:59.954001 6180 tablet_bootstrap.cc:654] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:59.954157 6179 tablet_bootstrap.cc:654] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:59.954973 6176 tablet_bootstrap.cc:654] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:59.957320 6178 tablet_bootstrap.cc:492] T 8e8d13caf8054b1daf09b2b114843766 P 17b49c694faf479ea2e5083470fc0302: No bootstrap required, opened a new log
I20260810 01:58:59.957566 6178 ts_tablet_manager.cc:1403] T 8e8d13caf8054b1daf09b2b114843766 P 17b49c694faf479ea2e5083470fc0302: Time spent bootstrapping tablet: real 0.023s user 0.011s sys 0.009s
I20260810 01:58:59.958319 6180 tablet_bootstrap.cc:492] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f: No bootstrap required, opened a new log
I20260810 01:58:59.958601 6180 ts_tablet_manager.cc:1403] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260810 01:58:59.958634 6178 raft_consensus.cc:359] T 8e8d13caf8054b1daf09b2b114843766 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:59.958806 6179 tablet_bootstrap.cc:492] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e: No bootstrap required, opened a new log
I20260810 01:58:59.958899 6178 raft_consensus.cc:385] T 8e8d13caf8054b1daf09b2b114843766 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:59.958988 6179 ts_tablet_manager.cc:1403] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.000s
I20260810 01:58:59.959018 6178 raft_consensus.cc:740] T 8e8d13caf8054b1daf09b2b114843766 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17b49c694faf479ea2e5083470fc0302, State: Initialized, Role: FOLLOWER
I20260810 01:58:59.959276 6176 tablet_bootstrap.cc:492] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871: No bootstrap required, opened a new log
I20260810 01:58:59.959308 6178 consensus_queue.cc:260] T 8e8d13caf8054b1daf09b2b114843766 P 17b49c694faf479ea2e5083470fc0302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:59.959477 6176 ts_tablet_manager.cc:1403] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.006s
I20260810 01:58:59.959558 6180 raft_consensus.cc:359] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:59.959831 6180 raft_consensus.cc:385] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:59.959973 6180 raft_consensus.cc:740] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc85be7d460a404f997177f57680850f, State: Initialized, Role: FOLLOWER
I20260810 01:58:59.960114 6179 raft_consensus.cc:359] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:59.960376 6179 raft_consensus.cc:385] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:59.960258 6180 consensus_queue.cc:260] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:59.960525 6179 raft_consensus.cc:740] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca4469fc2dbc48488bc7ad7f482f129e, State: Initialized, Role: FOLLOWER
I20260810 01:58:59.960881 6179 consensus_queue.cc:260] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:59.961089 6180 ts_tablet_manager.cc:1434] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:58:59.961767 6178 ts_tablet_manager.cc:1434] T 8e8d13caf8054b1daf09b2b114843766 P 17b49c694faf479ea2e5083470fc0302: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260810 01:58:59.962102 6178 tablet_bootstrap.cc:492] T 389d3abfeadd4fe6a4efa74427d71c4d P 17b49c694faf479ea2e5083470fc0302: Bootstrap starting.
I20260810 01:58:59.962244 6179 ts_tablet_manager.cc:1434] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 01:58:59.962598 6179 tablet_bootstrap.cc:492] T 8e8d13caf8054b1daf09b2b114843766 P ca4469fc2dbc48488bc7ad7f482f129e: Bootstrap starting.
I20260810 01:58:59.960500 6176 raft_consensus.cc:359] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:59.962988 6176 raft_consensus.cc:385] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:59.963224 6176 raft_consensus.cc:740] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f93d1d11364ceeb485585b4ae78871, State: Initialized, Role: FOLLOWER
I20260810 01:58:59.963457 6176 consensus_queue.cc:260] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:59.964171 6176 ts_tablet_manager.cc:1434] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260810 01:58:59.965734 6176 tablet_bootstrap.cc:492] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871: Bootstrap starting.
I20260810 01:58:59.967046 6178 tablet_bootstrap.cc:654] T 389d3abfeadd4fe6a4efa74427d71c4d P 17b49c694faf479ea2e5083470fc0302: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:59.967474 6176 tablet_bootstrap.cc:654] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:59.971015 6179 tablet_bootstrap.cc:654] T 8e8d13caf8054b1daf09b2b114843766 P ca4469fc2dbc48488bc7ad7f482f129e: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:59.977751 6179 tablet_bootstrap.cc:492] T 8e8d13caf8054b1daf09b2b114843766 P ca4469fc2dbc48488bc7ad7f482f129e: No bootstrap required, opened a new log
I20260810 01:58:59.977931 6176 tablet_bootstrap.cc:492] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871: No bootstrap required, opened a new log
I20260810 01:58:59.977939 6179 ts_tablet_manager.cc:1403] T 8e8d13caf8054b1daf09b2b114843766 P ca4469fc2dbc48488bc7ad7f482f129e: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.004s
I20260810 01:58:59.978099 6176 ts_tablet_manager.cc:1403] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.011s
I20260810 01:58:59.978770 6179 raft_consensus.cc:359] T 8e8d13caf8054b1daf09b2b114843766 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:59.978976 6178 tablet_bootstrap.cc:492] T 389d3abfeadd4fe6a4efa74427d71c4d P 17b49c694faf479ea2e5083470fc0302: No bootstrap required, opened a new log
I20260810 01:58:59.979029 6179 raft_consensus.cc:385] T 8e8d13caf8054b1daf09b2b114843766 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:59.978871 6176 raft_consensus.cc:359] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:59.979122 6179 raft_consensus.cc:740] T 8e8d13caf8054b1daf09b2b114843766 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca4469fc2dbc48488bc7ad7f482f129e, State: Initialized, Role: FOLLOWER
I20260810 01:58:59.979178 6178 ts_tablet_manager.cc:1403] T 389d3abfeadd4fe6a4efa74427d71c4d P 17b49c694faf479ea2e5083470fc0302: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.005s
I20260810 01:58:59.979243 6176 raft_consensus.cc:385] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:59.979324 6176 raft_consensus.cc:740] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f93d1d11364ceeb485585b4ae78871, State: Initialized, Role: FOLLOWER
I20260810 01:58:59.979430 6179 consensus_queue.cc:260] T 8e8d13caf8054b1daf09b2b114843766 P ca4469fc2dbc48488bc7ad7f482f129e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:59.979620 6176 consensus_queue.cc:260] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:59.980242 6176 ts_tablet_manager.cc:1434] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 01:58:59.980165 6178 raft_consensus.cc:359] T 389d3abfeadd4fe6a4efa74427d71c4d P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:59.980383 6178 raft_consensus.cc:385] T 389d3abfeadd4fe6a4efa74427d71c4d P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:59.980547 6176 tablet_bootstrap.cc:492] T 389d3abfeadd4fe6a4efa74427d71c4d P 82f93d1d11364ceeb485585b4ae78871: Bootstrap starting.
I20260810 01:58:59.980607 6178 raft_consensus.cc:740] T 389d3abfeadd4fe6a4efa74427d71c4d P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17b49c694faf479ea2e5083470fc0302, State: Initialized, Role: FOLLOWER
I20260810 01:58:59.980888 6179 ts_tablet_manager.cc:1434] T 8e8d13caf8054b1daf09b2b114843766 P ca4469fc2dbc48488bc7ad7f482f129e: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260810 01:58:59.981196 6178 consensus_queue.cc:260] T 389d3abfeadd4fe6a4efa74427d71c4d P 17b49c694faf479ea2e5083470fc0302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:59.982404 6176 tablet_bootstrap.cc:654] T 389d3abfeadd4fe6a4efa74427d71c4d P 82f93d1d11364ceeb485585b4ae78871: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:59.982681 6178 ts_tablet_manager.cc:1434] T 389d3abfeadd4fe6a4efa74427d71c4d P 17b49c694faf479ea2e5083470fc0302: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260810 01:58:59.983810 6178 tablet_bootstrap.cc:492] T 5528e3ba51a640eaa614f141440bb90b P 17b49c694faf479ea2e5083470fc0302: Bootstrap starting.
I20260810 01:58:59.987142 6178 tablet_bootstrap.cc:654] T 5528e3ba51a640eaa614f141440bb90b P 17b49c694faf479ea2e5083470fc0302: Neither blocks nor log segments found. Creating new log.
I20260810 01:58:59.987484 6176 tablet_bootstrap.cc:492] T 389d3abfeadd4fe6a4efa74427d71c4d P 82f93d1d11364ceeb485585b4ae78871: No bootstrap required, opened a new log
I20260810 01:58:59.987648 6176 ts_tablet_manager.cc:1403] T 389d3abfeadd4fe6a4efa74427d71c4d P 82f93d1d11364ceeb485585b4ae78871: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260810 01:58:59.988610 6176 raft_consensus.cc:359] T 389d3abfeadd4fe6a4efa74427d71c4d P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:59.988893 6176 raft_consensus.cc:385] T 389d3abfeadd4fe6a4efa74427d71c4d P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:59.989013 6176 raft_consensus.cc:740] T 389d3abfeadd4fe6a4efa74427d71c4d P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f93d1d11364ceeb485585b4ae78871, State: Initialized, Role: FOLLOWER
I20260810 01:58:59.989297 6176 consensus_queue.cc:260] T 389d3abfeadd4fe6a4efa74427d71c4d P 82f93d1d11364ceeb485585b4ae78871 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:58:59.990031 6176 ts_tablet_manager.cc:1434] T 389d3abfeadd4fe6a4efa74427d71c4d P 82f93d1d11364ceeb485585b4ae78871: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 01:58:59.992704 6178 tablet_bootstrap.cc:492] T 5528e3ba51a640eaa614f141440bb90b P 17b49c694faf479ea2e5083470fc0302: No bootstrap required, opened a new log
I20260810 01:58:59.992879 6178 ts_tablet_manager.cc:1403] T 5528e3ba51a640eaa614f141440bb90b P 17b49c694faf479ea2e5083470fc0302: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260810 01:58:59.993793 6178 raft_consensus.cc:359] T 5528e3ba51a640eaa614f141440bb90b P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:59.993974 6178 raft_consensus.cc:385] T 5528e3ba51a640eaa614f141440bb90b P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:58:59.994089 6178 raft_consensus.cc:740] T 5528e3ba51a640eaa614f141440bb90b P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17b49c694faf479ea2e5083470fc0302, State: Initialized, Role: FOLLOWER
I20260810 01:58:59.994374 6178 consensus_queue.cc:260] T 5528e3ba51a640eaa614f141440bb90b P 17b49c694faf479ea2e5083470fc0302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:58:59.994947 6178 ts_tablet_manager.cc:1434] T 5528e3ba51a640eaa614f141440bb90b P 17b49c694faf479ea2e5083470fc0302: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 01:59:00.030717 6094 raft_consensus.cc:493] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:59:00.030937 6094 raft_consensus.cc:515] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:59:00.031741 6094 leader_election.cc:290] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943), 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189)
I20260810 01:59:00.032312 4129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8d13caf8054b1daf09b2b114843766" candidate_uuid: "82f93d1d11364ceeb485585b4ae78871" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17b49c694faf479ea2e5083470fc0302" is_pre_election: true
I20260810 01:59:00.032380 4310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8d13caf8054b1daf09b2b114843766" candidate_uuid: "82f93d1d11364ceeb485585b4ae78871" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" is_pre_election: true
I20260810 01:59:00.032600 4129 raft_consensus.cc:2468] T 8e8d13caf8054b1daf09b2b114843766 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82f93d1d11364ceeb485585b4ae78871 in term 0.
I20260810 01:59:00.032667 4310 raft_consensus.cc:2468] T 8e8d13caf8054b1daf09b2b114843766 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82f93d1d11364ceeb485585b4ae78871 in term 0.
I20260810 01:59:00.033115 3856 leader_election.cc:304] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17b49c694faf479ea2e5083470fc0302, 82f93d1d11364ceeb485585b4ae78871; no voters:
I20260810 01:59:00.033555 6094 raft_consensus.cc:2804] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:59:00.033653 6094 raft_consensus.cc:493] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:59:00.033792 6094 raft_consensus.cc:3060] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:59:00.035831 6094 raft_consensus.cc:515] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:59:00.036439 6094 leader_election.cc:290] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 [CANDIDATE]: Term 1 election: Requested vote from peers ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943), 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189)
I20260810 01:59:00.036842 4310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8d13caf8054b1daf09b2b114843766" candidate_uuid: "82f93d1d11364ceeb485585b4ae78871" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca4469fc2dbc48488bc7ad7f482f129e"
I20260810 01:59:00.036960 4129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8d13caf8054b1daf09b2b114843766" candidate_uuid: "82f93d1d11364ceeb485585b4ae78871" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17b49c694faf479ea2e5083470fc0302"
I20260810 01:59:00.037057 4310 raft_consensus.cc:3060] T 8e8d13caf8054b1daf09b2b114843766 P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:59:00.037190 4129 raft_consensus.cc:3060] T 8e8d13caf8054b1daf09b2b114843766 P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:59:00.040154 4310 raft_consensus.cc:2468] T 8e8d13caf8054b1daf09b2b114843766 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82f93d1d11364ceeb485585b4ae78871 in term 1.
I20260810 01:59:00.040155 4129 raft_consensus.cc:2468] T 8e8d13caf8054b1daf09b2b114843766 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82f93d1d11364ceeb485585b4ae78871 in term 1.
I20260810 01:59:00.040607 3857 leader_election.cc:304] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 17b49c694faf479ea2e5083470fc0302, 82f93d1d11364ceeb485585b4ae78871, ca4469fc2dbc48488bc7ad7f482f129e; no voters:
I20260810 01:59:00.041003 6094 raft_consensus.cc:2804] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:59:00.041142 6094 raft_consensus.cc:697] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Becoming Leader. State: Replica: 82f93d1d11364ceeb485585b4ae78871, State: Running, Role: LEADER
I20260810 01:59:00.041534 6094 consensus_queue.cc:237] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:59:00.044541 3568 catalog_manager.cc:5719] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 reported cstate change: term changed from 0 to 1, leader changed from <none> to 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194). New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 01:59:00.102787 6149 raft_consensus.cc:493] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:59:00.103034 6149 raft_consensus.cc:515] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:59:00.103798 6149 leader_election.cc:290] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189), 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 01:59:00.104390 4129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389d3abfeadd4fe6a4efa74427d71c4d" candidate_uuid: "dc85be7d460a404f997177f57680850f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17b49c694faf479ea2e5083470fc0302" is_pre_election: true
I20260810 01:59:00.104420 3944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389d3abfeadd4fe6a4efa74427d71c4d" candidate_uuid: "dc85be7d460a404f997177f57680850f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f93d1d11364ceeb485585b4ae78871" is_pre_election: true
I20260810 01:59:00.104631 4129 raft_consensus.cc:2468] T 389d3abfeadd4fe6a4efa74427d71c4d P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc85be7d460a404f997177f57680850f in term 0.
I20260810 01:59:00.104779 3944 raft_consensus.cc:2468] T 389d3abfeadd4fe6a4efa74427d71c4d P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc85be7d460a404f997177f57680850f in term 0.
I20260810 01:59:00.105232 3671 leader_election.cc:304] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17b49c694faf479ea2e5083470fc0302, dc85be7d460a404f997177f57680850f; no voters:
I20260810 01:59:00.105597 6149 raft_consensus.cc:2804] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:59:00.105772 6149 raft_consensus.cc:493] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:59:00.105888 6149 raft_consensus.cc:3060] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:59:00.108098 6149 raft_consensus.cc:515] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:59:00.108717 6149 leader_election.cc:290] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f [CANDIDATE]: Term 1 election: Requested vote from peers 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189), 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 01:59:00.109144 4129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389d3abfeadd4fe6a4efa74427d71c4d" candidate_uuid: "dc85be7d460a404f997177f57680850f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17b49c694faf479ea2e5083470fc0302"
I20260810 01:59:00.109265 3944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389d3abfeadd4fe6a4efa74427d71c4d" candidate_uuid: "dc85be7d460a404f997177f57680850f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f93d1d11364ceeb485585b4ae78871"
I20260810 01:59:00.109372 4129 raft_consensus.cc:3060] T 389d3abfeadd4fe6a4efa74427d71c4d P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:59:00.109530 3944 raft_consensus.cc:3060] T 389d3abfeadd4fe6a4efa74427d71c4d P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:59:00.112284 3944 raft_consensus.cc:2468] T 389d3abfeadd4fe6a4efa74427d71c4d P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc85be7d460a404f997177f57680850f in term 1.
I20260810 01:59:00.112469 4129 raft_consensus.cc:2468] T 389d3abfeadd4fe6a4efa74427d71c4d P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc85be7d460a404f997177f57680850f in term 1.
I20260810 01:59:00.112705 3672 leader_election.cc:304] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82f93d1d11364ceeb485585b4ae78871, dc85be7d460a404f997177f57680850f; no voters:
I20260810 01:59:00.113020 6149 raft_consensus.cc:2804] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:59:00.113199 6149 raft_consensus.cc:697] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Becoming Leader. State: Replica: dc85be7d460a404f997177f57680850f, State: Running, Role: LEADER
I20260810 01:59:00.113554 6149 consensus_queue.cc:237] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:59:00.116813 3572 catalog_manager.cc:5719] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f reported cstate change: term changed from 0 to 1, leader changed from <none> to dc85be7d460a404f997177f57680850f (127.21.64.193). New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 01:59:00.189863 6089 raft_consensus.cc:493] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:59:00.190079 6089 raft_consensus.cc:515] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:59:00.190819 6089 leader_election.cc:290] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893), 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189)
I20260810 01:59:00.191408 4129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5528e3ba51a640eaa614f141440bb90b" candidate_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17b49c694faf479ea2e5083470fc0302" is_pre_election: true
I20260810 01:59:00.191434 3944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5528e3ba51a640eaa614f141440bb90b" candidate_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f93d1d11364ceeb485585b4ae78871" is_pre_election: true
I20260810 01:59:00.191694 4129 raft_consensus.cc:2468] T 5528e3ba51a640eaa614f141440bb90b P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca4469fc2dbc48488bc7ad7f482f129e in term 0.
I20260810 01:59:00.191690 3944 raft_consensus.cc:2468] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca4469fc2dbc48488bc7ad7f482f129e in term 0.
I20260810 01:59:00.192196 4222 leader_election.cc:304] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82f93d1d11364ceeb485585b4ae78871, ca4469fc2dbc48488bc7ad7f482f129e; no voters:
I20260810 01:59:00.192523 6089 raft_consensus.cc:2804] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:59:00.192667 6089 raft_consensus.cc:493] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:59:00.192773 6089 raft_consensus.cc:3060] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:59:00.194937 6089 raft_consensus.cc:515] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:59:00.195526 6089 leader_election.cc:290] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e [CANDIDATE]: Term 1 election: Requested vote from peers 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893), 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189)
I20260810 01:59:00.196038 4129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5528e3ba51a640eaa614f141440bb90b" candidate_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17b49c694faf479ea2e5083470fc0302"
I20260810 01:59:00.196027 3944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5528e3ba51a640eaa614f141440bb90b" candidate_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f93d1d11364ceeb485585b4ae78871"
I20260810 01:59:00.196257 3944 raft_consensus.cc:3060] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:59:00.196277 4129 raft_consensus.cc:3060] T 5528e3ba51a640eaa614f141440bb90b P 17b49c694faf479ea2e5083470fc0302 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:59:00.198794 3944 raft_consensus.cc:2468] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca4469fc2dbc48488bc7ad7f482f129e in term 1.
I20260810 01:59:00.198814 4129 raft_consensus.cc:2468] T 5528e3ba51a640eaa614f141440bb90b P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca4469fc2dbc48488bc7ad7f482f129e in term 1.
I20260810 01:59:00.199270 4220 leader_election.cc:304] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17b49c694faf479ea2e5083470fc0302, ca4469fc2dbc48488bc7ad7f482f129e; no voters:
I20260810 01:59:00.199599 6089 raft_consensus.cc:2804] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:59:00.200105 6089 raft_consensus.cc:697] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Becoming Leader. State: Replica: ca4469fc2dbc48488bc7ad7f482f129e, State: Running, Role: LEADER
I20260810 01:59:00.200439 6089 consensus_queue.cc:237] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:59:00.203462 3572 catalog_manager.cc:5719] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e reported cstate change: term changed from 0 to 1, leader changed from <none> to ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196). New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
I20260810 01:59:00.497186 6149 consensus_queue.cc:1048] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:59:00.519168 6149 consensus_queue.cc:1048] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:59:00.534660 6094 consensus_queue.cc:1048] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:59:00.587306 6213 consensus_queue.cc:1048] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:59:00.593544 6194 consensus_queue.cc:1048] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:59:00.628612 6089 consensus_queue.cc:1048] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 01:59:00.646139 3856 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.195:39189, user_credentials={real_user=slave}} blocked reactor thread for 49319.1us
W20260810 01:59:00.729238 6196 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:59:00.729661 6196 flags.cc:432] Enabled unsafe flag: --never_fsync=true
Using table 'rebalance_test_table_9'
INSERT report
rows total: 2000
time total: 253.751 ms
time per row: 0.126875 ms
I20260810 01:59:01.202550 21763 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNubV1X/build/asan/bin/kudu
/tmp/dist-test-taskNubV1X/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/wal
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/logs
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.64.197:38787
--local_ip_for_outbound_sockets=127.21.64.197
--tserver_master_addrs=127.21.64.254:44657
--webserver_port=34207
--webserver_interface=127.21.64.197
--builtin_ntp_servers=127.21.64.212:38687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
W20260810 01:59:01.610348 6284 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:59:01.610702 6284 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:59:01.610839 6284 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 01:59:01.620065 6284 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260810 01:59:01.620209 6284 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:59:01.620405 6284 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.64.197
I20260810 01:59:01.631349 6284 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.64.212:38687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.64.197:38787
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--webserver_interface=127.21.64.197
--webserver_port=34207
--tserver_master_addrs=127.21.64.254:44657
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.64.197
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 01:44:04 UTC on e7f111948823
build id 13266
ASAN enabled
I20260810 01:59:01.632978 6284 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:59:01.635035 6284 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 01:59:01.647914 6297 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:59:01.648239 6295 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:59:01.649679 6300 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:59:01.649925 6284 server_base.cc:1061] running on GCE node
I20260810 01:59:01.650570 6284 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:59:01.651799 6284 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:59:01.653047 6284 hybrid_clock.cc:648] HybridClock initialized: now 1786327141652961 us; error 54 us; skew 500 ppm
I20260810 01:59:01.653481 6284 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 01:59:01.655920 6284 webserver.cc:533] Webserver started at http://127.21.64.197:34207/ using document root <none> and password file <none>
I20260810 01:59:01.656759 6284 fs_manager.cc:362] Metadata directory not provided
I20260810 01:59:01.656888 6284 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:59:01.662864 6284 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 01:59:01.666267 6307 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:59:01.668002 6284 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260810 01:59:01.668191 6284 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data,/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/wal
uuid: "4dd4cba155c941b4b7ad4d64c7431536"
format_stamp: "Formatted at 2026-08-10 01:58:42 on dist-test-slave-bw88"
I20260810 01:59:01.669009 6284 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/wal
metadata directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/wal
1 data directories: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:59:01.687395 6284 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 01:59:01.688238 6284 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:59:01.688553 6284 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:59:01.689586 6284 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260810 01:59:01.691282 6284 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:59:01.691381 6284 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:59:01.691555 6284 ts_tablet_manager.cc:616] Registered 0 tablets
I20260810 01:59:01.691654 6284 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:59:01.730870 6284 rpc_server.cc:307] RPC server started. Bound to: 127.21.64.197:38787
I20260810 01:59:01.730923 6449 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.64.197:38787 every 8 connection(s)
I20260810 01:59:01.732878 6284 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/data/info.pb
I20260810 01:59:01.735183 21763 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNubV1X/build/asan/bin/kudu as pid 6284
I20260810 01:59:01.736075 21763 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNubV1X/build/asan/bin/kudu
/tmp/dist-test-taskNubV1X/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/wal
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/logs
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.64.198:45317
--local_ip_for_outbound_sockets=127.21.64.198
--tserver_master_addrs=127.21.64.254:44657
--webserver_port=43427
--webserver_interface=127.21.64.198
--builtin_ntp_servers=127.21.64.212:38687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
I20260810 01:59:01.749639 6450 heartbeater.cc:344] Connected to a master server at 127.21.64.254:44657
I20260810 01:59:01.750051 6450 heartbeater.cc:461] Registering TS with master...
I20260810 01:59:01.751024 6450 heartbeater.cc:507] Master 127.21.64.254:44657 requested a full tablet report, sending...
I20260810 01:59:01.752811 3565 ts_manager.cc:194] Re-registered known tserver with Master: 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197:38787)
I20260810 01:59:01.753819 3565 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.21.64.197:50101
W20260810 01:59:02.151597 6455 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:59:02.151927 6455 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:59:02.152050 6455 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 01:59:02.161809 6455 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260810 01:59:02.161955 6455 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:59:02.162186 6455 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.64.198
I20260810 01:59:02.172870 6455 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.64.212:38687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/data
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.64.198:45317
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/data/info.pb
--webserver_interface=127.21.64.198
--webserver_port=43427
--tserver_master_addrs=127.21.64.254:44657
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.64.198
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 01:44:04 UTC on e7f111948823
build id 13266
ASAN enabled
I20260810 01:59:02.174831 6455 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:59:02.176900 6455 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 01:59:02.187566 6466 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:59:02.187597 6465 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:59:02.188383 6468 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:59:02.188977 6455 server_base.cc:1061] running on GCE node
I20260810 01:59:02.189649 6455 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:59:02.190714 6455 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:59:02.191975 6455 hybrid_clock.cc:648] HybridClock initialized: now 1786327142191913 us; error 36 us; skew 500 ppm
I20260810 01:59:02.192287 6455 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 01:59:02.194585 6455 webserver.cc:533] Webserver started at http://127.21.64.198:43427/ using document root <none> and password file <none>
I20260810 01:59:02.195345 6455 fs_manager.cc:362] Metadata directory not provided
I20260810 01:59:02.195531 6455 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:59:02.201815 6455 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260810 01:59:02.204600 6476 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:59:02.206385 6455 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:59:02.206641 6455 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/data,/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/wal
uuid: "22ce0e487f0341fd9bf853393d6e7683"
format_stamp: "Formatted at 2026-08-10 01:58:42 on dist-test-slave-bw88"
I20260810 01:59:02.207691 6455 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/wal
metadata directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/wal
1 data directories: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:59:02.243883 6455 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 01:59:02.244786 6455 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:59:02.245044 6455 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:59:02.246155 6455 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260810 01:59:02.247815 6455 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:59:02.247911 6455 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:59:02.248003 6455 ts_tablet_manager.cc:616] Registered 0 tablets
I20260810 01:59:02.248126 6455 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:59:02.287639 6455 rpc_server.cc:307] RPC server started. Bound to: 127.21.64.198:45317
I20260810 01:59:02.287693 6622 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.64.198:45317 every 8 connection(s)
I20260810 01:59:02.289462 6455 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/data/info.pb
I20260810 01:59:02.291059 21763 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNubV1X/build/asan/bin/kudu as pid 6455
I20260810 01:59:02.291713 21763 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNubV1X/build/asan/bin/kudu
/tmp/dist-test-taskNubV1X/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/wal
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/logs
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.64.199:41689
--local_ip_for_outbound_sockets=127.21.64.199
--tserver_master_addrs=127.21.64.254:44657
--webserver_port=35725
--webserver_interface=127.21.64.199
--builtin_ntp_servers=127.21.64.212:38687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
I20260810 01:59:02.307984 6624 heartbeater.cc:344] Connected to a master server at 127.21.64.254:44657
I20260810 01:59:02.308377 6624 heartbeater.cc:461] Registering TS with master...
I20260810 01:59:02.309192 6624 heartbeater.cc:507] Master 127.21.64.254:44657 requested a full tablet report, sending...
I20260810 01:59:02.310863 3565 ts_manager.cc:194] Re-registered known tserver with Master: 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317)
I20260810 01:59:02.312026 3565 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.21.64.198:37671
W20260810 01:59:02.711889 6628 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:59:02.712203 6628 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:59:02.712280 6628 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 01:59:02.720889 6628 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260810 01:59:02.721038 6628 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:59:02.721293 6628 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.64.199
I20260810 01:59:02.731844 6628 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.64.212:38687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/data
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.64.199:41689
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/data/info.pb
--webserver_interface=127.21.64.199
--webserver_port=35725
--tserver_master_addrs=127.21.64.254:44657
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.64.199
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 01:44:04 UTC on e7f111948823
build id 13266
ASAN enabled
I20260810 01:59:02.733625 6628 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:59:02.735873 6628 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 01:59:02.746316 6640 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:59:02.746590 6641 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:59:02.748525 6644 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:59:02.749114 6628 server_base.cc:1061] running on GCE node
I20260810 01:59:02.749826 6628 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:59:02.750835 6628 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:59:02.752055 6628 hybrid_clock.cc:648] HybridClock initialized: now 1786327142751991 us; error 39 us; skew 500 ppm
I20260810 01:59:02.752318 6628 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 01:59:02.754626 6628 webserver.cc:533] Webserver started at http://127.21.64.199:35725/ using document root <none> and password file <none>
I20260810 01:59:02.755329 6628 fs_manager.cc:362] Metadata directory not provided
I20260810 01:59:02.755448 6628 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:59:02.756951 6450 heartbeater.cc:499] Master 127.21.64.254:44657 was elected leader, sending a full tablet report...
I20260810 01:59:02.761597 6628 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.002s sys 0.004s
I20260810 01:59:02.764508 6652 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:59:02.765902 6628 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:59:02.766094 6628 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/data,/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/wal
uuid: "c5ed5317da9c464b93f979c405f0f6e4"
format_stamp: "Formatted at 2026-08-10 01:58:43 on dist-test-slave-bw88"
I20260810 01:59:02.766834 6628 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/wal
metadata directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/wal
1 data directories: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:59:02.789546 6628 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 01:59:02.790652 6628 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:59:02.790951 6628 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:59:02.792141 6628 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260810 01:59:02.793996 6628 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:59:02.794137 6628 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:59:02.794269 6628 ts_tablet_manager.cc:616] Registered 0 tablets
I20260810 01:59:02.794363 6628 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:59:02.832224 6628 rpc_server.cc:307] RPC server started. Bound to: 127.21.64.199:41689
I20260810 01:59:02.832316 6795 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.64.199:41689 every 8 connection(s)
I20260810 01:59:02.833945 6628 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/data/info.pb
I20260810 01:59:02.835397 21763 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNubV1X/build/asan/bin/kudu as pid 6628
I20260810 01:59:02.836217 21763 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNubV1X/build/asan/bin/kudu
/tmp/dist-test-taskNubV1X/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/wal
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/logs
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.64.200:32995
--local_ip_for_outbound_sockets=127.21.64.200
--tserver_master_addrs=127.21.64.254:44657
--webserver_port=32803
--webserver_interface=127.21.64.200
--builtin_ntp_servers=127.21.64.212:38687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
I20260810 01:59:02.849983 6796 heartbeater.cc:344] Connected to a master server at 127.21.64.254:44657
I20260810 01:59:02.850406 6796 heartbeater.cc:461] Registering TS with master...
I20260810 01:59:02.851423 6796 heartbeater.cc:507] Master 127.21.64.254:44657 requested a full tablet report, sending...
I20260810 01:59:02.854421 3565 ts_manager.cc:194] Re-registered known tserver with Master: c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199:41689)
I20260810 01:59:02.855315 3565 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.21.64.199:54793
W20260810 01:59:03.263537 6803 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:59:03.263836 6803 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:59:03.263981 6803 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 01:59:03.272800 6803 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260810 01:59:03.272895 6803 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:59:03.273106 6803 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.64.200
I20260810 01:59:03.283897 6803 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.64.212:38687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/data
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.64.200:32995
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/data/info.pb
--webserver_interface=127.21.64.200
--webserver_port=32803
--tserver_master_addrs=127.21.64.254:44657
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.64.200
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 01:44:04 UTC on e7f111948823
build id 13266
ASAN enabled
I20260810 01:59:03.285796 6803 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:59:03.287722 6803 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 01:59:03.297366 6811 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:59:03.297302 6810 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:59:03.298467 6813 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:59:03.299324 6803 server_base.cc:1061] running on GCE node
I20260810 01:59:03.299958 6803 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:59:03.301003 6803 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:59:03.302284 6803 hybrid_clock.cc:648] HybridClock initialized: now 1786327143302188 us; error 85 us; skew 500 ppm
I20260810 01:59:03.302670 6803 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 01:59:03.304944 6803 webserver.cc:533] Webserver started at http://127.21.64.200:32803/ using document root <none> and password file <none>
I20260810 01:59:03.305823 6803 fs_manager.cc:362] Metadata directory not provided
I20260810 01:59:03.305965 6803 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:59:03.312292 6803 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 01:59:03.314865 6624 heartbeater.cc:499] Master 127.21.64.254:44657 was elected leader, sending a full tablet report...
I20260810 01:59:03.315521 6821 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:59:03.317449 6803 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260810 01:59:03.317652 6803 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/data,/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/wal
uuid: "3136daf7101445beadc1aa19bc01c227"
format_stamp: "Formatted at 2026-08-10 01:58:43 on dist-test-slave-bw88"
I20260810 01:59:03.318516 6803 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/wal
metadata directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/wal
1 data directories: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:59:03.338546 6803 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 01:59:03.339423 6803 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:59:03.339713 6803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:59:03.340696 6803 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260810 01:59:03.342396 6803 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:59:03.342525 6803 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:59:03.342669 6803 ts_tablet_manager.cc:616] Registered 0 tablets
I20260810 01:59:03.342759 6803 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:59:03.382272 6803 rpc_server.cc:307] RPC server started. Bound to: 127.21.64.200:32995
I20260810 01:59:03.382315 6964 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.64.200:32995 every 8 connection(s)
I20260810 01:59:03.384186 6803 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/data/info.pb
I20260810 01:59:03.384462 21763 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNubV1X/build/asan/bin/kudu as pid 6803
I20260810 01:59:03.404800 6965 heartbeater.cc:344] Connected to a master server at 127.21.64.254:44657
I20260810 01:59:03.405267 6965 heartbeater.cc:461] Registering TS with master...
I20260810 01:59:03.406409 6965 heartbeater.cc:507] Master 127.21.64.254:44657 requested a full tablet report, sending...
I20260810 01:59:03.408111 3565 ts_manager.cc:194] Re-registered known tserver with Master: 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995)
I20260810 01:59:03.408957 3565 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.21.64.200:53605
I20260810 01:59:03.858223 6796 heartbeater.cc:499] Master 127.21.64.254:44657 was elected leader, sending a full tablet report...
I20260810 01:59:04.411705 6965 heartbeater.cc:499] Master 127.21.64.254:44657 was elected leader, sending a full tablet report...
I20260810 01:59:04.819073 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260810 01:59:04.825474 3672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.196:41943, user_credentials={real_user=slave}} blocked reactor thread for 43804us
I20260810 01:59:04.868798 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:59:04.868893 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:04.906152 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:04.914423 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:04.915215 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:04.940272 6715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:04.971541 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:05.035940 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:05.100452 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:05.112028 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:05.116061 6715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:05.145138 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:59:05.157986 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:05.213361 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:05.231390 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:05.471571 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:05.480877 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:59:05.513252 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:05.538718 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:59:05.545516 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:05.564700 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:05.574755 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:05.597117 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:05.614637 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:05.615918 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:05.654907 6715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:05.663311 6715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:05.684435 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:05.724498 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:05.808852 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:05.924275 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:05.935985 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:05.962036 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:05.976207 6715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:06.007678 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
W20260810 01:59:06.038347 3672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.194:43893, user_credentials={real_user=slave}} blocked reactor thread for 143995us
I20260810 01:59:06.054769 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:06.080122 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:06.135152 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:06.154315 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
W20260810 01:59:06.566727 3857 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.196:41943, user_credentials={real_user=slave}} blocked reactor thread for 49019.1us
I20260810 01:59:06.634402 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:59:06.665834 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:06.668769 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:06.757583 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:06.798223 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:06.819480 6715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:06.871402 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
W20260810 01:59:06.887420 4222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.194:43893, user_credentials={real_user=slave}} blocked reactor thread for 46322.5us
I20260810 01:59:06.905642 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:07.069707 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:59:07.110426 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:07.113853 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:07.192291 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:07.198637 6715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:07.223769 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:07.242966 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:07.278189 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:07.828008 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:07.832376 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:59:07.851230 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:59:07.973788 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:08.014994 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:08.035825 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:08.057948 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:08.080282 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:08.101895 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:59:08.118335 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:08.119136 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:08.130594 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:08.136302 6715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:08.149493 6715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:08.150730 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:08.165396 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:08.167577 6715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:08.186455 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:08.206280 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:08.225356 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:08.247632 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:08.268641 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:08.276235 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:08.370453 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:08.758917 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260810 01:59:08.786263 4222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.194:43893, user_credentials={real_user=slave}} blocked reactor thread for 76945.9us
I20260810 01:59:08.818957 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
W20260810 01:59:08.831507 4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.193:36797, user_credentials={real_user=slave}} blocked reactor thread for 60892.7us
I20260810 01:59:08.841706 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:08.865665 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:08.868784 6715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:08.893597 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:09.018391 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:09.025455 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:09.067206 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:59:09.084403 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:09.156383 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:09.186472 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:09.214437 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:09.252009 6715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:09.254956 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:09.289902 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:09.698755 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:09.704577 4310 consensus_queue.cc:237] T be4737d169be4419b5a0a0b656a3930f P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:09.711993 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:09.723596 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:09.780735 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:59:09.790230 3941 raft_consensus.cc:1275] T be4737d169be4419b5a0a0b656a3930f P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:09.791862 7781 consensus_queue.cc:1048] T be4737d169be4419b5a0a0b656a3930f P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:09.794493 4132 raft_consensus.cc:1275] T be4737d169be4419b5a0a0b656a3930f P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:09.795280 7960 consensus_queue.cc:1048] T be4737d169be4419b5a0a0b656a3930f P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:09.807866 6715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:09.823623 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:09.824810 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:09.834756 7960 raft_consensus.cc:2955] T be4737d169be4419b5a0a0b656a3930f P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:09.842356 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:09.849737 4132 raft_consensus.cc:2955] T be4737d169be4419b5a0a0b656a3930f P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:09.862805 3941 raft_consensus.cc:2955] T be4737d169be4419b5a0a0b656a3930f P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:09.871347 3562 catalog_manager.cc:5719] T be4737d169be4419b5a0a0b656a3930f P 82f93d1d11364ceeb485585b4ae78871 reported cstate change: config changed from index -1 to 4, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
W20260810 01:59:09.890950 4219 consensus_peers.cc:597] T be4737d169be4419b5a0a0b656a3930f P ca4469fc2dbc48488bc7ad7f482f129e -> Peer 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995): Couldn't send request to peer 3136daf7101445beadc1aa19bc01c227. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: be4737d169be4419b5a0a0b656a3930f. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:10.042011 3757 consensus_queue.cc:237] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:10.089395 4311 raft_consensus.cc:1275] T abf302f27a12414a8647dab82ab8101f P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:10.090303 7666 consensus_queue.cc:1048] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:10.124040 4132 raft_consensus.cc:1275] T abf302f27a12414a8647dab82ab8101f P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:10.124943 7666 consensus_queue.cc:1048] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:10.140679 7666 raft_consensus.cc:2955] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:10.149843 4132 raft_consensus.cc:2955] T abf302f27a12414a8647dab82ab8101f P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:10.159516 3573 catalog_manager.cc:5719] T abf302f27a12414a8647dab82ab8101f P 17b49c694faf479ea2e5083470fc0302 reported cstate change: config changed from index -1 to 4, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:10.173936 8066 ts_tablet_manager.cc:933] T be4737d169be4419b5a0a0b656a3930f P 3136daf7101445beadc1aa19bc01c227: Initiating tablet copy from peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943)
W20260810 01:59:10.180018 3670 consensus_peers.cc:597] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f -> Peer 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197:38787): Couldn't send request to peer 4dd4cba155c941b4b7ad4d64c7431536. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: abf302f27a12414a8647dab82ab8101f. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:10.203639 4311 raft_consensus.cc:2955] T abf302f27a12414a8647dab82ab8101f P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:10.207600 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:59:10.213687 8066 tablet_copy_client.cc:323] T be4737d169be4419b5a0a0b656a3930f P 3136daf7101445beadc1aa19bc01c227: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.196:41943
I20260810 01:59:10.249178 6715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:10.250162 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:10.255987 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:10.282984 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:59:10.283622 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:10.295070 4337 tablet_copy_service.cc:140] P ca4469fc2dbc48488bc7ad7f482f129e: Received BeginTabletCopySession request for tablet be4737d169be4419b5a0a0b656a3930f from peer 3136daf7101445beadc1aa19bc01c227 ({username='slave'} at 127.21.64.200:36881)
I20260810 01:59:10.295476 4337 tablet_copy_service.cc:161] P ca4469fc2dbc48488bc7ad7f482f129e: Beginning new tablet copy session on tablet be4737d169be4419b5a0a0b656a3930f from peer 3136daf7101445beadc1aa19bc01c227 at {username='slave'} at 127.21.64.200:36881: session id = 3136daf7101445beadc1aa19bc01c227-be4737d169be4419b5a0a0b656a3930f
I20260810 01:59:10.301323 4337 tablet_copy_source_session.cc:215] T be4737d169be4419b5a0a0b656a3930f P ca4469fc2dbc48488bc7ad7f482f129e: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:10.309435 8066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be4737d169be4419b5a0a0b656a3930f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:10.309859 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:10.326311 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:10.346496 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:10.369786 3941 consensus_queue.cc:237] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:10.383262 4132 raft_consensus.cc:1275] T da507bc24d964ce1a5835edad5177726 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:10.384449 7655 consensus_queue.cc:1048] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:10.388032 8066 tablet_copy_client.cc:806] T be4737d169be4419b5a0a0b656a3930f P 3136daf7101445beadc1aa19bc01c227: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:10.388504 8066 tablet_copy_client.cc:670] T be4737d169be4419b5a0a0b656a3930f P 3136daf7101445beadc1aa19bc01c227: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:10.390362 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:10.394090 8066 tablet_copy_client.cc:538] T be4737d169be4419b5a0a0b656a3930f P 3136daf7101445beadc1aa19bc01c227: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:10.398327 3757 raft_consensus.cc:1275] T da507bc24d964ce1a5835edad5177726 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:10.400691 7655 consensus_queue.cc:1048] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:10.408604 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
W20260810 01:59:10.450316 3855 consensus_peers.cc:597] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 -> Peer 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197:38787): Couldn't send request to peer 4dd4cba155c941b4b7ad4d64c7431536. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: da507bc24d964ce1a5835edad5177726. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:10.455034 8066 tablet_bootstrap.cc:492] T be4737d169be4419b5a0a0b656a3930f P 3136daf7101445beadc1aa19bc01c227: Bootstrap starting.
I20260810 01:59:10.475443 7655 raft_consensus.cc:2955] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:10.478292 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:10.480917 4129 raft_consensus.cc:2955] T da507bc24d964ce1a5835edad5177726 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:10.488394 3573 catalog_manager.cc:5719] T da507bc24d964ce1a5835edad5177726 P 17b49c694faf479ea2e5083470fc0302 reported cstate change: config changed from index -1 to 4, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:10.493374 3756 raft_consensus.cc:2955] T da507bc24d964ce1a5835edad5177726 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:10.504374 6715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:10.536551 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:10.573557 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:10.577355 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:10.603843 4132 consensus_queue.cc:237] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:10.613798 8134 ts_tablet_manager.cc:933] T abf302f27a12414a8647dab82ab8101f P 4dd4cba155c941b4b7ad4d64c7431536: Initiating tablet copy from peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
I20260810 01:59:10.622186 8066 log.cc:826] T be4737d169be4419b5a0a0b656a3930f P 3136daf7101445beadc1aa19bc01c227: Log is configured to *not* fsync() on all Append() calls
I20260810 01:59:10.622690 8134 tablet_copy_client.cc:323] T abf302f27a12414a8647dab82ab8101f P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.193:36797
I20260810 01:59:10.634102 4311 raft_consensus.cc:1275] T c53fc4008faf445fa05e436b9c8e0282 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:10.634934 7576 consensus_queue.cc:1048] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:10.635615 3943 raft_consensus.cc:1275] T c53fc4008faf445fa05e436b9c8e0282 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:10.637197 7576 consensus_queue.cc:1048] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:10.670435 3787 tablet_copy_service.cc:140] P dc85be7d460a404f997177f57680850f: Received BeginTabletCopySession request for tablet abf302f27a12414a8647dab82ab8101f from peer 4dd4cba155c941b4b7ad4d64c7431536 ({username='slave'} at 127.21.64.197:44713)
I20260810 01:59:10.670714 3787 tablet_copy_service.cc:161] P dc85be7d460a404f997177f57680850f: Beginning new tablet copy session on tablet abf302f27a12414a8647dab82ab8101f from peer 4dd4cba155c941b4b7ad4d64c7431536 at {username='slave'} at 127.21.64.197:44713: session id = 4dd4cba155c941b4b7ad4d64c7431536-abf302f27a12414a8647dab82ab8101f
I20260810 01:59:10.673354 8147 raft_consensus.cc:2955] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:10.675108 4310 raft_consensus.cc:2955] T c53fc4008faf445fa05e436b9c8e0282 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:10.675997 3787 tablet_copy_source_session.cc:215] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:10.681924 3565 catalog_manager.cc:5719] T c53fc4008faf445fa05e436b9c8e0282 P ca4469fc2dbc48488bc7ad7f482f129e reported cstate change: config changed from index -1 to 4, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New cstate: current_term: 1 leader_uuid: "17b49c694faf479ea2e5083470fc0302" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
W20260810 01:59:10.694725 4036 consensus_peers.cc:597] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 -> Peer 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995): Couldn't send request to peer 3136daf7101445beadc1aa19bc01c227. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c53fc4008faf445fa05e436b9c8e0282. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:10.740429 8134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abf302f27a12414a8647dab82ab8101f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:10.740075 3943 raft_consensus.cc:2955] T c53fc4008faf445fa05e436b9c8e0282 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:10.771428 8134 tablet_copy_client.cc:806] T abf302f27a12414a8647dab82ab8101f P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:10.771945 8134 tablet_copy_client.cc:670] T abf302f27a12414a8647dab82ab8101f P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:10.789901 8134 tablet_copy_client.cc:538] T abf302f27a12414a8647dab82ab8101f P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:10.806129 8134 tablet_bootstrap.cc:492] T abf302f27a12414a8647dab82ab8101f P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap starting.
I20260810 01:59:10.814082 8066 tablet_bootstrap.cc:492] T be4737d169be4419b5a0a0b656a3930f P 3136daf7101445beadc1aa19bc01c227: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:10.814875 8066 tablet_bootstrap.cc:492] T be4737d169be4419b5a0a0b656a3930f P 3136daf7101445beadc1aa19bc01c227: Bootstrap complete.
I20260810 01:59:10.816011 8066 ts_tablet_manager.cc:1403] T be4737d169be4419b5a0a0b656a3930f P 3136daf7101445beadc1aa19bc01c227: Time spent bootstrapping tablet: real 0.361s user 0.066s sys 0.010s
I20260810 01:59:10.823331 8066 raft_consensus.cc:359] T be4737d169be4419b5a0a0b656a3930f P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:10.823876 8066 raft_consensus.cc:740] T be4737d169be4419b5a0a0b656a3930f P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3136daf7101445beadc1aa19bc01c227, State: Initialized, Role: FOLLOWER
I20260810 01:59:10.824733 8066 consensus_queue.cc:260] T be4737d169be4419b5a0a0b656a3930f P 3136daf7101445beadc1aa19bc01c227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:10.847265 8134 log.cc:826] T abf302f27a12414a8647dab82ab8101f P 4dd4cba155c941b4b7ad4d64c7431536: Log is configured to *not* fsync() on all Append() calls
I20260810 01:59:10.848994 3756 consensus_queue.cc:237] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
W20260810 01:59:10.853034 3670 consensus_peers.cc:597] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f -> Peer 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197:38787): Couldn't send request to peer 4dd4cba155c941b4b7ad4d64c7431536. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:10.852984 4132 raft_consensus.cc:1275] T abf302f27a12414a8647dab82ab8101f P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:10.854964 8077 consensus_queue.cc:1048] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260810 01:59:10.856583 8178 ts_tablet_manager.cc:933] T da507bc24d964ce1a5835edad5177726 P 4dd4cba155c941b4b7ad4d64c7431536: Initiating tablet copy from peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 01:59:10.858698 4310 raft_consensus.cc:1275] T abf302f27a12414a8647dab82ab8101f P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:10.861414 8077 consensus_queue.cc:1048] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:10.865672 7666 raft_consensus.cc:2955] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:10.866353 4310 raft_consensus.cc:2955] T abf302f27a12414a8647dab82ab8101f P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:10.872016 4132 raft_consensus.cc:2955] T abf302f27a12414a8647dab82ab8101f P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:10.874083 3565 catalog_manager.cc:5719] T abf302f27a12414a8647dab82ab8101f P ca4469fc2dbc48488bc7ad7f482f129e reported cstate change: config changed from index 4 to 5, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:10.892025 8178 tablet_copy_client.cc:323] T da507bc24d964ce1a5835edad5177726 P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.194:43893
I20260810 01:59:10.903725 3973 tablet_copy_service.cc:140] P 82f93d1d11364ceeb485585b4ae78871: Received BeginTabletCopySession request for tablet da507bc24d964ce1a5835edad5177726 from peer 4dd4cba155c941b4b7ad4d64c7431536 ({username='slave'} at 127.21.64.197:54659)
I20260810 01:59:10.904433 3973 tablet_copy_service.cc:161] P 82f93d1d11364ceeb485585b4ae78871: Beginning new tablet copy session on tablet da507bc24d964ce1a5835edad5177726 from peer 4dd4cba155c941b4b7ad4d64c7431536 at {username='slave'} at 127.21.64.197:54659: session id = 4dd4cba155c941b4b7ad4d64c7431536-da507bc24d964ce1a5835edad5177726
I20260810 01:59:10.911187 3973 tablet_copy_source_session.cc:215] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:10.914115 8178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da507bc24d964ce1a5835edad5177726. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:10.937429 8178 tablet_copy_client.cc:806] T da507bc24d964ce1a5835edad5177726 P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:10.937840 8178 tablet_copy_client.cc:670] T da507bc24d964ce1a5835edad5177726 P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:10.938509 8066 ts_tablet_manager.cc:1434] T be4737d169be4419b5a0a0b656a3930f P 3136daf7101445beadc1aa19bc01c227: Time spent starting tablet: real 0.122s user 0.038s sys 0.053s
I20260810 01:59:10.939540 4337 tablet_copy_service.cc:342] P ca4469fc2dbc48488bc7ad7f482f129e: Request end of tablet copy session 3136daf7101445beadc1aa19bc01c227-be4737d169be4419b5a0a0b656a3930f received from {username='slave'} at 127.21.64.200:36881
I20260810 01:59:10.939754 4337 tablet_copy_service.cc:434] P ca4469fc2dbc48488bc7ad7f482f129e: ending tablet copy session 3136daf7101445beadc1aa19bc01c227-be4737d169be4419b5a0a0b656a3930f on tablet be4737d169be4419b5a0a0b656a3930f with peer 3136daf7101445beadc1aa19bc01c227
I20260810 01:59:10.943249 8178 tablet_copy_client.cc:538] T da507bc24d964ce1a5835edad5177726 P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:10.947726 8178 tablet_bootstrap.cc:492] T da507bc24d964ce1a5835edad5177726 P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap starting.
W20260810 01:59:10.950343 3673 consensus_peers.cc:597] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f -> Peer c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199:41689): Couldn't send request to peer c5ed5317da9c464b93f979c405f0f6e4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: abf302f27a12414a8647dab82ab8101f. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:10.987370 8134 tablet_bootstrap.cc:492] T abf302f27a12414a8647dab82ab8101f P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:10.988351 8134 tablet_bootstrap.cc:492] T abf302f27a12414a8647dab82ab8101f P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap complete.
I20260810 01:59:10.989105 8134 ts_tablet_manager.cc:1403] T abf302f27a12414a8647dab82ab8101f P 4dd4cba155c941b4b7ad4d64c7431536: Time spent bootstrapping tablet: real 0.183s user 0.066s sys 0.007s
I20260810 01:59:10.997128 8134 raft_consensus.cc:359] T abf302f27a12414a8647dab82ab8101f P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:10.997714 8134 raft_consensus.cc:740] T abf302f27a12414a8647dab82ab8101f P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dd4cba155c941b4b7ad4d64c7431536, State: Initialized, Role: FOLLOWER
I20260810 01:59:10.998675 8134 consensus_queue.cc:260] T abf302f27a12414a8647dab82ab8101f P 4dd4cba155c941b4b7ad4d64c7431536 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:11.014812 3943 consensus_queue.cc:237] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:11.027930 3756 raft_consensus.cc:1275] T b6c5892f4de449fb8cb7f4cff7eb2e20 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:11.029071 8124 consensus_queue.cc:1048] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260810 01:59:11.038602 3855 consensus_peers.cc:597] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 -> Peer 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197:38787): Couldn't send request to peer 4dd4cba155c941b4b7ad4d64c7431536. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b6c5892f4de449fb8cb7f4cff7eb2e20. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:11.040238 4310 raft_consensus.cc:1275] T b6c5892f4de449fb8cb7f4cff7eb2e20 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:11.041172 7655 consensus_queue.cc:1048] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:11.047861 8134 ts_tablet_manager.cc:1434] T abf302f27a12414a8647dab82ab8101f P 4dd4cba155c941b4b7ad4d64c7431536: Time spent starting tablet: real 0.059s user 0.027s sys 0.030s
I20260810 01:59:11.052351 3787 tablet_copy_service.cc:342] P dc85be7d460a404f997177f57680850f: Request end of tablet copy session 4dd4cba155c941b4b7ad4d64c7431536-abf302f27a12414a8647dab82ab8101f received from {username='slave'} at 127.21.64.197:44713
I20260810 01:59:11.052632 3787 tablet_copy_service.cc:434] P dc85be7d460a404f997177f57680850f: ending tablet copy session 4dd4cba155c941b4b7ad4d64c7431536-abf302f27a12414a8647dab82ab8101f on tablet abf302f27a12414a8647dab82ab8101f with peer 4dd4cba155c941b4b7ad4d64c7431536
I20260810 01:59:11.061671 7655 raft_consensus.cc:2955] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:11.066447 4311 raft_consensus.cc:2955] T b6c5892f4de449fb8cb7f4cff7eb2e20 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:11.075225 3572 catalog_manager.cc:5719] T b6c5892f4de449fb8cb7f4cff7eb2e20 P ca4469fc2dbc48488bc7ad7f482f129e reported cstate change: config changed from index -1 to 4, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:11.076920 3757 raft_consensus.cc:2955] T b6c5892f4de449fb8cb7f4cff7eb2e20 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:11.140044 8066 ts_tablet_manager.cc:933] T c53fc4008faf445fa05e436b9c8e0282 P 3136daf7101445beadc1aa19bc01c227: Initiating tablet copy from peer 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189)
I20260810 01:59:11.140794 8066 tablet_copy_client.cc:323] T c53fc4008faf445fa05e436b9c8e0282 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.195:39189
I20260810 01:59:11.162225 4162 tablet_copy_service.cc:140] P 17b49c694faf479ea2e5083470fc0302: Received BeginTabletCopySession request for tablet c53fc4008faf445fa05e436b9c8e0282 from peer 3136daf7101445beadc1aa19bc01c227 ({username='slave'} at 127.21.64.200:35273)
I20260810 01:59:11.162608 4162 tablet_copy_service.cc:161] P 17b49c694faf479ea2e5083470fc0302: Beginning new tablet copy session on tablet c53fc4008faf445fa05e436b9c8e0282 from peer 3136daf7101445beadc1aa19bc01c227 at {username='slave'} at 127.21.64.200:35273: session id = 3136daf7101445beadc1aa19bc01c227-c53fc4008faf445fa05e436b9c8e0282
I20260810 01:59:11.167287 4162 tablet_copy_source_session.cc:215] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:11.173182 8066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c53fc4008faf445fa05e436b9c8e0282. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:11.174630 6909 raft_consensus.cc:1217] T be4737d169be4419b5a0a0b656a3930f P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20260810 01:59:11.184687 4132 consensus_queue.cc:237] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:11.185971 3943 consensus_queue.cc:237] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:11.187036 8066 tablet_copy_client.cc:806] T c53fc4008faf445fa05e436b9c8e0282 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:11.187338 8066 tablet_copy_client.cc:670] T c53fc4008faf445fa05e436b9c8e0282 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:11.194170 8066 tablet_copy_client.cc:538] T c53fc4008faf445fa05e436b9c8e0282 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:11.211290 3756 raft_consensus.cc:1275] T 4fc45932b9634d6d98d8a0204d4b121a P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:11.214098 7576 consensus_queue.cc:1048] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:11.219439 8178 tablet_bootstrap.cc:492] T da507bc24d964ce1a5835edad5177726 P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:11.220031 8178 tablet_bootstrap.cc:492] T da507bc24d964ce1a5835edad5177726 P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap complete.
I20260810 01:59:11.220384 8178 ts_tablet_manager.cc:1403] T da507bc24d964ce1a5835edad5177726 P 4dd4cba155c941b4b7ad4d64c7431536: Time spent bootstrapping tablet: real 0.273s user 0.062s sys 0.006s
I20260810 01:59:11.223095 8178 raft_consensus.cc:359] T da507bc24d964ce1a5835edad5177726 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:11.223472 8178 raft_consensus.cc:740] T da507bc24d964ce1a5835edad5177726 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dd4cba155c941b4b7ad4d64c7431536, State: Initialized, Role: FOLLOWER
I20260810 01:59:11.223829 8178 consensus_queue.cc:260] T da507bc24d964ce1a5835edad5177726 P 4dd4cba155c941b4b7ad4d64c7431536 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:11.224656 8178 ts_tablet_manager.cc:1434] T da507bc24d964ce1a5835edad5177726 P 4dd4cba155c941b4b7ad4d64c7431536: Time spent starting tablet: real 0.004s user 0.003s sys 0.001s
I20260810 01:59:11.226639 3973 tablet_copy_service.cc:342] P 82f93d1d11364ceeb485585b4ae78871: Request end of tablet copy session 4dd4cba155c941b4b7ad4d64c7431536-da507bc24d964ce1a5835edad5177726 received from {username='slave'} at 127.21.64.197:54659
I20260810 01:59:11.226910 3973 tablet_copy_service.cc:434] P 82f93d1d11364ceeb485585b4ae78871: ending tablet copy session 4dd4cba155c941b4b7ad4d64c7431536-da507bc24d964ce1a5835edad5177726 on tablet da507bc24d964ce1a5835edad5177726 with peer 4dd4cba155c941b4b7ad4d64c7431536
I20260810 01:59:11.230480 3941 consensus_queue.cc:237] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:11.233915 4310 raft_consensus.cc:1275] T 4fc45932b9634d6d98d8a0204d4b121a P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:11.235847 6397 raft_consensus.cc:1275] T da507bc24d964ce1a5835edad5177726 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:11.236680 8066 tablet_bootstrap.cc:492] T c53fc4008faf445fa05e436b9c8e0282 P 3136daf7101445beadc1aa19bc01c227: Bootstrap starting.
I20260810 01:59:11.236943 3756 raft_consensus.cc:1275] T f7a36f7ebd5d4342a259b093e45d4c32 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:11.237829 8242 consensus_queue.cc:1048] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260810 01:59:11.239545 8242 consensus_queue.cc:1048] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:11.240738 7576 consensus_queue.cc:1048] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:11.241643 4132 raft_consensus.cc:1275] T da507bc24d964ce1a5835edad5177726 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:11.241902 4311 raft_consensus.cc:1275] T f7a36f7ebd5d4342a259b093e45d4c32 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:11.243527 8124 consensus_queue.cc:1048] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:11.244096 8124 consensus_queue.cc:1048] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260810 01:59:11.246881 3855 consensus_peers.cc:597] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 -> Peer 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197:38787): Couldn't send request to peer 4dd4cba155c941b4b7ad4d64c7431536. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f7a36f7ebd5d4342a259b093e45d4c32. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:11.248250 3757 raft_consensus.cc:1275] T da507bc24d964ce1a5835edad5177726 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:11.250875 7655 consensus_queue.cc:1048] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:11.255476 7655 raft_consensus.cc:2955] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:11.262794 3757 raft_consensus.cc:2955] T da507bc24d964ce1a5835edad5177726 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
W20260810 01:59:11.264474 4038 consensus_peers.cc:597] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 -> Peer 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317): Couldn't send request to peer 22ce0e487f0341fd9bf853393d6e7683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4fc45932b9634d6d98d8a0204d4b121a. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:11.265622 3572 catalog_manager.cc:5719] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 reported cstate change: config changed from index 4 to 5, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:11.266188 7576 raft_consensus.cc:2955] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:11.272639 4132 raft_consensus.cc:2955] T da507bc24d964ce1a5835edad5177726 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:11.295003 6397 raft_consensus.cc:2955] T da507bc24d964ce1a5835edad5177726 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:11.299958 3761 raft_consensus.cc:2955] T 4fc45932b9634d6d98d8a0204d4b121a P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
W20260810 01:59:11.317216 3858 consensus_peers.cc:597] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 -> Peer c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199:41689): Couldn't send request to peer c5ed5317da9c464b93f979c405f0f6e4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: da507bc24d964ce1a5835edad5177726. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:11.323931 3572 catalog_manager.cc:5719] T 4fc45932b9634d6d98d8a0204d4b121a P dc85be7d460a404f997177f57680850f reported cstate change: config changed from index -1 to 4, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New cstate: current_term: 1 leader_uuid: "17b49c694faf479ea2e5083470fc0302" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:11.333890 8124 raft_consensus.cc:2955] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:11.344081 4310 raft_consensus.cc:2955] T f7a36f7ebd5d4342a259b093e45d4c32 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:11.351313 3573 catalog_manager.cc:5719] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 reported cstate change: config changed from index -1 to 4, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:11.366176 3756 raft_consensus.cc:2955] T f7a36f7ebd5d4342a259b093e45d4c32 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:11.368932 4310 raft_consensus.cc:2955] T 4fc45932b9634d6d98d8a0204d4b121a P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:11.374856 8066 tablet_bootstrap.cc:492] T c53fc4008faf445fa05e436b9c8e0282 P 3136daf7101445beadc1aa19bc01c227: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:11.375458 8066 tablet_bootstrap.cc:492] T c53fc4008faf445fa05e436b9c8e0282 P 3136daf7101445beadc1aa19bc01c227: Bootstrap complete.
I20260810 01:59:11.375834 8066 ts_tablet_manager.cc:1403] T c53fc4008faf445fa05e436b9c8e0282 P 3136daf7101445beadc1aa19bc01c227: Time spent bootstrapping tablet: real 0.139s user 0.096s sys 0.009s
I20260810 01:59:11.377439 8066 raft_consensus.cc:359] T c53fc4008faf445fa05e436b9c8e0282 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:11.377779 8066 raft_consensus.cc:740] T c53fc4008faf445fa05e436b9c8e0282 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3136daf7101445beadc1aa19bc01c227, State: Initialized, Role: FOLLOWER
I20260810 01:59:11.378183 8066 consensus_queue.cc:260] T c53fc4008faf445fa05e436b9c8e0282 P 3136daf7101445beadc1aa19bc01c227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:11.378804 8066 ts_tablet_manager.cc:1434] T c53fc4008faf445fa05e436b9c8e0282 P 3136daf7101445beadc1aa19bc01c227: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260810 01:59:11.380051 4162 tablet_copy_service.cc:342] P 17b49c694faf479ea2e5083470fc0302: Request end of tablet copy session 3136daf7101445beadc1aa19bc01c227-c53fc4008faf445fa05e436b9c8e0282 received from {username='slave'} at 127.21.64.200:35273
I20260810 01:59:11.380255 4162 tablet_copy_service.cc:434] P 17b49c694faf479ea2e5083470fc0302: ending tablet copy session 3136daf7101445beadc1aa19bc01c227-c53fc4008faf445fa05e436b9c8e0282 on tablet c53fc4008faf445fa05e436b9c8e0282 with peer 3136daf7101445beadc1aa19bc01c227
I20260810 01:59:11.430469 3756 consensus_queue.cc:237] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:11.441854 4310 raft_consensus.cc:1275] T cf531b93380e43bfa103837bd6350834 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:11.440186 8361 ts_tablet_manager.cc:933] T abf302f27a12414a8647dab82ab8101f P c5ed5317da9c464b93f979c405f0f6e4: Initiating tablet copy from peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
I20260810 01:59:11.443077 4132 raft_consensus.cc:1275] T cf531b93380e43bfa103837bd6350834 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:11.443205 8189 consensus_queue.cc:1048] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:11.445665 8189 consensus_queue.cc:1048] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260810 01:59:11.453514 3672 consensus_peers.cc:597] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f -> Peer 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317): Couldn't send request to peer 22ce0e487f0341fd9bf853393d6e7683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cf531b93380e43bfa103837bd6350834. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:11.464963 8361 tablet_copy_client.cc:323] T abf302f27a12414a8647dab82ab8101f P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.193:36797
I20260810 01:59:11.473397 8178 ts_tablet_manager.cc:933] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 4dd4cba155c941b4b7ad4d64c7431536: Initiating tablet copy from peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 01:59:11.488696 6397 raft_consensus.cc:2955] T abf302f27a12414a8647dab82ab8101f P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:11.494735 8178 tablet_copy_client.cc:323] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.194:43893
I20260810 01:59:11.495628 3973 tablet_copy_service.cc:140] P 82f93d1d11364ceeb485585b4ae78871: Received BeginTabletCopySession request for tablet b6c5892f4de449fb8cb7f4cff7eb2e20 from peer 4dd4cba155c941b4b7ad4d64c7431536 ({username='slave'} at 127.21.64.197:54659)
I20260810 01:59:11.495852 3973 tablet_copy_service.cc:161] P 82f93d1d11364ceeb485585b4ae78871: Beginning new tablet copy session on tablet b6c5892f4de449fb8cb7f4cff7eb2e20 from peer 4dd4cba155c941b4b7ad4d64c7431536 at {username='slave'} at 127.21.64.197:54659: session id = 4dd4cba155c941b4b7ad4d64c7431536-b6c5892f4de449fb8cb7f4cff7eb2e20
I20260810 01:59:11.500921 3787 tablet_copy_service.cc:140] P dc85be7d460a404f997177f57680850f: Received BeginTabletCopySession request for tablet abf302f27a12414a8647dab82ab8101f from peer c5ed5317da9c464b93f979c405f0f6e4 ({username='slave'} at 127.21.64.199:59819)
I20260810 01:59:11.501219 3787 tablet_copy_service.cc:161] P dc85be7d460a404f997177f57680850f: Beginning new tablet copy session on tablet abf302f27a12414a8647dab82ab8101f from peer c5ed5317da9c464b93f979c405f0f6e4 at {username='slave'} at 127.21.64.199:59819: session id = c5ed5317da9c464b93f979c405f0f6e4-abf302f27a12414a8647dab82ab8101f
I20260810 01:59:11.502314 3973 tablet_copy_source_session.cc:215] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:11.505944 3787 tablet_copy_source_session.cc:215] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:11.507128 8178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6c5892f4de449fb8cb7f4cff7eb2e20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:11.514467 8361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abf302f27a12414a8647dab82ab8101f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:11.527824 8365 raft_consensus.cc:2955] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:11.528658 4311 raft_consensus.cc:2955] T cf531b93380e43bfa103837bd6350834 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:11.535959 4132 raft_consensus.cc:2955] T cf531b93380e43bfa103837bd6350834 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:11.541914 8361 tablet_copy_client.cc:806] T abf302f27a12414a8647dab82ab8101f P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:11.542913 8361 tablet_copy_client.cc:670] T abf302f27a12414a8647dab82ab8101f P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:11.548084 3565 catalog_manager.cc:5719] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f reported cstate change: config changed from index -1 to 4, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:11.556126 6909 raft_consensus.cc:1217] T c53fc4008faf445fa05e436b9c8e0282 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20260810 01:59:11.556403 8361 tablet_copy_client.cc:538] T abf302f27a12414a8647dab82ab8101f P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:11.622553 4311 consensus_queue.cc:237] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:11.623088 8361 tablet_bootstrap.cc:492] T abf302f27a12414a8647dab82ab8101f P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap starting.
I20260810 01:59:11.624573 8178 tablet_copy_client.cc:806] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:11.625213 8178 tablet_copy_client.cc:670] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:11.628285 8178 tablet_copy_client.cc:538] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:11.629024 4310 consensus_queue.cc:237] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:11.641506 8178 tablet_bootstrap.cc:492] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap starting.
I20260810 01:59:11.647866 3943 raft_consensus.cc:1275] T 7207ea155ba44c0a9ba216acd22dc1b4 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:11.648944 3756 raft_consensus.cc:1275] T 7207ea155ba44c0a9ba216acd22dc1b4 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:11.649850 8388 consensus_queue.cc:1048] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:11.650257 8385 consensus_queue.cc:1048] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:11.698454 8388 raft_consensus.cc:2955] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
W20260810 01:59:11.703783 4224 consensus_peers.cc:597] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e -> Peer c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199:41689): Couldn't send request to peer c5ed5317da9c464b93f979c405f0f6e4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7207ea155ba44c0a9ba216acd22dc1b4. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:11.704504 3756 raft_consensus.cc:2955] T 7207ea155ba44c0a9ba216acd22dc1b4 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
W20260810 01:59:11.721263 4222 consensus_peers.cc:597] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e -> Peer 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317): Couldn't send request to peer 22ce0e487f0341fd9bf853393d6e7683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8308d63e9002418b876c3d3ae0095d9f. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:11.721856 3941 raft_consensus.cc:1275] T 8308d63e9002418b876c3d3ae0095d9f P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:11.722520 8385 consensus_queue.cc:1048] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:11.732990 3565 catalog_manager.cc:5719] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e reported cstate change: config changed from index -1 to 4, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:11.742169 8442 ts_tablet_manager.cc:933] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4: Initiating tablet copy from peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 01:59:11.743542 3941 raft_consensus.cc:2955] T 7207ea155ba44c0a9ba216acd22dc1b4 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:11.748867 8434 ts_tablet_manager.cc:933] T 4fc45932b9634d6d98d8a0204d4b121a P 22ce0e487f0341fd9bf853393d6e7683: Initiating tablet copy from peer 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189)
I20260810 01:59:11.751277 8442 tablet_copy_client.cc:323] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.194:43893
I20260810 01:59:11.753880 8437 ts_tablet_manager.cc:933] T f7a36f7ebd5d4342a259b093e45d4c32 P 4dd4cba155c941b4b7ad4d64c7431536: Initiating tablet copy from peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 01:59:11.755012 8437 tablet_copy_client.cc:323] T f7a36f7ebd5d4342a259b093e45d4c32 P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.194:43893
I20260810 01:59:11.755957 3973 tablet_copy_service.cc:140] P 82f93d1d11364ceeb485585b4ae78871: Received BeginTabletCopySession request for tablet f7a36f7ebd5d4342a259b093e45d4c32 from peer 4dd4cba155c941b4b7ad4d64c7431536 ({username='slave'} at 127.21.64.197:54659)
I20260810 01:59:11.756178 3973 tablet_copy_service.cc:161] P 82f93d1d11364ceeb485585b4ae78871: Beginning new tablet copy session on tablet f7a36f7ebd5d4342a259b093e45d4c32 from peer 4dd4cba155c941b4b7ad4d64c7431536 at {username='slave'} at 127.21.64.197:54659: session id = 4dd4cba155c941b4b7ad4d64c7431536-f7a36f7ebd5d4342a259b093e45d4c32
I20260810 01:59:11.757282 8434 tablet_copy_client.cc:323] T 4fc45932b9634d6d98d8a0204d4b121a P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.195:39189
I20260810 01:59:11.760493 3973 tablet_copy_source_session.cc:215] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:11.762606 3756 raft_consensus.cc:1275] T 8308d63e9002418b876c3d3ae0095d9f P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:11.764025 8437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7a36f7ebd5d4342a259b093e45d4c32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:11.767683 3973 tablet_copy_service.cc:140] P 82f93d1d11364ceeb485585b4ae78871: Received BeginTabletCopySession request for tablet da507bc24d964ce1a5835edad5177726 from peer c5ed5317da9c464b93f979c405f0f6e4 ({username='slave'} at 127.21.64.199:41929)
I20260810 01:59:11.767884 3973 tablet_copy_service.cc:161] P 82f93d1d11364ceeb485585b4ae78871: Beginning new tablet copy session on tablet da507bc24d964ce1a5835edad5177726 from peer c5ed5317da9c464b93f979c405f0f6e4 at {username='slave'} at 127.21.64.199:41929: session id = c5ed5317da9c464b93f979c405f0f6e4-da507bc24d964ce1a5835edad5177726
I20260810 01:59:11.769534 8388 consensus_queue.cc:1048] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:11.771633 3973 tablet_copy_source_session.cc:215] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:11.773442 8442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da507bc24d964ce1a5835edad5177726. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:11.777006 8361 log.cc:826] T abf302f27a12414a8647dab82ab8101f P c5ed5317da9c464b93f979c405f0f6e4: Log is configured to *not* fsync() on all Append() calls
I20260810 01:59:11.789601 8388 raft_consensus.cc:2955] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:11.794296 3756 raft_consensus.cc:2955] T 8308d63e9002418b876c3d3ae0095d9f P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:11.789356 8442 tablet_copy_client.cc:806] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:11.797451 8442 tablet_copy_client.cc:670] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:11.799731 8442 tablet_copy_client.cc:538] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:11.804483 8442 tablet_bootstrap.cc:492] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap starting.
I20260810 01:59:11.805096 3941 raft_consensus.cc:2955] T 8308d63e9002418b876c3d3ae0095d9f P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:11.813279 3565 catalog_manager.cc:5719] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e reported cstate change: config changed from index -1 to 4, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:11.842422 4310 consensus_queue.cc:237] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:11.847765 4162 tablet_copy_service.cc:140] P 17b49c694faf479ea2e5083470fc0302: Received BeginTabletCopySession request for tablet 4fc45932b9634d6d98d8a0204d4b121a from peer 22ce0e487f0341fd9bf853393d6e7683 ({username='slave'} at 127.21.64.198:56113)
I20260810 01:59:11.848018 4162 tablet_copy_service.cc:161] P 17b49c694faf479ea2e5083470fc0302: Beginning new tablet copy session on tablet 4fc45932b9634d6d98d8a0204d4b121a from peer 22ce0e487f0341fd9bf853393d6e7683 at {username='slave'} at 127.21.64.198:56113: session id = 22ce0e487f0341fd9bf853393d6e7683-4fc45932b9634d6d98d8a0204d4b121a
I20260810 01:59:11.851847 4162 tablet_copy_source_session.cc:215] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:11.857542 8437 tablet_copy_client.cc:806] T f7a36f7ebd5d4342a259b093e45d4c32 P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:11.857928 8437 tablet_copy_client.cc:670] T f7a36f7ebd5d4342a259b093e45d4c32 P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:11.859280 3941 raft_consensus.cc:1275] T 1d377b919f4748c88efb249dfc964f17 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:11.859977 8388 consensus_queue.cc:1048] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:11.860121 8437 tablet_copy_client.cc:538] T f7a36f7ebd5d4342a259b093e45d4c32 P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:11.860803 8434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fc45932b9634d6d98d8a0204d4b121a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:11.865864 3756 consensus_queue.cc:237] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
W20260810 01:59:11.867864 4219 consensus_peers.cc:597] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e -> Peer 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995): Couldn't send request to peer 3136daf7101445beadc1aa19bc01c227. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1d377b919f4748c88efb249dfc964f17. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:11.872715 8437 tablet_bootstrap.cc:492] T f7a36f7ebd5d4342a259b093e45d4c32 P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap starting.
I20260810 01:59:11.875612 4132 raft_consensus.cc:1275] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:11.876482 8385 consensus_queue.cc:1048] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:11.878790 3761 consensus_queue.cc:237] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:11.891723 8434 tablet_copy_client.cc:806] T 4fc45932b9634d6d98d8a0204d4b121a P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:11.892129 8434 tablet_copy_client.cc:670] T 4fc45932b9634d6d98d8a0204d4b121a P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:11.911237 8434 tablet_copy_client.cc:538] T 4fc45932b9634d6d98d8a0204d4b121a P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260810 01:59:11.912254 3673 consensus_peers.cc:597] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f -> Peer c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199:41689): Couldn't send request to peer c5ed5317da9c464b93f979c405f0f6e4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 389d3abfeadd4fe6a4efa74427d71c4d. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:11.912812 4129 raft_consensus.cc:1275] T 389d3abfeadd4fe6a4efa74427d71c4d P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:11.913762 8365 consensus_queue.cc:1048] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:11.918103 3943 raft_consensus.cc:1275] T 389d3abfeadd4fe6a4efa74427d71c4d P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:11.919023 8365 consensus_queue.cc:1048] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:11.927661 8434 tablet_bootstrap.cc:492] T 4fc45932b9634d6d98d8a0204d4b121a P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap starting.
W20260810 01:59:11.934294 3673 consensus_peers.cc:597] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f -> Peer c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199:41689): Couldn't send request to peer c5ed5317da9c464b93f979c405f0f6e4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: df5b102a0b03406f9449cdd84dfd147e. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:11.934900 4310 raft_consensus.cc:1275] T df5b102a0b03406f9449cdd84dfd147e P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:11.935611 8365 consensus_queue.cc:1048] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:11.948246 3944 raft_consensus.cc:1275] T df5b102a0b03406f9449cdd84dfd147e P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:11.949072 8365 consensus_queue.cc:1048] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:11.970626 8365 raft_consensus.cc:2955] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:11.977118 4310 raft_consensus.cc:2955] T df5b102a0b03406f9449cdd84dfd147e P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:11.981108 8434 log.cc:826] T 4fc45932b9634d6d98d8a0204d4b121a P 22ce0e487f0341fd9bf853393d6e7683: Log is configured to *not* fsync() on all Append() calls
I20260810 01:59:11.989167 3572 catalog_manager.cc:5719] T df5b102a0b03406f9449cdd84dfd147e P ca4469fc2dbc48488bc7ad7f482f129e reported cstate change: config changed from index -1 to 4, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:12.001508 3944 raft_consensus.cc:2955] T df5b102a0b03406f9449cdd84dfd147e P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:12.011616 8189 raft_consensus.cc:2955] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:12.029810 8388 raft_consensus.cc:2955] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:12.034301 3944 raft_consensus.cc:2955] T 1d377b919f4748c88efb249dfc964f17 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:12.043222 4132 raft_consensus.cc:2955] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:12.043471 3572 catalog_manager.cc:5719] T 1d377b919f4748c88efb249dfc964f17 P 82f93d1d11364ceeb485585b4ae78871 reported cstate change: config changed from index -1 to 4, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:12.050258 3943 raft_consensus.cc:2955] T 389d3abfeadd4fe6a4efa74427d71c4d P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:12.083103 3565 catalog_manager.cc:5719] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f reported cstate change: config changed from index -1 to 4, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:12.085592 8178 tablet_bootstrap.cc:492] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:12.088248 8178 tablet_bootstrap.cc:492] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap complete.
I20260810 01:59:12.088629 8178 ts_tablet_manager.cc:1403] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 4dd4cba155c941b4b7ad4d64c7431536: Time spent bootstrapping tablet: real 0.451s user 0.061s sys 0.008s
I20260810 01:59:12.090749 4129 raft_consensus.cc:2955] T 389d3abfeadd4fe6a4efa74427d71c4d P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:12.101550 8178 raft_consensus.cc:359] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:12.101832 8178 raft_consensus.cc:740] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dd4cba155c941b4b7ad4d64c7431536, State: Initialized, Role: FOLLOWER
I20260810 01:59:12.102202 8178 consensus_queue.cc:260] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 4dd4cba155c941b4b7ad4d64c7431536 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:12.105449 8496 ts_tablet_manager.cc:933] T cf531b93380e43bfa103837bd6350834 P 22ce0e487f0341fd9bf853393d6e7683: Initiating tablet copy from peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
I20260810 01:59:12.114383 8496 tablet_copy_client.cc:323] T cf531b93380e43bfa103837bd6350834 P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.193:36797
I20260810 01:59:12.115996 8178 ts_tablet_manager.cc:1434] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 4dd4cba155c941b4b7ad4d64c7431536: Time spent starting tablet: real 0.027s user 0.003s sys 0.000s
I20260810 01:59:12.117151 3973 tablet_copy_service.cc:342] P 82f93d1d11364ceeb485585b4ae78871: Request end of tablet copy session 4dd4cba155c941b4b7ad4d64c7431536-b6c5892f4de449fb8cb7f4cff7eb2e20 received from {username='slave'} at 127.21.64.197:54659
I20260810 01:59:12.117319 3973 tablet_copy_service.cc:434] P 82f93d1d11364ceeb485585b4ae78871: ending tablet copy session 4dd4cba155c941b4b7ad4d64c7431536-b6c5892f4de449fb8cb7f4cff7eb2e20 on tablet b6c5892f4de449fb8cb7f4cff7eb2e20 with peer 4dd4cba155c941b4b7ad4d64c7431536
I20260810 01:59:12.117424 8442 tablet_bootstrap.cc:492] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:12.122352 8442 tablet_bootstrap.cc:492] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap complete.
I20260810 01:59:12.123032 8442 ts_tablet_manager.cc:1403] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4: Time spent bootstrapping tablet: real 0.319s user 0.062s sys 0.021s
I20260810 01:59:12.127869 3787 tablet_copy_service.cc:140] P dc85be7d460a404f997177f57680850f: Received BeginTabletCopySession request for tablet cf531b93380e43bfa103837bd6350834 from peer 22ce0e487f0341fd9bf853393d6e7683 ({username='slave'} at 127.21.64.198:55265)
I20260810 01:59:12.128082 3787 tablet_copy_service.cc:161] P dc85be7d460a404f997177f57680850f: Beginning new tablet copy session on tablet cf531b93380e43bfa103837bd6350834 from peer 22ce0e487f0341fd9bf853393d6e7683 at {username='slave'} at 127.21.64.198:55265: session id = 22ce0e487f0341fd9bf853393d6e7683-cf531b93380e43bfa103837bd6350834
I20260810 01:59:12.132862 3787 tablet_copy_source_session.cc:215] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:12.136370 8361 tablet_bootstrap.cc:492] T abf302f27a12414a8647dab82ab8101f P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:12.137063 8361 tablet_bootstrap.cc:492] T abf302f27a12414a8647dab82ab8101f P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap complete.
I20260810 01:59:12.138162 8496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf531b93380e43bfa103837bd6350834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:12.149425 8361 ts_tablet_manager.cc:1403] T abf302f27a12414a8647dab82ab8101f P c5ed5317da9c464b93f979c405f0f6e4: Time spent bootstrapping tablet: real 0.515s user 0.082s sys 0.001s
I20260810 01:59:12.163669 8496 tablet_copy_client.cc:806] T cf531b93380e43bfa103837bd6350834 P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:12.164160 8496 tablet_copy_client.cc:670] T cf531b93380e43bfa103837bd6350834 P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:12.167193 8496 tablet_copy_client.cc:538] T cf531b93380e43bfa103837bd6350834 P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:12.172727 8496 tablet_bootstrap.cc:492] T cf531b93380e43bfa103837bd6350834 P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap starting.
I20260810 01:59:12.181908 8361 raft_consensus.cc:359] T abf302f27a12414a8647dab82ab8101f P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:12.182667 8361 raft_consensus.cc:740] T abf302f27a12414a8647dab82ab8101f P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ed5317da9c464b93f979c405f0f6e4, State: Initialized, Role: FOLLOWER
I20260810 01:59:12.183691 8361 consensus_queue.cc:260] T abf302f27a12414a8647dab82ab8101f P c5ed5317da9c464b93f979c405f0f6e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:12.188613 8442 raft_consensus.cc:359] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:12.189245 8442 raft_consensus.cc:740] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ed5317da9c464b93f979c405f0f6e4, State: Initialized, Role: FOLLOWER
I20260810 01:59:12.189600 8442 consensus_queue.cc:260] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:12.207533 8361 ts_tablet_manager.cc:1434] T abf302f27a12414a8647dab82ab8101f P c5ed5317da9c464b93f979c405f0f6e4: Time spent starting tablet: real 0.058s user 0.005s sys 0.000s
I20260810 01:59:12.211865 8437 tablet_bootstrap.cc:492] T f7a36f7ebd5d4342a259b093e45d4c32 P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:12.212428 8437 tablet_bootstrap.cc:492] T f7a36f7ebd5d4342a259b093e45d4c32 P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap complete.
I20260810 01:59:12.212762 8437 ts_tablet_manager.cc:1403] T f7a36f7ebd5d4342a259b093e45d4c32 P 4dd4cba155c941b4b7ad4d64c7431536: Time spent bootstrapping tablet: real 0.341s user 0.075s sys 0.047s
I20260810 01:59:12.213991 8437 raft_consensus.cc:359] T f7a36f7ebd5d4342a259b093e45d4c32 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:12.214247 8437 raft_consensus.cc:740] T f7a36f7ebd5d4342a259b093e45d4c32 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dd4cba155c941b4b7ad4d64c7431536, State: Initialized, Role: FOLLOWER
I20260810 01:59:12.214529 8437 consensus_queue.cc:260] T f7a36f7ebd5d4342a259b093e45d4c32 P 4dd4cba155c941b4b7ad4d64c7431536 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:12.215195 8437 ts_tablet_manager.cc:1434] T f7a36f7ebd5d4342a259b093e45d4c32 P 4dd4cba155c941b4b7ad4d64c7431536: Time spent starting tablet: real 0.002s user 0.004s sys 0.000s
I20260810 01:59:12.216225 3973 tablet_copy_service.cc:342] P 82f93d1d11364ceeb485585b4ae78871: Request end of tablet copy session 4dd4cba155c941b4b7ad4d64c7431536-f7a36f7ebd5d4342a259b093e45d4c32 received from {username='slave'} at 127.21.64.197:54659
I20260810 01:59:12.216403 3973 tablet_copy_service.cc:434] P 82f93d1d11364ceeb485585b4ae78871: ending tablet copy session 4dd4cba155c941b4b7ad4d64c7431536-f7a36f7ebd5d4342a259b093e45d4c32 on tablet f7a36f7ebd5d4342a259b093e45d4c32 with peer 4dd4cba155c941b4b7ad4d64c7431536
I20260810 01:59:12.222782 8530 ts_tablet_manager.cc:933] T 7207ea155ba44c0a9ba216acd22dc1b4 P c5ed5317da9c464b93f979c405f0f6e4: Initiating tablet copy from peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943)
I20260810 01:59:12.226795 8442 ts_tablet_manager.cc:1434] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4: Time spent starting tablet: real 0.104s user 0.006s sys 0.003s
I20260810 01:59:12.227849 8530 tablet_copy_client.cc:323] T 7207ea155ba44c0a9ba216acd22dc1b4 P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.196:41943
I20260810 01:59:12.238765 4337 tablet_copy_service.cc:140] P ca4469fc2dbc48488bc7ad7f482f129e: Received BeginTabletCopySession request for tablet 7207ea155ba44c0a9ba216acd22dc1b4 from peer c5ed5317da9c464b93f979c405f0f6e4 ({username='slave'} at 127.21.64.199:45727)
I20260810 01:59:12.238940 4337 tablet_copy_service.cc:161] P ca4469fc2dbc48488bc7ad7f482f129e: Beginning new tablet copy session on tablet 7207ea155ba44c0a9ba216acd22dc1b4 from peer c5ed5317da9c464b93f979c405f0f6e4 at {username='slave'} at 127.21.64.199:45727: session id = c5ed5317da9c464b93f979c405f0f6e4-7207ea155ba44c0a9ba216acd22dc1b4
I20260810 01:59:12.241993 3787 tablet_copy_service.cc:342] P dc85be7d460a404f997177f57680850f: Request end of tablet copy session c5ed5317da9c464b93f979c405f0f6e4-abf302f27a12414a8647dab82ab8101f received from {username='slave'} at 127.21.64.199:59819
I20260810 01:59:12.242007 3973 tablet_copy_service.cc:342] P 82f93d1d11364ceeb485585b4ae78871: Request end of tablet copy session c5ed5317da9c464b93f979c405f0f6e4-da507bc24d964ce1a5835edad5177726 received from {username='slave'} at 127.21.64.199:41929
I20260810 01:59:12.242159 3787 tablet_copy_service.cc:434] P dc85be7d460a404f997177f57680850f: ending tablet copy session c5ed5317da9c464b93f979c405f0f6e4-abf302f27a12414a8647dab82ab8101f on tablet abf302f27a12414a8647dab82ab8101f with peer c5ed5317da9c464b93f979c405f0f6e4
I20260810 01:59:12.242193 3973 tablet_copy_service.cc:434] P 82f93d1d11364ceeb485585b4ae78871: ending tablet copy session c5ed5317da9c464b93f979c405f0f6e4-da507bc24d964ce1a5835edad5177726 on tablet da507bc24d964ce1a5835edad5177726 with peer c5ed5317da9c464b93f979c405f0f6e4
I20260810 01:59:12.243376 4337 tablet_copy_source_session.cc:215] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:12.258095 8530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7207ea155ba44c0a9ba216acd22dc1b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:12.258320 8496 tablet_bootstrap.cc:492] T cf531b93380e43bfa103837bd6350834 P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:12.259138 8496 tablet_bootstrap.cc:492] T cf531b93380e43bfa103837bd6350834 P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap complete.
I20260810 01:59:12.259735 8496 ts_tablet_manager.cc:1403] T cf531b93380e43bfa103837bd6350834 P 22ce0e487f0341fd9bf853393d6e7683: Time spent bootstrapping tablet: real 0.087s user 0.056s sys 0.008s
I20260810 01:59:12.266283 8496 raft_consensus.cc:359] T cf531b93380e43bfa103837bd6350834 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:12.266870 8496 raft_consensus.cc:740] T cf531b93380e43bfa103837bd6350834 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ce0e487f0341fd9bf853393d6e7683, State: Initialized, Role: FOLLOWER
I20260810 01:59:12.267896 8496 consensus_queue.cc:260] T cf531b93380e43bfa103837bd6350834 P 22ce0e487f0341fd9bf853393d6e7683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:12.280556 8530 tablet_copy_client.cc:806] T 7207ea155ba44c0a9ba216acd22dc1b4 P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:12.283607 8496 ts_tablet_manager.cc:1434] T cf531b93380e43bfa103837bd6350834 P 22ce0e487f0341fd9bf853393d6e7683: Time spent starting tablet: real 0.024s user 0.016s sys 0.002s
I20260810 01:59:12.284822 8555 ts_tablet_manager.cc:933] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683: Initiating tablet copy from peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943)
I20260810 01:59:12.285950 3787 tablet_copy_service.cc:342] P dc85be7d460a404f997177f57680850f: Request end of tablet copy session 22ce0e487f0341fd9bf853393d6e7683-cf531b93380e43bfa103837bd6350834 received from {username='slave'} at 127.21.64.198:55265
I20260810 01:59:12.286127 3787 tablet_copy_service.cc:434] P dc85be7d460a404f997177f57680850f: ending tablet copy session 22ce0e487f0341fd9bf853393d6e7683-cf531b93380e43bfa103837bd6350834 on tablet cf531b93380e43bfa103837bd6350834 with peer 22ce0e487f0341fd9bf853393d6e7683
I20260810 01:59:12.286595 8530 tablet_copy_client.cc:670] T 7207ea155ba44c0a9ba216acd22dc1b4 P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:12.288641 8530 tablet_copy_client.cc:538] T 7207ea155ba44c0a9ba216acd22dc1b4 P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:12.292744 3756 consensus_queue.cc:237] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:12.294806 8555 tablet_copy_client.cc:323] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.196:41943
I20260810 01:59:12.296523 4132 raft_consensus.cc:1275] T 252899385eaa45b392974d2768e3cf01 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:12.297935 8490 consensus_queue.cc:1048] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:12.299715 3943 raft_consensus.cc:1275] T 252899385eaa45b392974d2768e3cf01 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:12.304045 8490 consensus_queue.cc:1048] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260810 01:59:12.305645 3672 consensus_peers.cc:597] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f -> Peer 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317): Couldn't send request to peer 22ce0e487f0341fd9bf853393d6e7683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 252899385eaa45b392974d2768e3cf01. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:12.306245 8530 tablet_bootstrap.cc:492] T 7207ea155ba44c0a9ba216acd22dc1b4 P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap starting.
I20260810 01:59:12.311789 8361 ts_tablet_manager.cc:933] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4: Initiating tablet copy from peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
I20260810 01:59:12.311797 4337 tablet_copy_service.cc:140] P ca4469fc2dbc48488bc7ad7f482f129e: Received BeginTabletCopySession request for tablet 8308d63e9002418b876c3d3ae0095d9f from peer 22ce0e487f0341fd9bf853393d6e7683 ({username='slave'} at 127.21.64.198:60673)
I20260810 01:59:12.311964 4337 tablet_copy_service.cc:161] P ca4469fc2dbc48488bc7ad7f482f129e: Beginning new tablet copy session on tablet 8308d63e9002418b876c3d3ae0095d9f from peer 22ce0e487f0341fd9bf853393d6e7683 at {username='slave'} at 127.21.64.198:60673: session id = 22ce0e487f0341fd9bf853393d6e7683-8308d63e9002418b876c3d3ae0095d9f
I20260810 01:59:12.315310 4337 tablet_copy_source_session.cc:215] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:12.328810 6397 raft_consensus.cc:1217] T f7a36f7ebd5d4342a259b093e45d4c32 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20260810 01:59:12.331614 8555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8308d63e9002418b876c3d3ae0095d9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:12.334379 8584 ts_tablet_manager.cc:933] T 1d377b919f4748c88efb249dfc964f17 P 3136daf7101445beadc1aa19bc01c227: Initiating tablet copy from peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943)
I20260810 01:59:12.342120 8361 tablet_copy_client.cc:323] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.193:36797
I20260810 01:59:12.343021 3787 tablet_copy_service.cc:140] P dc85be7d460a404f997177f57680850f: Received BeginTabletCopySession request for tablet 389d3abfeadd4fe6a4efa74427d71c4d from peer c5ed5317da9c464b93f979c405f0f6e4 ({username='slave'} at 127.21.64.199:59819)
I20260810 01:59:12.343247 3787 tablet_copy_service.cc:161] P dc85be7d460a404f997177f57680850f: Beginning new tablet copy session on tablet 389d3abfeadd4fe6a4efa74427d71c4d from peer c5ed5317da9c464b93f979c405f0f6e4 at {username='slave'} at 127.21.64.199:59819: session id = c5ed5317da9c464b93f979c405f0f6e4-389d3abfeadd4fe6a4efa74427d71c4d
I20260810 01:59:12.347019 6737 raft_consensus.cc:1217] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20260810 01:59:12.350646 6397 raft_consensus.cc:1217] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20260810 01:59:12.352227 3787 tablet_copy_source_session.cc:215] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:12.354321 8361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 389d3abfeadd4fe6a4efa74427d71c4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:12.354359 8584 tablet_copy_client.cc:323] T 1d377b919f4748c88efb249dfc964f17 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.196:41943
I20260810 01:59:12.355376 4337 tablet_copy_service.cc:140] P ca4469fc2dbc48488bc7ad7f482f129e: Received BeginTabletCopySession request for tablet 1d377b919f4748c88efb249dfc964f17 from peer 3136daf7101445beadc1aa19bc01c227 ({username='slave'} at 127.21.64.200:36881)
I20260810 01:59:12.355643 4337 tablet_copy_service.cc:161] P ca4469fc2dbc48488bc7ad7f482f129e: Beginning new tablet copy session on tablet 1d377b919f4748c88efb249dfc964f17 from peer 3136daf7101445beadc1aa19bc01c227 at {username='slave'} at 127.21.64.200:36881: session id = 3136daf7101445beadc1aa19bc01c227-1d377b919f4748c88efb249dfc964f17
I20260810 01:59:12.359426 4337 tablet_copy_source_session.cc:215] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:12.365913 8584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d377b919f4748c88efb249dfc964f17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:12.366947 8361 tablet_copy_client.cc:806] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:12.367218 8361 tablet_copy_client.cc:670] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:12.378810 8555 tablet_copy_client.cc:806] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:12.379220 8555 tablet_copy_client.cc:670] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:12.379921 8361 tablet_copy_client.cc:538] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:12.379936 8584 tablet_copy_client.cc:806] T 1d377b919f4748c88efb249dfc964f17 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:12.380193 8584 tablet_copy_client.cc:670] T 1d377b919f4748c88efb249dfc964f17 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:12.381089 8189 raft_consensus.cc:2955] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:12.381950 3941 raft_consensus.cc:2955] T 252899385eaa45b392974d2768e3cf01 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:12.382503 8584 tablet_copy_client.cc:538] T 1d377b919f4748c88efb249dfc964f17 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:12.386858 8584 tablet_bootstrap.cc:492] T 1d377b919f4748c88efb249dfc964f17 P 3136daf7101445beadc1aa19bc01c227: Bootstrap starting.
I20260810 01:59:12.386862 4132 raft_consensus.cc:2955] T 252899385eaa45b392974d2768e3cf01 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:12.395185 3573 catalog_manager.cc:5719] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f reported cstate change: config changed from index -1 to 4, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:12.413704 8361 tablet_bootstrap.cc:492] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap starting.
I20260810 01:59:12.414431 8555 tablet_copy_client.cc:538] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:12.439472 3756 consensus_queue.cc:237] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:12.443686 4311 raft_consensus.cc:1275] T df5b102a0b03406f9449cdd84dfd147e P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
W20260810 01:59:12.444597 3673 consensus_peers.cc:597] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f -> Peer c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199:41689): Couldn't send request to peer c5ed5317da9c464b93f979c405f0f6e4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: df5b102a0b03406f9449cdd84dfd147e. This is attempt 1: this message will repeat every 5th retry.
W20260810 01:59:12.445072 3672 consensus_peers.cc:597] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f -> Peer 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317): Couldn't send request to peer 22ce0e487f0341fd9bf853393d6e7683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: df5b102a0b03406f9449cdd84dfd147e. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:12.445366 8189 consensus_queue.cc:1048] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:12.448185 3941 raft_consensus.cc:1275] T df5b102a0b03406f9449cdd84dfd147e P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:12.448936 8189 consensus_queue.cc:1048] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:12.452214 8189 raft_consensus.cc:2955] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:12.457857 3941 raft_consensus.cc:2955] T df5b102a0b03406f9449cdd84dfd147e P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:12.462478 4311 raft_consensus.cc:2955] T df5b102a0b03406f9449cdd84dfd147e P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:12.469805 3573 catalog_manager.cc:5719] T df5b102a0b03406f9449cdd84dfd147e P ca4469fc2dbc48488bc7ad7f482f129e reported cstate change: config changed from index 4 to 5, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:12.498478 8530 tablet_bootstrap.cc:492] T 7207ea155ba44c0a9ba216acd22dc1b4 P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:12.499414 8530 tablet_bootstrap.cc:492] T 7207ea155ba44c0a9ba216acd22dc1b4 P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap complete.
I20260810 01:59:12.500046 8530 ts_tablet_manager.cc:1403] T 7207ea155ba44c0a9ba216acd22dc1b4 P c5ed5317da9c464b93f979c405f0f6e4: Time spent bootstrapping tablet: real 0.194s user 0.035s sys 0.036s
I20260810 01:59:12.501207 8530 raft_consensus.cc:359] T 7207ea155ba44c0a9ba216acd22dc1b4 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:12.501578 8530 raft_consensus.cc:740] T 7207ea155ba44c0a9ba216acd22dc1b4 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ed5317da9c464b93f979c405f0f6e4, State: Initialized, Role: FOLLOWER
I20260810 01:59:12.501953 8530 consensus_queue.cc:260] T 7207ea155ba44c0a9ba216acd22dc1b4 P c5ed5317da9c464b93f979c405f0f6e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:12.502704 8530 ts_tablet_manager.cc:1434] T 7207ea155ba44c0a9ba216acd22dc1b4 P c5ed5317da9c464b93f979c405f0f6e4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:59:12.504145 4337 tablet_copy_service.cc:342] P ca4469fc2dbc48488bc7ad7f482f129e: Request end of tablet copy session c5ed5317da9c464b93f979c405f0f6e4-7207ea155ba44c0a9ba216acd22dc1b4 received from {username='slave'} at 127.21.64.199:45727
I20260810 01:59:12.504294 4337 tablet_copy_service.cc:434] P ca4469fc2dbc48488bc7ad7f482f129e: ending tablet copy session c5ed5317da9c464b93f979c405f0f6e4-7207ea155ba44c0a9ba216acd22dc1b4 on tablet 7207ea155ba44c0a9ba216acd22dc1b4 with peer c5ed5317da9c464b93f979c405f0f6e4
I20260810 01:59:12.506048 4132 consensus_queue.cc:237] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:12.507102 8555 tablet_bootstrap.cc:492] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap starting.
I20260810 01:59:12.516044 8434 tablet_bootstrap.cc:492] T 4fc45932b9634d6d98d8a0204d4b121a P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:12.524310 8434 tablet_bootstrap.cc:492] T 4fc45932b9634d6d98d8a0204d4b121a P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap complete.
W20260810 01:59:12.524837 4038 consensus_peers.cc:597] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 -> Peer 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317): Couldn't send request to peer 22ce0e487f0341fd9bf853393d6e7683. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:12.525144 8434 ts_tablet_manager.cc:1403] T 4fc45932b9634d6d98d8a0204d4b121a P 22ce0e487f0341fd9bf853393d6e7683: Time spent bootstrapping tablet: real 0.598s user 0.089s sys 0.002s
I20260810 01:59:12.526353 8434 raft_consensus.cc:359] T 4fc45932b9634d6d98d8a0204d4b121a P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:12.526647 8434 raft_consensus.cc:740] T 4fc45932b9634d6d98d8a0204d4b121a P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ce0e487f0341fd9bf853393d6e7683, State: Initialized, Role: FOLLOWER
I20260810 01:59:12.527499 8434 consensus_queue.cc:260] T 4fc45932b9634d6d98d8a0204d4b121a P 22ce0e487f0341fd9bf853393d6e7683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:12.529358 8434 ts_tablet_manager.cc:1434] T 4fc45932b9634d6d98d8a0204d4b121a P 22ce0e487f0341fd9bf853393d6e7683: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260810 01:59:12.533514 4311 raft_consensus.cc:1275] T 4fc45932b9634d6d98d8a0204d4b121a P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:12.535373 8581 consensus_queue.cc:1048] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:12.540537 6737 raft_consensus.cc:1217] T abf302f27a12414a8647dab82ab8101f P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20260810 01:59:12.550202 8361 tablet_bootstrap.cc:492] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:12.535167 6567 raft_consensus.cc:1217] T cf531b93380e43bfa103837bd6350834 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20260810 01:59:12.550699 8361 tablet_bootstrap.cc:492] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap complete.
I20260810 01:59:12.551005 8361 ts_tablet_manager.cc:1403] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4: Time spent bootstrapping tablet: real 0.137s user 0.055s sys 0.000s
I20260810 01:59:12.556726 8361 raft_consensus.cc:359] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:12.557291 4311 consensus_queue.cc:237] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:12.558497 4162 tablet_copy_service.cc:342] P 17b49c694faf479ea2e5083470fc0302: Request end of tablet copy session 22ce0e487f0341fd9bf853393d6e7683-4fc45932b9634d6d98d8a0204d4b121a received from {username='slave'} at 127.21.64.198:56113
I20260810 01:59:12.558631 4162 tablet_copy_service.cc:434] P 17b49c694faf479ea2e5083470fc0302: ending tablet copy session 22ce0e487f0341fd9bf853393d6e7683-4fc45932b9634d6d98d8a0204d4b121a on tablet 4fc45932b9634d6d98d8a0204d4b121a with peer 22ce0e487f0341fd9bf853393d6e7683
I20260810 01:59:12.560158 8361 raft_consensus.cc:740] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ed5317da9c464b93f979c405f0f6e4, State: Initialized, Role: FOLLOWER
I20260810 01:59:12.560588 8361 consensus_queue.cc:260] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:12.562130 3756 raft_consensus.cc:1275] T a586b7d625bb4c27a6343ae7918c8cea P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:12.562256 8361 ts_tablet_manager.cc:1434] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4: Time spent starting tablet: real 0.011s user 0.004s sys 0.000s
W20260810 01:59:12.562917 4224 consensus_peers.cc:597] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e -> Peer c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199:41689): Couldn't send request to peer c5ed5317da9c464b93f979c405f0f6e4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a586b7d625bb4c27a6343ae7918c8cea. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:12.563522 8388 consensus_queue.cc:1048] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:12.566687 3787 tablet_copy_service.cc:342] P dc85be7d460a404f997177f57680850f: Request end of tablet copy session c5ed5317da9c464b93f979c405f0f6e4-389d3abfeadd4fe6a4efa74427d71c4d received from {username='slave'} at 127.21.64.199:59819
I20260810 01:59:12.566861 3787 tablet_copy_service.cc:434] P dc85be7d460a404f997177f57680850f: ending tablet copy session c5ed5317da9c464b93f979c405f0f6e4-389d3abfeadd4fe6a4efa74427d71c4d on tablet 389d3abfeadd4fe6a4efa74427d71c4d with peer c5ed5317da9c464b93f979c405f0f6e4
I20260810 01:59:12.579921 8584 tablet_bootstrap.cc:492] T 1d377b919f4748c88efb249dfc964f17 P 3136daf7101445beadc1aa19bc01c227: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:12.580698 8584 tablet_bootstrap.cc:492] T 1d377b919f4748c88efb249dfc964f17 P 3136daf7101445beadc1aa19bc01c227: Bootstrap complete.
I20260810 01:59:12.581099 8584 ts_tablet_manager.cc:1403] T 1d377b919f4748c88efb249dfc964f17 P 3136daf7101445beadc1aa19bc01c227: Time spent bootstrapping tablet: real 0.194s user 0.050s sys 0.022s
I20260810 01:59:12.582167 8584 raft_consensus.cc:359] T 1d377b919f4748c88efb249dfc964f17 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:12.582540 8584 raft_consensus.cc:740] T 1d377b919f4748c88efb249dfc964f17 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3136daf7101445beadc1aa19bc01c227, State: Initialized, Role: FOLLOWER
I20260810 01:59:12.582901 8584 consensus_queue.cc:260] T 1d377b919f4748c88efb249dfc964f17 P 3136daf7101445beadc1aa19bc01c227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:12.602108 6737 raft_consensus.cc:1217] T 7207ea155ba44c0a9ba216acd22dc1b4 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20260810 01:59:12.609560 8584 ts_tablet_manager.cc:1434] T 1d377b919f4748c88efb249dfc964f17 P 3136daf7101445beadc1aa19bc01c227: Time spent starting tablet: real 0.028s user 0.007s sys 0.008s
I20260810 01:59:12.610513 4337 tablet_copy_service.cc:342] P ca4469fc2dbc48488bc7ad7f482f129e: Request end of tablet copy session 3136daf7101445beadc1aa19bc01c227-1d377b919f4748c88efb249dfc964f17 received from {username='slave'} at 127.21.64.200:36881
I20260810 01:59:12.610702 4337 tablet_copy_service.cc:434] P ca4469fc2dbc48488bc7ad7f482f129e: ending tablet copy session 3136daf7101445beadc1aa19bc01c227-1d377b919f4748c88efb249dfc964f17 on tablet 1d377b919f4748c88efb249dfc964f17 with peer 3136daf7101445beadc1aa19bc01c227
I20260810 01:59:12.630069 3756 raft_consensus.cc:1275] T 4fc45932b9634d6d98d8a0204d4b121a P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:12.631209 8581 consensus_queue.cc:1048] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:12.631531 4132 raft_consensus.cc:1275] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:12.642040 8388 consensus_queue.cc:1048] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:12.681444 8581 raft_consensus.cc:2955] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:12.693763 4311 raft_consensus.cc:2955] T 4fc45932b9634d6d98d8a0204d4b121a P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:12.695297 3573 catalog_manager.cc:5719] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 reported cstate change: config changed from index 4 to 5, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New cstate: current_term: 1 leader_uuid: "17b49c694faf479ea2e5083470fc0302" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:12.695736 8555 tablet_bootstrap.cc:492] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:12.696249 8555 tablet_bootstrap.cc:492] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap complete.
I20260810 01:59:12.697108 8555 ts_tablet_manager.cc:1403] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683: Time spent bootstrapping tablet: real 0.190s user 0.053s sys 0.012s
I20260810 01:59:12.698338 8555 raft_consensus.cc:359] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:12.698695 8555 raft_consensus.cc:740] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ce0e487f0341fd9bf853393d6e7683, State: Initialized, Role: FOLLOWER
I20260810 01:59:12.699079 8555 consensus_queue.cc:260] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:12.699849 8555 ts_tablet_manager.cc:1434] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 01:59:12.700659 4337 tablet_copy_service.cc:342] P ca4469fc2dbc48488bc7ad7f482f129e: Request end of tablet copy session 22ce0e487f0341fd9bf853393d6e7683-8308d63e9002418b876c3d3ae0095d9f received from {username='slave'} at 127.21.64.198:60673
I20260810 01:59:12.700793 4337 tablet_copy_service.cc:434] P ca4469fc2dbc48488bc7ad7f482f129e: ending tablet copy session 22ce0e487f0341fd9bf853393d6e7683-8308d63e9002418b876c3d3ae0095d9f on tablet 8308d63e9002418b876c3d3ae0095d9f with peer 22ce0e487f0341fd9bf853393d6e7683
I20260810 01:59:12.705843 8388 raft_consensus.cc:2955] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:12.718569 3759 raft_consensus.cc:2955] T 4fc45932b9634d6d98d8a0204d4b121a P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:12.719304 3572 catalog_manager.cc:5719] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e reported cstate change: config changed from index -1 to 4, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:12.720690 4129 raft_consensus.cc:2955] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:12.726150 3761 raft_consensus.cc:2955] T a586b7d625bb4c27a6343ae7918c8cea P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
W20260810 01:59:12.726567 4036 consensus_peers.cc:597] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 -> Peer 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197:38787): Couldn't send request to peer 4dd4cba155c941b4b7ad4d64c7431536. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4fc45932b9634d6d98d8a0204d4b121a. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:12.762418 6567 raft_consensus.cc:1217] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20260810 01:59:12.779081 8555 ts_tablet_manager.cc:933] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683: Initiating tablet copy from peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
I20260810 01:59:12.785830 8555 tablet_copy_client.cc:323] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.193:36797
I20260810 01:59:12.786835 3787 tablet_copy_service.cc:140] P dc85be7d460a404f997177f57680850f: Received BeginTabletCopySession request for tablet 252899385eaa45b392974d2768e3cf01 from peer 22ce0e487f0341fd9bf853393d6e7683 ({username='slave'} at 127.21.64.198:55265)
I20260810 01:59:12.786995 3787 tablet_copy_service.cc:161] P dc85be7d460a404f997177f57680850f: Beginning new tablet copy session on tablet 252899385eaa45b392974d2768e3cf01 from peer 22ce0e487f0341fd9bf853393d6e7683 at {username='slave'} at 127.21.64.198:55265: session id = 22ce0e487f0341fd9bf853393d6e7683-252899385eaa45b392974d2768e3cf01
I20260810 01:59:12.790793 3787 tablet_copy_source_session.cc:215] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:12.792361 8555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 252899385eaa45b392974d2768e3cf01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:12.814059 8555 tablet_copy_client.cc:806] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:12.818640 8555 tablet_copy_client.cc:670] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:12.823206 8555 tablet_copy_client.cc:538] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:12.827553 8555 tablet_bootstrap.cc:492] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap starting.
I20260810 01:59:12.843609 8361 ts_tablet_manager.cc:933] T df5b102a0b03406f9449cdd84dfd147e P c5ed5317da9c464b93f979c405f0f6e4: Initiating tablet copy from peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
I20260810 01:59:12.868072 8361 tablet_copy_client.cc:323] T df5b102a0b03406f9449cdd84dfd147e P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.193:36797
I20260810 01:59:12.869889 3787 tablet_copy_service.cc:140] P dc85be7d460a404f997177f57680850f: Received BeginTabletCopySession request for tablet df5b102a0b03406f9449cdd84dfd147e from peer c5ed5317da9c464b93f979c405f0f6e4 ({username='slave'} at 127.21.64.199:59819)
I20260810 01:59:12.870162 3787 tablet_copy_service.cc:161] P dc85be7d460a404f997177f57680850f: Beginning new tablet copy session on tablet df5b102a0b03406f9449cdd84dfd147e from peer c5ed5317da9c464b93f979c405f0f6e4 at {username='slave'} at 127.21.64.199:59819: session id = c5ed5317da9c464b93f979c405f0f6e4-df5b102a0b03406f9449cdd84dfd147e
I20260810 01:59:12.878029 3787 tablet_copy_source_session.cc:215] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:12.880674 8361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df5b102a0b03406f9449cdd84dfd147e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:12.909581 6909 raft_consensus.cc:1217] T 1d377b919f4748c88efb249dfc964f17 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20260810 01:59:12.922585 6737 raft_consensus.cc:1217] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20260810 01:59:12.933008 6567 raft_consensus.cc:2955] T 4fc45932b9634d6d98d8a0204d4b121a P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:12.953539 8361 tablet_copy_client.cc:806] T df5b102a0b03406f9449cdd84dfd147e P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:12.953835 8361 tablet_copy_client.cc:670] T df5b102a0b03406f9449cdd84dfd147e P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:12.959389 3941 consensus_queue.cc:237] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:12.959604 8361 tablet_copy_client.cc:538] T df5b102a0b03406f9449cdd84dfd147e P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:12.964036 8361 tablet_bootstrap.cc:492] T df5b102a0b03406f9449cdd84dfd147e P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap starting.
I20260810 01:59:12.995816 8434 ts_tablet_manager.cc:933] T df5b102a0b03406f9449cdd84dfd147e P 22ce0e487f0341fd9bf853393d6e7683: Initiating tablet copy from peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
I20260810 01:59:13.003804 4311 raft_consensus.cc:1275] T 4a4350cf2ece4769b8547620ac5bedcb P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:13.004833 8124 consensus_queue.cc:1048] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:13.007411 8555 tablet_bootstrap.cc:492] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:13.008056 8555 tablet_bootstrap.cc:492] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap complete.
I20260810 01:59:13.008447 8555 ts_tablet_manager.cc:1403] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683: Time spent bootstrapping tablet: real 0.181s user 0.055s sys 0.011s
I20260810 01:59:13.009912 8555 raft_consensus.cc:359] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:13.010233 8555 raft_consensus.cc:740] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ce0e487f0341fd9bf853393d6e7683, State: Initialized, Role: FOLLOWER
I20260810 01:59:13.010582 8555 consensus_queue.cc:260] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:13.011468 8555 ts_tablet_manager.cc:1434] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683: Time spent starting tablet: real 0.003s user 0.005s sys 0.000s
I20260810 01:59:13.012511 3787 tablet_copy_service.cc:342] P dc85be7d460a404f997177f57680850f: Request end of tablet copy session 22ce0e487f0341fd9bf853393d6e7683-252899385eaa45b392974d2768e3cf01 received from {username='slave'} at 127.21.64.198:55265
I20260810 01:59:13.012691 3787 tablet_copy_service.cc:434] P dc85be7d460a404f997177f57680850f: ending tablet copy session 22ce0e487f0341fd9bf853393d6e7683-252899385eaa45b392974d2768e3cf01 on tablet 252899385eaa45b392974d2768e3cf01 with peer 22ce0e487f0341fd9bf853393d6e7683
I20260810 01:59:13.034457 3941 consensus_queue.cc:237] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:13.037755 4311 raft_consensus.cc:1275] T 8e8d13caf8054b1daf09b2b114843766 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:13.038539 4132 raft_consensus.cc:1275] T 8e8d13caf8054b1daf09b2b114843766 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:13.038532 8124 consensus_queue.cc:1048] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:13.039302 8124 consensus_queue.cc:1048] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260810 01:59:13.049248 8725 log.cc:927] Time spent T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871: Append to log took a long time: real 0.073s user 0.000s sys 0.000s
I20260810 01:59:13.050952 3761 raft_consensus.cc:1275] T 4a4350cf2ece4769b8547620ac5bedcb P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:13.052552 8434 tablet_copy_client.cc:323] T df5b102a0b03406f9449cdd84dfd147e P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.193:36797
I20260810 01:59:13.053447 3787 tablet_copy_service.cc:140] P dc85be7d460a404f997177f57680850f: Received BeginTabletCopySession request for tablet df5b102a0b03406f9449cdd84dfd147e from peer 22ce0e487f0341fd9bf853393d6e7683 ({username='slave'} at 127.21.64.198:55265)
I20260810 01:59:13.053648 3787 tablet_copy_service.cc:161] P dc85be7d460a404f997177f57680850f: Beginning new tablet copy session on tablet df5b102a0b03406f9449cdd84dfd147e from peer 22ce0e487f0341fd9bf853393d6e7683 at {username='slave'} at 127.21.64.198:55265: session id = 22ce0e487f0341fd9bf853393d6e7683-df5b102a0b03406f9449cdd84dfd147e
I20260810 01:59:13.057860 3787 tablet_copy_source_session.cc:215] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:13.059705 8434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df5b102a0b03406f9449cdd84dfd147e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:13.067797 8434 tablet_copy_client.cc:806] T df5b102a0b03406f9449cdd84dfd147e P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:13.068231 8434 tablet_copy_client.cc:670] T df5b102a0b03406f9449cdd84dfd147e P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:13.070379 8434 tablet_copy_client.cc:538] T df5b102a0b03406f9449cdd84dfd147e P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:13.073094 8124 consensus_queue.cc:1048] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:13.084641 3941 consensus_queue.cc:237] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:13.099704 8434 tablet_bootstrap.cc:492] T df5b102a0b03406f9449cdd84dfd147e P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap starting.
I20260810 01:59:13.101135 8124 raft_consensus.cc:2955] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:13.107856 4310 raft_consensus.cc:2955] T 4a4350cf2ece4769b8547620ac5bedcb P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:13.113624 3761 raft_consensus.cc:2955] T 4a4350cf2ece4769b8547620ac5bedcb P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:13.116518 3572 catalog_manager.cc:5719] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 reported cstate change: config changed from index -1 to 4, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:13.123828 4132 raft_consensus.cc:1275] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:13.126755 8301 consensus_queue.cc:1048] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:13.127583 8361 tablet_bootstrap.cc:492] T df5b102a0b03406f9449cdd84dfd147e P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:13.128077 8361 tablet_bootstrap.cc:492] T df5b102a0b03406f9449cdd84dfd147e P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap complete.
I20260810 01:59:13.128378 8361 ts_tablet_manager.cc:1403] T df5b102a0b03406f9449cdd84dfd147e P c5ed5317da9c464b93f979c405f0f6e4: Time spent bootstrapping tablet: real 0.164s user 0.072s sys 0.020s
I20260810 01:59:13.129390 8361 raft_consensus.cc:359] T df5b102a0b03406f9449cdd84dfd147e P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:13.129630 8361 raft_consensus.cc:740] T df5b102a0b03406f9449cdd84dfd147e P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ed5317da9c464b93f979c405f0f6e4, State: Initialized, Role: FOLLOWER
I20260810 01:59:13.129997 8361 consensus_queue.cc:260] T df5b102a0b03406f9449cdd84dfd147e P c5ed5317da9c464b93f979c405f0f6e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:13.130612 8361 ts_tablet_manager.cc:1434] T df5b102a0b03406f9449cdd84dfd147e P c5ed5317da9c464b93f979c405f0f6e4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:59:13.131351 3787 tablet_copy_service.cc:342] P dc85be7d460a404f997177f57680850f: Request end of tablet copy session c5ed5317da9c464b93f979c405f0f6e4-df5b102a0b03406f9449cdd84dfd147e received from {username='slave'} at 127.21.64.199:59819
I20260810 01:59:13.131529 3787 tablet_copy_service.cc:434] P dc85be7d460a404f997177f57680850f: ending tablet copy session c5ed5317da9c464b93f979c405f0f6e4-df5b102a0b03406f9449cdd84dfd147e on tablet df5b102a0b03406f9449cdd84dfd147e with peer c5ed5317da9c464b93f979c405f0f6e4
I20260810 01:59:13.135528 8301 raft_consensus.cc:2955] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:13.139406 8361 ts_tablet_manager.cc:933] T a586b7d625bb4c27a6343ae7918c8cea P c5ed5317da9c464b93f979c405f0f6e4: Initiating tablet copy from peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943)
I20260810 01:59:13.140024 4310 raft_consensus.cc:1275] T 18a93b1a1ce1440b99bdd7a3bcf49064 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260810 01:59:13.134665 3855 consensus_peers.cc:597] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 -> Peer 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995): Couldn't send request to peer 3136daf7101445beadc1aa19bc01c227. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4a4350cf2ece4769b8547620ac5bedcb. This is attempt 1: this message will repeat every 5th retry.
W20260810 01:59:13.146152 3855 consensus_peers.cc:597] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 -> Peer 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995): Couldn't send request to peer 3136daf7101445beadc1aa19bc01c227. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8e8d13caf8054b1daf09b2b114843766. This is attempt 1: this message will repeat every 5th retry.
W20260810 01:59:13.146515 3855 consensus_peers.cc:597] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871 -> Peer 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995): Couldn't send request to peer 3136daf7101445beadc1aa19bc01c227. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 18a93b1a1ce1440b99bdd7a3bcf49064. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:13.154785 8769 consensus_queue.cc:1048] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:13.158283 8361 tablet_copy_client.cc:323] T a586b7d625bb4c27a6343ae7918c8cea P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.196:41943
I20260810 01:59:13.159483 4337 tablet_copy_service.cc:140] P ca4469fc2dbc48488bc7ad7f482f129e: Received BeginTabletCopySession request for tablet a586b7d625bb4c27a6343ae7918c8cea from peer c5ed5317da9c464b93f979c405f0f6e4 ({username='slave'} at 127.21.64.199:45727)
I20260810 01:59:13.159678 4337 tablet_copy_service.cc:161] P ca4469fc2dbc48488bc7ad7f482f129e: Beginning new tablet copy session on tablet a586b7d625bb4c27a6343ae7918c8cea from peer c5ed5317da9c464b93f979c405f0f6e4 at {username='slave'} at 127.21.64.199:45727: session id = c5ed5317da9c464b93f979c405f0f6e4-a586b7d625bb4c27a6343ae7918c8cea
I20260810 01:59:13.162073 4311 raft_consensus.cc:2955] T 8e8d13caf8054b1daf09b2b114843766 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:13.163630 4337 tablet_copy_source_session.cc:215] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:13.168044 8361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a586b7d625bb4c27a6343ae7918c8cea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:13.174634 8756 ts_tablet_manager.cc:933] T 4fc45932b9634d6d98d8a0204d4b121a P 4dd4cba155c941b4b7ad4d64c7431536: Initiating tablet copy from peer 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189)
I20260810 01:59:13.175496 3565 catalog_manager.cc:5719] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 reported cstate change: config changed from index -1 to 4, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:13.184151 8756 tablet_copy_client.cc:323] T 4fc45932b9634d6d98d8a0204d4b121a P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.195:39189
I20260810 01:59:13.187055 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:59:13.200383 4132 raft_consensus.cc:2955] T 8e8d13caf8054b1daf09b2b114843766 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:13.207854 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:13.239920 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:13.255868 3761 consensus_queue.cc:237] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
W20260810 01:59:13.260934 3670 consensus_peers.cc:597] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f -> Peer 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197:38787): Couldn't send request to peer 4dd4cba155c941b4b7ad4d64c7431536. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: df5b102a0b03406f9449cdd84dfd147e. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:13.279567 8361 tablet_copy_client.cc:806] T a586b7d625bb4c27a6343ae7918c8cea P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:13.280020 8361 tablet_copy_client.cc:670] T a586b7d625bb4c27a6343ae7918c8cea P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:13.295166 8361 tablet_copy_client.cc:538] T a586b7d625bb4c27a6343ae7918c8cea P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:13.296276 4162 tablet_copy_service.cc:140] P 17b49c694faf479ea2e5083470fc0302: Received BeginTabletCopySession request for tablet 4fc45932b9634d6d98d8a0204d4b121a from peer 4dd4cba155c941b4b7ad4d64c7431536 ({username='slave'} at 127.21.64.197:39923)
I20260810 01:59:13.296479 4162 tablet_copy_service.cc:161] P 17b49c694faf479ea2e5083470fc0302: Beginning new tablet copy session on tablet 4fc45932b9634d6d98d8a0204d4b121a from peer 4dd4cba155c941b4b7ad4d64c7431536 at {username='slave'} at 127.21.64.197:39923: session id = 4dd4cba155c941b4b7ad4d64c7431536-4fc45932b9634d6d98d8a0204d4b121a
I20260810 01:59:13.299820 4162 tablet_copy_source_session.cc:215] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:13.303018 8756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fc45932b9634d6d98d8a0204d4b121a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:13.303954 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:13.305397 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:13.311434 8756 tablet_copy_client.cc:806] T 4fc45932b9634d6d98d8a0204d4b121a P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:13.311728 8756 tablet_copy_client.cc:670] T 4fc45932b9634d6d98d8a0204d4b121a P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:13.319293 8361 tablet_bootstrap.cc:492] T a586b7d625bb4c27a6343ae7918c8cea P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap starting.
I20260810 01:59:13.324998 8756 tablet_copy_client.cc:538] T 4fc45932b9634d6d98d8a0204d4b121a P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:13.328976 8756 tablet_bootstrap.cc:492] T 4fc45932b9634d6d98d8a0204d4b121a P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap starting.
W20260810 01:59:13.342100 3671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.195:39189, user_credentials={real_user=slave}} blocked reactor thread for 83237.4us
I20260810 01:59:13.346844 3941 raft_consensus.cc:1275] T df5b102a0b03406f9449cdd84dfd147e P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:13.348204 4310 raft_consensus.cc:1275] T df5b102a0b03406f9449cdd84dfd147e P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:13.348541 6567 raft_consensus.cc:1217] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20260810 01:59:13.350932 8189 consensus_queue.cc:1048] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:13.352084 8189 consensus_queue.cc:1048] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:13.372640 8769 raft_consensus.cc:2955] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
W20260810 01:59:13.373615 3672 consensus_peers.cc:597] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f -> Peer 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317): Couldn't send request to peer 22ce0e487f0341fd9bf853393d6e7683. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:13.380070 4132 raft_consensus.cc:2955] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:13.387458 3565 catalog_manager.cc:5719] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302 reported cstate change: config changed from index -1 to 4, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:13.398442 6737 raft_consensus.cc:1275] T df5b102a0b03406f9449cdd84dfd147e P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:13.404945 8189 consensus_queue.cc:1048] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:13.416404 4310 raft_consensus.cc:2955] T 18a93b1a1ce1440b99bdd7a3bcf49064 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:13.423228 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:13.444458 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:13.455796 8434 tablet_bootstrap.cc:492] T df5b102a0b03406f9449cdd84dfd147e P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:13.456365 8434 tablet_bootstrap.cc:492] T df5b102a0b03406f9449cdd84dfd147e P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap complete.
I20260810 01:59:13.456717 8434 ts_tablet_manager.cc:1403] T df5b102a0b03406f9449cdd84dfd147e P 22ce0e487f0341fd9bf853393d6e7683: Time spent bootstrapping tablet: real 0.357s user 0.079s sys 0.062s
I20260810 01:59:13.466758 8434 raft_consensus.cc:359] T df5b102a0b03406f9449cdd84dfd147e P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:13.467077 8434 raft_consensus.cc:740] T df5b102a0b03406f9449cdd84dfd147e P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ce0e487f0341fd9bf853393d6e7683, State: Initialized, Role: FOLLOWER
I20260810 01:59:13.467428 8434 consensus_queue.cc:260] T df5b102a0b03406f9449cdd84dfd147e P 22ce0e487f0341fd9bf853393d6e7683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:13.468151 8434 ts_tablet_manager.cc:1434] T df5b102a0b03406f9449cdd84dfd147e P 22ce0e487f0341fd9bf853393d6e7683: Time spent starting tablet: real 0.011s user 0.001s sys 0.000s
I20260810 01:59:13.484952 3787 tablet_copy_service.cc:342] P dc85be7d460a404f997177f57680850f: Request end of tablet copy session 22ce0e487f0341fd9bf853393d6e7683-df5b102a0b03406f9449cdd84dfd147e received from {username='slave'} at 127.21.64.198:55265
I20260810 01:59:13.485271 3787 tablet_copy_service.cc:434] P dc85be7d460a404f997177f57680850f: ending tablet copy session 22ce0e487f0341fd9bf853393d6e7683-df5b102a0b03406f9449cdd84dfd147e on tablet df5b102a0b03406f9449cdd84dfd147e with peer 22ce0e487f0341fd9bf853393d6e7683
I20260810 01:59:13.486675 8820 ts_tablet_manager.cc:933] T 4a4350cf2ece4769b8547620ac5bedcb P 3136daf7101445beadc1aa19bc01c227: Initiating tablet copy from peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 01:59:13.522084 8802 raft_consensus.cc:2955] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:13.525252 6715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:13.530696 4310 raft_consensus.cc:2955] T df5b102a0b03406f9449cdd84dfd147e P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:13.535737 3941 raft_consensus.cc:2955] T df5b102a0b03406f9449cdd84dfd147e P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:13.539309 3572 catalog_manager.cc:5719] T df5b102a0b03406f9449cdd84dfd147e P ca4469fc2dbc48488bc7ad7f482f129e reported cstate change: config changed from index 5 to 6, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:13.525647 6739 raft_consensus.cc:2955] T df5b102a0b03406f9449cdd84dfd147e P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:13.546569 8832 ts_tablet_manager.cc:933] T 8e8d13caf8054b1daf09b2b114843766 P 3136daf7101445beadc1aa19bc01c227: Initiating tablet copy from peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 01:59:13.563225 8832 tablet_copy_client.cc:323] T 8e8d13caf8054b1daf09b2b114843766 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.194:43893
I20260810 01:59:13.591432 3973 tablet_copy_service.cc:140] P 82f93d1d11364ceeb485585b4ae78871: Received BeginTabletCopySession request for tablet 8e8d13caf8054b1daf09b2b114843766 from peer 3136daf7101445beadc1aa19bc01c227 ({username='slave'} at 127.21.64.200:39385)
I20260810 01:59:13.591636 3973 tablet_copy_service.cc:161] P 82f93d1d11364ceeb485585b4ae78871: Beginning new tablet copy session on tablet 8e8d13caf8054b1daf09b2b114843766 from peer 3136daf7101445beadc1aa19bc01c227 at {username='slave'} at 127.21.64.200:39385: session id = 3136daf7101445beadc1aa19bc01c227-8e8d13caf8054b1daf09b2b114843766
I20260810 01:59:13.595140 3973 tablet_copy_source_session.cc:215] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:13.598316 8832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e8d13caf8054b1daf09b2b114843766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:13.611089 8820 tablet_copy_client.cc:323] T 4a4350cf2ece4769b8547620ac5bedcb P 3136daf7101445beadc1aa19bc01c227: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.194:43893
I20260810 01:59:13.612130 3973 tablet_copy_service.cc:140] P 82f93d1d11364ceeb485585b4ae78871: Received BeginTabletCopySession request for tablet 4a4350cf2ece4769b8547620ac5bedcb from peer 3136daf7101445beadc1aa19bc01c227 ({username='slave'} at 127.21.64.200:39385)
I20260810 01:59:13.612371 3973 tablet_copy_service.cc:161] P 82f93d1d11364ceeb485585b4ae78871: Beginning new tablet copy session on tablet 4a4350cf2ece4769b8547620ac5bedcb from peer 3136daf7101445beadc1aa19bc01c227 at {username='slave'} at 127.21.64.200:39385: session id = 3136daf7101445beadc1aa19bc01c227-4a4350cf2ece4769b8547620ac5bedcb
I20260810 01:59:13.615974 3973 tablet_copy_source_session.cc:215] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:13.618845 8820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a4350cf2ece4769b8547620ac5bedcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:13.653218 8832 tablet_copy_client.cc:806] T 8e8d13caf8054b1daf09b2b114843766 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:13.653645 8832 tablet_copy_client.cc:670] T 8e8d13caf8054b1daf09b2b114843766 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:13.657649 8832 tablet_copy_client.cc:538] T 8e8d13caf8054b1daf09b2b114843766 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:13.662024 8832 tablet_bootstrap.cc:492] T 8e8d13caf8054b1daf09b2b114843766 P 3136daf7101445beadc1aa19bc01c227: Bootstrap starting.
I20260810 01:59:13.662200 8820 tablet_copy_client.cc:806] T 4a4350cf2ece4769b8547620ac5bedcb P 3136daf7101445beadc1aa19bc01c227: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:13.676749 8820 tablet_copy_client.cc:670] T 4a4350cf2ece4769b8547620ac5bedcb P 3136daf7101445beadc1aa19bc01c227: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:13.679494 8820 tablet_copy_client.cc:538] T 4a4350cf2ece4769b8547620ac5bedcb P 3136daf7101445beadc1aa19bc01c227: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:13.685180 8854 ts_tablet_manager.cc:933] T df5b102a0b03406f9449cdd84dfd147e P 4dd4cba155c941b4b7ad4d64c7431536: Initiating tablet copy from peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
I20260810 01:59:13.684013 8820 tablet_bootstrap.cc:492] T 4a4350cf2ece4769b8547620ac5bedcb P 3136daf7101445beadc1aa19bc01c227: Bootstrap starting.
I20260810 01:59:13.699615 6567 raft_consensus.cc:2955] T df5b102a0b03406f9449cdd84dfd147e P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:13.712431 8854 tablet_copy_client.cc:323] T df5b102a0b03406f9449cdd84dfd147e P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.193:36797
I20260810 01:59:13.713594 3787 tablet_copy_service.cc:140] P dc85be7d460a404f997177f57680850f: Received BeginTabletCopySession request for tablet df5b102a0b03406f9449cdd84dfd147e from peer 4dd4cba155c941b4b7ad4d64c7431536 ({username='slave'} at 127.21.64.197:44713)
I20260810 01:59:13.713784 3787 tablet_copy_service.cc:161] P dc85be7d460a404f997177f57680850f: Beginning new tablet copy session on tablet df5b102a0b03406f9449cdd84dfd147e from peer 4dd4cba155c941b4b7ad4d64c7431536 at {username='slave'} at 127.21.64.197:44713: session id = 4dd4cba155c941b4b7ad4d64c7431536-df5b102a0b03406f9449cdd84dfd147e
I20260810 01:59:13.718173 3787 tablet_copy_source_session.cc:215] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:13.719664 8854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df5b102a0b03406f9449cdd84dfd147e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:13.727402 8854 tablet_copy_client.cc:806] T df5b102a0b03406f9449cdd84dfd147e P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:13.727749 8854 tablet_copy_client.cc:670] T df5b102a0b03406f9449cdd84dfd147e P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:13.729832 8854 tablet_copy_client.cc:538] T df5b102a0b03406f9449cdd84dfd147e P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:13.741252 8870 ts_tablet_manager.cc:933] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 3136daf7101445beadc1aa19bc01c227: Initiating tablet copy from peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 01:59:13.762765 8756 tablet_bootstrap.cc:492] T 4fc45932b9634d6d98d8a0204d4b121a P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:13.763631 8756 tablet_bootstrap.cc:492] T 4fc45932b9634d6d98d8a0204d4b121a P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap complete.
I20260810 01:59:13.763999 8756 ts_tablet_manager.cc:1403] T 4fc45932b9634d6d98d8a0204d4b121a P 4dd4cba155c941b4b7ad4d64c7431536: Time spent bootstrapping tablet: real 0.435s user 0.054s sys 0.012s
I20260810 01:59:13.765128 8756 raft_consensus.cc:359] T 4fc45932b9634d6d98d8a0204d4b121a P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:13.765429 8756 raft_consensus.cc:740] T 4fc45932b9634d6d98d8a0204d4b121a P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dd4cba155c941b4b7ad4d64c7431536, State: Initialized, Role: FOLLOWER
I20260810 01:59:13.765800 8756 consensus_queue.cc:260] T 4fc45932b9634d6d98d8a0204d4b121a P 4dd4cba155c941b4b7ad4d64c7431536 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:13.767736 8870 tablet_copy_client.cc:323] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.194:43893
I20260810 01:59:13.772202 3973 tablet_copy_service.cc:140] P 82f93d1d11364ceeb485585b4ae78871: Received BeginTabletCopySession request for tablet 18a93b1a1ce1440b99bdd7a3bcf49064 from peer 3136daf7101445beadc1aa19bc01c227 ({username='slave'} at 127.21.64.200:39385)
I20260810 01:59:13.772418 3973 tablet_copy_service.cc:161] P 82f93d1d11364ceeb485585b4ae78871: Beginning new tablet copy session on tablet 18a93b1a1ce1440b99bdd7a3bcf49064 from peer 3136daf7101445beadc1aa19bc01c227 at {username='slave'} at 127.21.64.200:39385: session id = 3136daf7101445beadc1aa19bc01c227-18a93b1a1ce1440b99bdd7a3bcf49064
I20260810 01:59:13.774216 8756 ts_tablet_manager.cc:1434] T 4fc45932b9634d6d98d8a0204d4b121a P 4dd4cba155c941b4b7ad4d64c7431536: Time spent starting tablet: real 0.010s user 0.005s sys 0.000s
I20260810 01:59:13.774317 8854 tablet_bootstrap.cc:492] T df5b102a0b03406f9449cdd84dfd147e P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap starting.
I20260810 01:59:13.776185 3973 tablet_copy_source_session.cc:215] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:13.779064 4162 tablet_copy_service.cc:342] P 17b49c694faf479ea2e5083470fc0302: Request end of tablet copy session 4dd4cba155c941b4b7ad4d64c7431536-4fc45932b9634d6d98d8a0204d4b121a received from {username='slave'} at 127.21.64.197:39923
I20260810 01:59:13.779268 4162 tablet_copy_service.cc:434] P 17b49c694faf479ea2e5083470fc0302: ending tablet copy session 4dd4cba155c941b4b7ad4d64c7431536-4fc45932b9634d6d98d8a0204d4b121a on tablet 4fc45932b9634d6d98d8a0204d4b121a with peer 4dd4cba155c941b4b7ad4d64c7431536
I20260810 01:59:13.780184 8361 tablet_bootstrap.cc:492] T a586b7d625bb4c27a6343ae7918c8cea P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:13.782181 8870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18a93b1a1ce1440b99bdd7a3bcf49064. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:13.780704 8361 tablet_bootstrap.cc:492] T a586b7d625bb4c27a6343ae7918c8cea P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap complete.
I20260810 01:59:13.782799 8361 ts_tablet_manager.cc:1403] T a586b7d625bb4c27a6343ae7918c8cea P c5ed5317da9c464b93f979c405f0f6e4: Time spent bootstrapping tablet: real 0.464s user 0.033s sys 0.030s
I20260810 01:59:13.788362 8361 raft_consensus.cc:359] T a586b7d625bb4c27a6343ae7918c8cea P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:13.794076 8361 raft_consensus.cc:740] T a586b7d625bb4c27a6343ae7918c8cea P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ed5317da9c464b93f979c405f0f6e4, State: Initialized, Role: FOLLOWER
I20260810 01:59:13.794458 8361 consensus_queue.cc:260] T a586b7d625bb4c27a6343ae7918c8cea P c5ed5317da9c464b93f979c405f0f6e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:13.798373 8361 ts_tablet_manager.cc:1434] T a586b7d625bb4c27a6343ae7918c8cea P c5ed5317da9c464b93f979c405f0f6e4: Time spent starting tablet: real 0.011s user 0.001s sys 0.000s
I20260810 01:59:13.801730 4337 tablet_copy_service.cc:342] P ca4469fc2dbc48488bc7ad7f482f129e: Request end of tablet copy session c5ed5317da9c464b93f979c405f0f6e4-a586b7d625bb4c27a6343ae7918c8cea received from {username='slave'} at 127.21.64.199:45727
I20260810 01:59:13.801890 4337 tablet_copy_service.cc:434] P ca4469fc2dbc48488bc7ad7f482f129e: ending tablet copy session c5ed5317da9c464b93f979c405f0f6e4-a586b7d625bb4c27a6343ae7918c8cea on tablet a586b7d625bb4c27a6343ae7918c8cea with peer c5ed5317da9c464b93f979c405f0f6e4
I20260810 01:59:13.858036 8820 tablet_bootstrap.cc:492] T 4a4350cf2ece4769b8547620ac5bedcb P 3136daf7101445beadc1aa19bc01c227: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:13.858714 8820 tablet_bootstrap.cc:492] T 4a4350cf2ece4769b8547620ac5bedcb P 3136daf7101445beadc1aa19bc01c227: Bootstrap complete.
I20260810 01:59:13.859088 8820 ts_tablet_manager.cc:1403] T 4a4350cf2ece4769b8547620ac5bedcb P 3136daf7101445beadc1aa19bc01c227: Time spent bootstrapping tablet: real 0.175s user 0.052s sys 0.000s
I20260810 01:59:13.860296 8820 raft_consensus.cc:359] T 4a4350cf2ece4769b8547620ac5bedcb P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:13.860632 8820 raft_consensus.cc:740] T 4a4350cf2ece4769b8547620ac5bedcb P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3136daf7101445beadc1aa19bc01c227, State: Initialized, Role: FOLLOWER
I20260810 01:59:13.860981 8820 consensus_queue.cc:260] T 4a4350cf2ece4769b8547620ac5bedcb P 3136daf7101445beadc1aa19bc01c227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:13.868369 8820 ts_tablet_manager.cc:1434] T 4a4350cf2ece4769b8547620ac5bedcb P 3136daf7101445beadc1aa19bc01c227: Time spent starting tablet: real 0.009s user 0.008s sys 0.000s
I20260810 01:59:13.870536 3973 tablet_copy_service.cc:342] P 82f93d1d11364ceeb485585b4ae78871: Request end of tablet copy session 3136daf7101445beadc1aa19bc01c227-4a4350cf2ece4769b8547620ac5bedcb received from {username='slave'} at 127.21.64.200:39385
I20260810 01:59:13.870752 3973 tablet_copy_service.cc:434] P 82f93d1d11364ceeb485585b4ae78871: ending tablet copy session 3136daf7101445beadc1aa19bc01c227-4a4350cf2ece4769b8547620ac5bedcb on tablet 4a4350cf2ece4769b8547620ac5bedcb with peer 3136daf7101445beadc1aa19bc01c227
I20260810 01:59:13.884703 3761 consensus_queue.cc:237] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:13.886000 6397 raft_consensus.cc:1217] T 4fc45932b9634d6d98d8a0204d4b121a P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
W20260810 01:59:13.898298 3672 consensus_peers.cc:597] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f -> Peer 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317): Couldn't send request to peer 22ce0e487f0341fd9bf853393d6e7683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3a15b27dbdaf4092aea66c3670204fcc. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:13.898662 4132 raft_consensus.cc:1275] T 3a15b27dbdaf4092aea66c3670204fcc P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:13.899432 8802 consensus_queue.cc:1048] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:13.907212 4311 raft_consensus.cc:1275] T 3a15b27dbdaf4092aea66c3670204fcc P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:13.908406 8802 consensus_queue.cc:1048] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:13.923914 8870 tablet_copy_client.cc:806] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:13.930084 8802 raft_consensus.cc:2955] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:13.932016 8870 tablet_copy_client.cc:670] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:13.932047 8832 tablet_bootstrap.cc:492] T 8e8d13caf8054b1daf09b2b114843766 P 3136daf7101445beadc1aa19bc01c227: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:13.933621 8832 tablet_bootstrap.cc:492] T 8e8d13caf8054b1daf09b2b114843766 P 3136daf7101445beadc1aa19bc01c227: Bootstrap complete.
I20260810 01:59:13.934036 8832 ts_tablet_manager.cc:1403] T 8e8d13caf8054b1daf09b2b114843766 P 3136daf7101445beadc1aa19bc01c227: Time spent bootstrapping tablet: real 0.272s user 0.050s sys 0.020s
I20260810 01:59:13.933655 4310 raft_consensus.cc:2955] T 3a15b27dbdaf4092aea66c3670204fcc P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:13.935130 8832 raft_consensus.cc:359] T 8e8d13caf8054b1daf09b2b114843766 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:13.935475 8832 raft_consensus.cc:740] T 8e8d13caf8054b1daf09b2b114843766 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3136daf7101445beadc1aa19bc01c227, State: Initialized, Role: FOLLOWER
I20260810 01:59:13.935822 8832 consensus_queue.cc:260] T 8e8d13caf8054b1daf09b2b114843766 P 3136daf7101445beadc1aa19bc01c227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:13.937645 8832 ts_tablet_manager.cc:1434] T 8e8d13caf8054b1daf09b2b114843766 P 3136daf7101445beadc1aa19bc01c227: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260810 01:59:13.939750 3973 tablet_copy_service.cc:342] P 82f93d1d11364ceeb485585b4ae78871: Request end of tablet copy session 3136daf7101445beadc1aa19bc01c227-8e8d13caf8054b1daf09b2b114843766 received from {username='slave'} at 127.21.64.200:39385
I20260810 01:59:13.939965 3973 tablet_copy_service.cc:434] P 82f93d1d11364ceeb485585b4ae78871: ending tablet copy session 3136daf7101445beadc1aa19bc01c227-8e8d13caf8054b1daf09b2b114843766 on tablet 8e8d13caf8054b1daf09b2b114843766 with peer 3136daf7101445beadc1aa19bc01c227
I20260810 01:59:13.942644 4129 raft_consensus.cc:2955] T 3a15b27dbdaf4092aea66c3670204fcc P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:13.949878 8870 tablet_copy_client.cc:538] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:13.949831 3572 catalog_manager.cc:5719] T 3a15b27dbdaf4092aea66c3670204fcc P 17b49c694faf479ea2e5083470fc0302 reported cstate change: config changed from index -1 to 4, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:13.961786 8870 tablet_bootstrap.cc:492] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 3136daf7101445beadc1aa19bc01c227: Bootstrap starting.
I20260810 01:59:13.973452 8854 tablet_bootstrap.cc:492] T df5b102a0b03406f9449cdd84dfd147e P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:13.974050 8854 tablet_bootstrap.cc:492] T df5b102a0b03406f9449cdd84dfd147e P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap complete.
I20260810 01:59:13.975592 8854 ts_tablet_manager.cc:1403] T df5b102a0b03406f9449cdd84dfd147e P 4dd4cba155c941b4b7ad4d64c7431536: Time spent bootstrapping tablet: real 0.201s user 0.065s sys 0.003s
I20260810 01:59:13.981001 8854 raft_consensus.cc:359] T df5b102a0b03406f9449cdd84dfd147e P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:13.981386 8854 raft_consensus.cc:740] T df5b102a0b03406f9449cdd84dfd147e P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dd4cba155c941b4b7ad4d64c7431536, State: Initialized, Role: FOLLOWER
I20260810 01:59:13.984920 8854 consensus_queue.cc:260] T df5b102a0b03406f9449cdd84dfd147e P 4dd4cba155c941b4b7ad4d64c7431536 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 1.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:13.986649 8854 ts_tablet_manager.cc:1434] T df5b102a0b03406f9449cdd84dfd147e P 4dd4cba155c941b4b7ad4d64c7431536: Time spent starting tablet: real 0.011s user 0.000s sys 0.003s
I20260810 01:59:13.988114 3787 tablet_copy_service.cc:342] P dc85be7d460a404f997177f57680850f: Request end of tablet copy session 4dd4cba155c941b4b7ad4d64c7431536-df5b102a0b03406f9449cdd84dfd147e received from {username='slave'} at 127.21.64.197:44713
I20260810 01:59:13.988240 3787 tablet_copy_service.cc:434] P dc85be7d460a404f997177f57680850f: ending tablet copy session 4dd4cba155c941b4b7ad4d64c7431536-df5b102a0b03406f9449cdd84dfd147e on tablet df5b102a0b03406f9449cdd84dfd147e with peer 4dd4cba155c941b4b7ad4d64c7431536
I20260810 01:59:14.002647 3943 consensus_queue.cc:237] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:14.017051 6909 raft_consensus.cc:1217] T 8e8d13caf8054b1daf09b2b114843766 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20260810 01:59:14.038435 6397 raft_consensus.cc:1275] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:14.039444 8766 consensus_queue.cc:1048] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:14.045387 3761 raft_consensus.cc:1275] T b6c5892f4de449fb8cb7f4cff7eb2e20 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:14.047504 8769 consensus_queue.cc:1048] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:14.120081 8769 raft_consensus.cc:2955] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:14.130196 3761 raft_consensus.cc:2955] T b6c5892f4de449fb8cb7f4cff7eb2e20 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:14.141397 6395 raft_consensus.cc:2955] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:14.162106 3572 catalog_manager.cc:5719] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 4dd4cba155c941b4b7ad4d64c7431536 reported cstate change: config changed from index 4 to 5, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:14.169555 4310 raft_consensus.cc:1275] T b6c5892f4de449fb8cb7f4cff7eb2e20 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:14.172022 6909 raft_consensus.cc:1217] T 4a4350cf2ece4769b8547620ac5bedcb P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20260810 01:59:14.178608 6397 raft_consensus.cc:1217] T df5b102a0b03406f9449cdd84dfd147e P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.5->[1.6-1.6] Dedup: 1.6->[]
I20260810 01:59:14.186486 8766 consensus_queue.cc:1048] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:14.196211 4310 raft_consensus.cc:2955] T b6c5892f4de449fb8cb7f4cff7eb2e20 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:14.197085 6739 raft_consensus.cc:1217] T a586b7d625bb4c27a6343ae7918c8cea P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
W20260810 01:59:14.210359 3857 consensus_peers.cc:597] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 -> Peer 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317): Couldn't send request to peer 22ce0e487f0341fd9bf853393d6e7683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b6c5892f4de449fb8cb7f4cff7eb2e20. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:14.263996 8870 tablet_bootstrap.cc:492] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 3136daf7101445beadc1aa19bc01c227: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:14.268834 8870 tablet_bootstrap.cc:492] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 3136daf7101445beadc1aa19bc01c227: Bootstrap complete.
I20260810 01:59:14.270090 8870 ts_tablet_manager.cc:1403] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 3136daf7101445beadc1aa19bc01c227: Time spent bootstrapping tablet: real 0.308s user 0.052s sys 0.015s
I20260810 01:59:14.271442 8870 raft_consensus.cc:359] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:14.272997 8870 raft_consensus.cc:740] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3136daf7101445beadc1aa19bc01c227, State: Initialized, Role: FOLLOWER
I20260810 01:59:14.273713 8870 consensus_queue.cc:260] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 3136daf7101445beadc1aa19bc01c227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:14.279014 8870 ts_tablet_manager.cc:1434] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 3136daf7101445beadc1aa19bc01c227: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260810 01:59:14.284615 3973 tablet_copy_service.cc:342] P 82f93d1d11364ceeb485585b4ae78871: Request end of tablet copy session 3136daf7101445beadc1aa19bc01c227-18a93b1a1ce1440b99bdd7a3bcf49064 received from {username='slave'} at 127.21.64.200:39385
I20260810 01:59:14.284785 3973 tablet_copy_service.cc:434] P 82f93d1d11364ceeb485585b4ae78871: ending tablet copy session 3136daf7101445beadc1aa19bc01c227-18a93b1a1ce1440b99bdd7a3bcf49064 on tablet 18a93b1a1ce1440b99bdd7a3bcf49064 with peer 3136daf7101445beadc1aa19bc01c227
I20260810 01:59:14.308416 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:59:14.326645 6909 raft_consensus.cc:1217] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20260810 01:59:14.337143 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:14.452252 4310 consensus_queue.cc:237] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:14.455241 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:14.488821 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260810 01:59:14.489023 4224 consensus_peers.cc:597] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e -> Peer c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199:41689): Couldn't send request to peer c5ed5317da9c464b93f979c405f0f6e4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1d377b919f4748c88efb249dfc964f17. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:14.489708 6909 raft_consensus.cc:1275] T 1d377b919f4748c88efb249dfc964f17 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:14.490613 9036 ts_tablet_manager.cc:933] T 3a15b27dbdaf4092aea66c3670204fcc P 22ce0e487f0341fd9bf853393d6e7683: Initiating tablet copy from peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
I20260810 01:59:14.490702 8385 consensus_queue.cc:1048] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:14.512830 4132 raft_consensus.cc:1275] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:14.514058 8388 consensus_queue.cc:1048] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:14.528473 3943 raft_consensus.cc:1275] T 1d377b919f4748c88efb249dfc964f17 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:14.529747 8385 consensus_queue.cc:1048] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:14.531430 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:14.556627 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:14.562040 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:14.566052 9036 tablet_copy_client.cc:323] T 3a15b27dbdaf4092aea66c3670204fcc P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.193:36797
I20260810 01:59:14.596947 3787 tablet_copy_service.cc:140] P dc85be7d460a404f997177f57680850f: Received BeginTabletCopySession request for tablet 3a15b27dbdaf4092aea66c3670204fcc from peer 22ce0e487f0341fd9bf853393d6e7683 ({username='slave'} at 127.21.64.198:55265)
I20260810 01:59:14.597147 3787 tablet_copy_service.cc:161] P dc85be7d460a404f997177f57680850f: Beginning new tablet copy session on tablet 3a15b27dbdaf4092aea66c3670204fcc from peer 22ce0e487f0341fd9bf853393d6e7683 at {username='slave'} at 127.21.64.198:55265: session id = 22ce0e487f0341fd9bf853393d6e7683-3a15b27dbdaf4092aea66c3670204fcc
I20260810 01:59:14.602433 3787 tablet_copy_source_session.cc:215] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:14.607304 8388 raft_consensus.cc:2955] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:14.610503 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:14.611575 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:14.613854 3945 raft_consensus.cc:2955] T 1d377b919f4748c88efb249dfc964f17 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:14.617514 4132 raft_consensus.cc:2955] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:14.625253 3572 catalog_manager.cc:5719] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e reported cstate change: config changed from index 4 to 5, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:14.631000 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:59:14.638418 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:14.642442 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:14.647900 9036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a15b27dbdaf4092aea66c3670204fcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:14.655375 9073 ts_tablet_manager.cc:933] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 22ce0e487f0341fd9bf853393d6e7683: Initiating tablet copy from peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 01:59:14.658192 6908 raft_consensus.cc:2955] T 1d377b919f4748c88efb249dfc964f17 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:14.665079 9036 tablet_copy_client.cc:806] T 3a15b27dbdaf4092aea66c3670204fcc P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:14.665482 9036 tablet_copy_client.cc:670] T 3a15b27dbdaf4092aea66c3670204fcc P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:14.671973 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:14.681753 9073 tablet_copy_client.cc:323] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.194:43893
I20260810 01:59:14.682446 6715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:14.698530 9036 tablet_copy_client.cc:538] T 3a15b27dbdaf4092aea66c3670204fcc P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:14.711226 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:14.719871 3973 tablet_copy_service.cc:140] P 82f93d1d11364ceeb485585b4ae78871: Received BeginTabletCopySession request for tablet b6c5892f4de449fb8cb7f4cff7eb2e20 from peer 22ce0e487f0341fd9bf853393d6e7683 ({username='slave'} at 127.21.64.198:54627)
I20260810 01:59:14.720072 3973 tablet_copy_service.cc:161] P 82f93d1d11364ceeb485585b4ae78871: Beginning new tablet copy session on tablet b6c5892f4de449fb8cb7f4cff7eb2e20 from peer 22ce0e487f0341fd9bf853393d6e7683 at {username='slave'} at 127.21.64.198:54627: session id = 22ce0e487f0341fd9bf853393d6e7683-b6c5892f4de449fb8cb7f4cff7eb2e20
I20260810 01:59:14.723663 3973 tablet_copy_source_session.cc:215] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:14.725950 9073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6c5892f4de449fb8cb7f4cff7eb2e20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:14.731488 4311 consensus_queue.cc:237] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:14.733310 9036 tablet_bootstrap.cc:492] T 3a15b27dbdaf4092aea66c3670204fcc P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap starting.
I20260810 01:59:14.740947 3943 raft_consensus.cc:1275] T 8308d63e9002418b876c3d3ae0095d9f P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:14.742004 8385 consensus_queue.cc:1048] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:14.743222 6567 raft_consensus.cc:1275] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:14.743992 9071 consensus_queue.cc:1048] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:14.745445 3761 raft_consensus.cc:1275] T 8308d63e9002418b876c3d3ae0095d9f P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
W20260810 01:59:14.746676 4219 consensus_peers.cc:597] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e -> Peer 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995): Couldn't send request to peer 3136daf7101445beadc1aa19bc01c227. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8308d63e9002418b876c3d3ae0095d9f. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:14.747004 9071 consensus_queue.cc:1048] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:14.765074 6715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:14.765072 9073 tablet_copy_client.cc:806] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:14.765415 9073 tablet_copy_client.cc:670] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:14.771845 9073 tablet_copy_client.cc:538] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:14.808204 3756 consensus_queue.cc:237] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:14.809969 9073 tablet_bootstrap.cc:492] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap starting.
W20260810 01:59:14.811585 3670 consensus_peers.cc:597] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f -> Peer 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197:38787): Couldn't send request to peer 4dd4cba155c941b4b7ad4d64c7431536. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3a15b27dbdaf4092aea66c3670204fcc. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:14.813146 4129 raft_consensus.cc:1275] T 3a15b27dbdaf4092aea66c3670204fcc P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:14.813973 8189 consensus_queue.cc:1048] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:14.816892 4310 raft_consensus.cc:1275] T 3a15b27dbdaf4092aea66c3670204fcc P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:14.817782 9068 consensus_queue.cc:1048] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:14.818282 8385 raft_consensus.cc:2955] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:14.821470 8189 raft_consensus.cc:2955] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:14.825760 3945 raft_consensus.cc:2955] T 8308d63e9002418b876c3d3ae0095d9f P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:14.834271 3565 catalog_manager.cc:5719] T 8308d63e9002418b876c3d3ae0095d9f P 82f93d1d11364ceeb485585b4ae78871 reported cstate change: config changed from index 4 to 5, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:14.869042 4310 raft_consensus.cc:2955] T 3a15b27dbdaf4092aea66c3670204fcc P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:14.878314 3756 raft_consensus.cc:2955] T 8308d63e9002418b876c3d3ae0095d9f P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
W20260810 01:59:14.895038 3672 consensus_peers.cc:597] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f -> Peer 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317): Couldn't send request to peer 22ce0e487f0341fd9bf853393d6e7683. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:14.906960 4129 raft_consensus.cc:2955] T 3a15b27dbdaf4092aea66c3670204fcc P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:14.915474 3565 catalog_manager.cc:5719] T 3a15b27dbdaf4092aea66c3670204fcc P 17b49c694faf479ea2e5083470fc0302 reported cstate change: config changed from index 4 to 5, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:14.934216 6567 raft_consensus.cc:2955] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:15.036203 9036 tablet_bootstrap.cc:492] T 3a15b27dbdaf4092aea66c3670204fcc P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:15.036803 9036 tablet_bootstrap.cc:492] T 3a15b27dbdaf4092aea66c3670204fcc P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap complete.
I20260810 01:59:15.037159 9036 ts_tablet_manager.cc:1403] T 3a15b27dbdaf4092aea66c3670204fcc P 22ce0e487f0341fd9bf853393d6e7683: Time spent bootstrapping tablet: real 0.304s user 0.047s sys 0.005s
I20260810 01:59:15.038127 9036 raft_consensus.cc:359] T 3a15b27dbdaf4092aea66c3670204fcc P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:15.038388 9036 raft_consensus.cc:740] T 3a15b27dbdaf4092aea66c3670204fcc P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ce0e487f0341fd9bf853393d6e7683, State: Initialized, Role: FOLLOWER
I20260810 01:59:15.036203 9117 ts_tablet_manager.cc:933] T 1d377b919f4748c88efb249dfc964f17 P c5ed5317da9c464b93f979c405f0f6e4: Initiating tablet copy from peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943)
I20260810 01:59:15.038762 9036 consensus_queue.cc:260] T 3a15b27dbdaf4092aea66c3670204fcc P 22ce0e487f0341fd9bf853393d6e7683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:15.040541 9036 ts_tablet_manager.cc:1434] T 3a15b27dbdaf4092aea66c3670204fcc P 22ce0e487f0341fd9bf853393d6e7683: Time spent starting tablet: real 0.003s user 0.006s sys 0.000s
I20260810 01:59:15.042518 3787 tablet_copy_service.cc:342] P dc85be7d460a404f997177f57680850f: Request end of tablet copy session 22ce0e487f0341fd9bf853393d6e7683-3a15b27dbdaf4092aea66c3670204fcc received from {username='slave'} at 127.21.64.198:55265
I20260810 01:59:15.042685 3787 tablet_copy_service.cc:434] P dc85be7d460a404f997177f57680850f: ending tablet copy session 22ce0e487f0341fd9bf853393d6e7683-3a15b27dbdaf4092aea66c3670204fcc on tablet 3a15b27dbdaf4092aea66c3670204fcc with peer 22ce0e487f0341fd9bf853393d6e7683
I20260810 01:59:15.080120 9073 tablet_bootstrap.cc:492] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:15.080852 9073 tablet_bootstrap.cc:492] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap complete.
I20260810 01:59:15.081285 9073 ts_tablet_manager.cc:1403] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 22ce0e487f0341fd9bf853393d6e7683: Time spent bootstrapping tablet: real 0.271s user 0.050s sys 0.010s
I20260810 01:59:15.082582 9073 raft_consensus.cc:359] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:15.083012 9073 raft_consensus.cc:740] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ce0e487f0341fd9bf853393d6e7683, State: Initialized, Role: FOLLOWER
I20260810 01:59:15.083333 9073 consensus_queue.cc:260] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 22ce0e487f0341fd9bf853393d6e7683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:15.084211 9073 ts_tablet_manager.cc:1434] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 22ce0e487f0341fd9bf853393d6e7683: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 01:59:15.087065 3973 tablet_copy_service.cc:342] P 82f93d1d11364ceeb485585b4ae78871: Request end of tablet copy session 22ce0e487f0341fd9bf853393d6e7683-b6c5892f4de449fb8cb7f4cff7eb2e20 received from {username='slave'} at 127.21.64.198:54627
I20260810 01:59:15.087373 3973 tablet_copy_service.cc:434] P 82f93d1d11364ceeb485585b4ae78871: ending tablet copy session 22ce0e487f0341fd9bf853393d6e7683-b6c5892f4de449fb8cb7f4cff7eb2e20 on tablet b6c5892f4de449fb8cb7f4cff7eb2e20 with peer 22ce0e487f0341fd9bf853393d6e7683
I20260810 01:59:15.104987 9117 tablet_copy_client.cc:323] T 1d377b919f4748c88efb249dfc964f17 P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.196:41943
I20260810 01:59:15.105969 4337 tablet_copy_service.cc:140] P ca4469fc2dbc48488bc7ad7f482f129e: Received BeginTabletCopySession request for tablet 1d377b919f4748c88efb249dfc964f17 from peer c5ed5317da9c464b93f979c405f0f6e4 ({username='slave'} at 127.21.64.199:45727)
I20260810 01:59:15.106245 4337 tablet_copy_service.cc:161] P ca4469fc2dbc48488bc7ad7f482f129e: Beginning new tablet copy session on tablet 1d377b919f4748c88efb249dfc964f17 from peer c5ed5317da9c464b93f979c405f0f6e4 at {username='slave'} at 127.21.64.199:45727: session id = c5ed5317da9c464b93f979c405f0f6e4-1d377b919f4748c88efb249dfc964f17
I20260810 01:59:15.111140 4337 tablet_copy_source_session.cc:215] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:15.117635 9117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d377b919f4748c88efb249dfc964f17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:15.136543 9117 tablet_copy_client.cc:806] T 1d377b919f4748c88efb249dfc964f17 P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:15.136905 9117 tablet_copy_client.cc:670] T 1d377b919f4748c88efb249dfc964f17 P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:15.141489 9117 tablet_copy_client.cc:538] T 1d377b919f4748c88efb249dfc964f17 P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:15.150722 9117 tablet_bootstrap.cc:492] T 1d377b919f4748c88efb249dfc964f17 P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap starting.
I20260810 01:59:15.168391 3945 consensus_queue.cc:237] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
W20260810 01:59:15.181802 3855 consensus_peers.cc:597] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 -> Peer 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995): Couldn't send request to peer 3136daf7101445beadc1aa19bc01c227. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f7a36f7ebd5d4342a259b093e45d4c32. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:15.188357 6397 raft_consensus.cc:1275] T f7a36f7ebd5d4342a259b093e45d4c32 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:15.189919 8769 consensus_queue.cc:1048] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:15.217398 4311 raft_consensus.cc:1275] T f7a36f7ebd5d4342a259b093e45d4c32 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:15.218554 8766 consensus_queue.cc:1048] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:15.219956 6567 raft_consensus.cc:1217] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20260810 01:59:15.230535 3943 consensus_queue.cc:237] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:15.240003 3756 raft_consensus.cc:1275] T f7a36f7ebd5d4342a259b093e45d4c32 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:15.240829 8769 consensus_queue.cc:1048] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:15.245579 9154 ts_tablet_manager.cc:933] T 8308d63e9002418b876c3d3ae0095d9f P 3136daf7101445beadc1aa19bc01c227: Initiating tablet copy from peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943)
I20260810 01:59:15.247247 8769 raft_consensus.cc:2955] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:15.264683 6397 raft_consensus.cc:2955] T f7a36f7ebd5d4342a259b093e45d4c32 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
W20260810 01:59:15.332882 3857 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.196:41943, user_credentials={real_user=slave}} blocked reactor thread for 97748.4us
I20260810 01:59:15.336047 6908 raft_consensus.cc:1275] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:15.337447 3761 raft_consensus.cc:2955] T f7a36f7ebd5d4342a259b093e45d4c32 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:15.350076 3572 catalog_manager.cc:5719] T f7a36f7ebd5d4342a259b093e45d4c32 P dc85be7d460a404f997177f57680850f reported cstate change: config changed from index 4 to 5, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:15.358575 4311 raft_consensus.cc:1275] T 18a93b1a1ce1440b99bdd7a3bcf49064 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:15.359617 9173 consensus_queue.cc:1048] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:15.361779 9117 tablet_bootstrap.cc:492] T 1d377b919f4748c88efb249dfc964f17 P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:15.361829 9154 tablet_copy_client.cc:323] T 8308d63e9002418b876c3d3ae0095d9f P 3136daf7101445beadc1aa19bc01c227: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.196:41943
I20260810 01:59:15.362386 9117 tablet_bootstrap.cc:492] T 1d377b919f4748c88efb249dfc964f17 P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap complete.
I20260810 01:59:15.362860 4337 tablet_copy_service.cc:140] P ca4469fc2dbc48488bc7ad7f482f129e: Received BeginTabletCopySession request for tablet 8308d63e9002418b876c3d3ae0095d9f from peer 3136daf7101445beadc1aa19bc01c227 ({username='slave'} at 127.21.64.200:36881)
I20260810 01:59:15.363090 4337 tablet_copy_service.cc:161] P ca4469fc2dbc48488bc7ad7f482f129e: Beginning new tablet copy session on tablet 8308d63e9002418b876c3d3ae0095d9f from peer 3136daf7101445beadc1aa19bc01c227 at {username='slave'} at 127.21.64.200:36881: session id = 3136daf7101445beadc1aa19bc01c227-8308d63e9002418b876c3d3ae0095d9f
I20260810 01:59:15.365936 9117 ts_tablet_manager.cc:1403] T 1d377b919f4748c88efb249dfc964f17 P c5ed5317da9c464b93f979c405f0f6e4: Time spent bootstrapping tablet: real 0.215s user 0.078s sys 0.010s
I20260810 01:59:15.366753 9117 raft_consensus.cc:359] T 1d377b919f4748c88efb249dfc964f17 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:15.367008 9117 raft_consensus.cc:740] T 1d377b919f4748c88efb249dfc964f17 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ed5317da9c464b93f979c405f0f6e4, State: Initialized, Role: FOLLOWER
I20260810 01:59:15.368791 9117 consensus_queue.cc:260] T 1d377b919f4748c88efb249dfc964f17 P c5ed5317da9c464b93f979c405f0f6e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:15.372148 4337 tablet_copy_source_session.cc:215] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:15.372738 8766 consensus_queue.cc:1048] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:15.376459 9117 ts_tablet_manager.cc:1434] T 1d377b919f4748c88efb249dfc964f17 P c5ed5317da9c464b93f979c405f0f6e4: Time spent starting tablet: real 0.010s user 0.004s sys 0.001s
I20260810 01:59:15.378186 9154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8308d63e9002418b876c3d3ae0095d9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:15.379878 4132 raft_consensus.cc:1275] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:15.388278 9154 tablet_copy_client.cc:806] T 8308d63e9002418b876c3d3ae0095d9f P 3136daf7101445beadc1aa19bc01c227: tablet copy: Starting download of 0 data blocks...
W20260810 01:59:15.397257 3858 consensus_peers.cc:597] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871 -> Peer c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199:41689): Couldn't send request to peer c5ed5317da9c464b93f979c405f0f6e4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 18a93b1a1ce1440b99bdd7a3bcf49064. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:15.397713 9154 tablet_copy_client.cc:670] T 8308d63e9002418b876c3d3ae0095d9f P 3136daf7101445beadc1aa19bc01c227: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:15.400717 9154 tablet_copy_client.cc:538] T 8308d63e9002418b876c3d3ae0095d9f P 3136daf7101445beadc1aa19bc01c227: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:15.401749 9192 ts_tablet_manager.cc:933] T 3a15b27dbdaf4092aea66c3670204fcc P 4dd4cba155c941b4b7ad4d64c7431536: Initiating tablet copy from peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
I20260810 01:59:15.405428 9154 tablet_bootstrap.cc:492] T 8308d63e9002418b876c3d3ae0095d9f P 3136daf7101445beadc1aa19bc01c227: Bootstrap starting.
I20260810 01:59:15.405516 4337 tablet_copy_service.cc:342] P ca4469fc2dbc48488bc7ad7f482f129e: Request end of tablet copy session c5ed5317da9c464b93f979c405f0f6e4-1d377b919f4748c88efb249dfc964f17 received from {username='slave'} at 127.21.64.199:45727
I20260810 01:59:15.405689 4337 tablet_copy_service.cc:434] P ca4469fc2dbc48488bc7ad7f482f129e: ending tablet copy session c5ed5317da9c464b93f979c405f0f6e4-1d377b919f4748c88efb249dfc964f17 on tablet 1d377b919f4748c88efb249dfc964f17 with peer c5ed5317da9c464b93f979c405f0f6e4
I20260810 01:59:15.406667 9192 tablet_copy_client.cc:323] T 3a15b27dbdaf4092aea66c3670204fcc P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.193:36797
I20260810 01:59:15.407564 3787 tablet_copy_service.cc:140] P dc85be7d460a404f997177f57680850f: Received BeginTabletCopySession request for tablet 3a15b27dbdaf4092aea66c3670204fcc from peer 4dd4cba155c941b4b7ad4d64c7431536 ({username='slave'} at 127.21.64.197:44713)
I20260810 01:59:15.407788 3787 tablet_copy_service.cc:161] P dc85be7d460a404f997177f57680850f: Beginning new tablet copy session on tablet 3a15b27dbdaf4092aea66c3670204fcc from peer 4dd4cba155c941b4b7ad4d64c7431536 at {username='slave'} at 127.21.64.197:44713: session id = 4dd4cba155c941b4b7ad4d64c7431536-3a15b27dbdaf4092aea66c3670204fcc
I20260810 01:59:15.418058 3787 tablet_copy_source_session.cc:215] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:15.419973 9192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a15b27dbdaf4092aea66c3670204fcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:15.428331 9192 tablet_copy_client.cc:806] T 3a15b27dbdaf4092aea66c3670204fcc P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:15.428630 9192 tablet_copy_client.cc:670] T 3a15b27dbdaf4092aea66c3670204fcc P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:15.429584 9173 consensus_queue.cc:1048] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:15.434507 8766 raft_consensus.cc:2955] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:15.448616 9192 tablet_copy_client.cc:538] T 3a15b27dbdaf4092aea66c3670204fcc P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:15.449021 4132 raft_consensus.cc:2955] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:15.459434 3565 catalog_manager.cc:5719] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302 reported cstate change: config changed from index 4 to 5, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:15.462469 9192 tablet_bootstrap.cc:492] T 3a15b27dbdaf4092aea66c3670204fcc P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap starting.
I20260810 01:59:15.466365 4311 consensus_queue.cc:237] T 606ad043ee3344c39c9eef7cd1920d7e P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:15.474421 4310 raft_consensus.cc:2955] T 18a93b1a1ce1440b99bdd7a3bcf49064 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:15.485670 6567 raft_consensus.cc:2955] T 3a15b27dbdaf4092aea66c3670204fcc P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:15.520689 6739 raft_consensus.cc:1217] T 1d377b919f4748c88efb249dfc964f17 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
W20260810 01:59:15.531420 4219 consensus_peers.cc:597] T 606ad043ee3344c39c9eef7cd1920d7e P ca4469fc2dbc48488bc7ad7f482f129e -> Peer 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995): Couldn't send request to peer 3136daf7101445beadc1aa19bc01c227. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 606ad043ee3344c39c9eef7cd1920d7e. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:15.531809 4132 raft_consensus.cc:1275] T 606ad043ee3344c39c9eef7cd1920d7e P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:15.532812 9101 consensus_queue.cc:1048] T 606ad043ee3344c39c9eef7cd1920d7e P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:15.534593 3756 raft_consensus.cc:1275] T 606ad043ee3344c39c9eef7cd1920d7e P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:15.535292 9101 consensus_queue.cc:1048] T 606ad043ee3344c39c9eef7cd1920d7e P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:15.560421 6909 raft_consensus.cc:2955] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:15.572160 9101 raft_consensus.cc:2955] T 606ad043ee3344c39c9eef7cd1920d7e P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:15.578408 9154 tablet_bootstrap.cc:492] T 8308d63e9002418b876c3d3ae0095d9f P 3136daf7101445beadc1aa19bc01c227: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:15.578907 9154 tablet_bootstrap.cc:492] T 8308d63e9002418b876c3d3ae0095d9f P 3136daf7101445beadc1aa19bc01c227: Bootstrap complete.
I20260810 01:59:15.577138 3761 raft_consensus.cc:2955] T 606ad043ee3344c39c9eef7cd1920d7e P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:15.579223 9154 ts_tablet_manager.cc:1403] T 8308d63e9002418b876c3d3ae0095d9f P 3136daf7101445beadc1aa19bc01c227: Time spent bootstrapping tablet: real 0.174s user 0.058s sys 0.008s
I20260810 01:59:15.580090 9154 raft_consensus.cc:359] T 8308d63e9002418b876c3d3ae0095d9f P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:15.580329 9154 raft_consensus.cc:740] T 8308d63e9002418b876c3d3ae0095d9f P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3136daf7101445beadc1aa19bc01c227, State: Initialized, Role: FOLLOWER
I20260810 01:59:15.582129 9154 consensus_queue.cc:260] T 8308d63e9002418b876c3d3ae0095d9f P 3136daf7101445beadc1aa19bc01c227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:15.583629 9154 ts_tablet_manager.cc:1434] T 8308d63e9002418b876c3d3ae0095d9f P 3136daf7101445beadc1aa19bc01c227: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
I20260810 01:59:15.584335 4337 tablet_copy_service.cc:342] P ca4469fc2dbc48488bc7ad7f482f129e: Request end of tablet copy session 3136daf7101445beadc1aa19bc01c227-8308d63e9002418b876c3d3ae0095d9f received from {username='slave'} at 127.21.64.200:36881
I20260810 01:59:15.584483 4337 tablet_copy_service.cc:434] P ca4469fc2dbc48488bc7ad7f482f129e: ending tablet copy session 3136daf7101445beadc1aa19bc01c227-8308d63e9002418b876c3d3ae0095d9f on tablet 8308d63e9002418b876c3d3ae0095d9f with peer 3136daf7101445beadc1aa19bc01c227
I20260810 01:59:15.639107 3565 catalog_manager.cc:5719] T 606ad043ee3344c39c9eef7cd1920d7e P dc85be7d460a404f997177f57680850f reported cstate change: config changed from index -1 to 4, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
W20260810 01:59:15.651624 4220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.195:39189, user_credentials={real_user=slave}} blocked reactor thread for 58550.7us
I20260810 01:59:15.652701 4132 raft_consensus.cc:2955] T 606ad043ee3344c39c9eef7cd1920d7e P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:15.683450 6909 raft_consensus.cc:1217] T 8308d63e9002418b876c3d3ae0095d9f P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20260810 01:59:15.706022 9192 tablet_bootstrap.cc:492] T 3a15b27dbdaf4092aea66c3670204fcc P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:15.706682 9192 tablet_bootstrap.cc:492] T 3a15b27dbdaf4092aea66c3670204fcc P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap complete.
I20260810 01:59:15.707078 9192 ts_tablet_manager.cc:1403] T 3a15b27dbdaf4092aea66c3670204fcc P 4dd4cba155c941b4b7ad4d64c7431536: Time spent bootstrapping tablet: real 0.245s user 0.060s sys 0.007s
I20260810 01:59:15.708078 9192 raft_consensus.cc:359] T 3a15b27dbdaf4092aea66c3670204fcc P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:15.708431 9192 raft_consensus.cc:740] T 3a15b27dbdaf4092aea66c3670204fcc P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dd4cba155c941b4b7ad4d64c7431536, State: Initialized, Role: FOLLOWER
I20260810 01:59:15.708801 9192 consensus_queue.cc:260] T 3a15b27dbdaf4092aea66c3670204fcc P 4dd4cba155c941b4b7ad4d64c7431536 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:15.710927 9192 ts_tablet_manager.cc:1434] T 3a15b27dbdaf4092aea66c3670204fcc P 4dd4cba155c941b4b7ad4d64c7431536: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260810 01:59:15.712250 3787 tablet_copy_service.cc:342] P dc85be7d460a404f997177f57680850f: Request end of tablet copy session 4dd4cba155c941b4b7ad4d64c7431536-3a15b27dbdaf4092aea66c3670204fcc received from {username='slave'} at 127.21.64.197:44713
I20260810 01:59:15.712435 3787 tablet_copy_service.cc:434] P dc85be7d460a404f997177f57680850f: ending tablet copy session 4dd4cba155c941b4b7ad4d64c7431536-3a15b27dbdaf4092aea66c3670204fcc on tablet 3a15b27dbdaf4092aea66c3670204fcc with peer 4dd4cba155c941b4b7ad4d64c7431536
I20260810 01:59:15.726212 9117 ts_tablet_manager.cc:933] T 18a93b1a1ce1440b99bdd7a3bcf49064 P c5ed5317da9c464b93f979c405f0f6e4: Initiating tablet copy from peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 01:59:15.730543 9117 tablet_copy_client.cc:323] T 18a93b1a1ce1440b99bdd7a3bcf49064 P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.194:43893
I20260810 01:59:15.731673 3973 tablet_copy_service.cc:140] P 82f93d1d11364ceeb485585b4ae78871: Received BeginTabletCopySession request for tablet 18a93b1a1ce1440b99bdd7a3bcf49064 from peer c5ed5317da9c464b93f979c405f0f6e4 ({username='slave'} at 127.21.64.199:41929)
I20260810 01:59:15.731876 3973 tablet_copy_service.cc:161] P 82f93d1d11364ceeb485585b4ae78871: Beginning new tablet copy session on tablet 18a93b1a1ce1440b99bdd7a3bcf49064 from peer c5ed5317da9c464b93f979c405f0f6e4 at {username='slave'} at 127.21.64.199:41929: session id = c5ed5317da9c464b93f979c405f0f6e4-18a93b1a1ce1440b99bdd7a3bcf49064
I20260810 01:59:15.736317 3973 tablet_copy_source_session.cc:215] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:15.738552 9117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18a93b1a1ce1440b99bdd7a3bcf49064. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:15.751614 9117 tablet_copy_client.cc:806] T 18a93b1a1ce1440b99bdd7a3bcf49064 P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:15.751948 9117 tablet_copy_client.cc:670] T 18a93b1a1ce1440b99bdd7a3bcf49064 P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:15.753870 9117 tablet_copy_client.cc:538] T 18a93b1a1ce1440b99bdd7a3bcf49064 P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:15.763770 9117 tablet_bootstrap.cc:492] T 18a93b1a1ce1440b99bdd7a3bcf49064 P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap starting.
I20260810 01:59:15.776538 4311 raft_consensus.cc:2955] T f7a36f7ebd5d4342a259b093e45d4c32 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:15.781901 9154 ts_tablet_manager.cc:933] T f7a36f7ebd5d4342a259b093e45d4c32 P 3136daf7101445beadc1aa19bc01c227: Initiating tablet copy from peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 01:59:15.788246 3756 consensus_queue.cc:237] T 57f6f22d97c14ed98960e27ce2c8f3fb P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:15.795475 4132 consensus_queue.cc:237] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
W20260810 01:59:15.805109 3670 consensus_peers.cc:597] T 57f6f22d97c14ed98960e27ce2c8f3fb P dc85be7d460a404f997177f57680850f -> Peer 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197:38787): Couldn't send request to peer 4dd4cba155c941b4b7ad4d64c7431536. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 57f6f22d97c14ed98960e27ce2c8f3fb. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:15.806308 3943 raft_consensus.cc:1275] T 57f6f22d97c14ed98960e27ce2c8f3fb P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:15.807025 8189 consensus_queue.cc:1048] T 57f6f22d97c14ed98960e27ce2c8f3fb P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:15.814510 4129 raft_consensus.cc:1275] T 57f6f22d97c14ed98960e27ce2c8f3fb P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:15.815392 8189 consensus_queue.cc:1048] T 57f6f22d97c14ed98960e27ce2c8f3fb P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:15.816620 6397 raft_consensus.cc:1217] T 3a15b27dbdaf4092aea66c3670204fcc P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20260810 01:59:15.847036 9154 tablet_copy_client.cc:323] T f7a36f7ebd5d4342a259b093e45d4c32 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.194:43893
I20260810 01:59:15.847940 3973 tablet_copy_service.cc:140] P 82f93d1d11364ceeb485585b4ae78871: Received BeginTabletCopySession request for tablet f7a36f7ebd5d4342a259b093e45d4c32 from peer 3136daf7101445beadc1aa19bc01c227 ({username='slave'} at 127.21.64.200:39385)
I20260810 01:59:15.848130 3973 tablet_copy_service.cc:161] P 82f93d1d11364ceeb485585b4ae78871: Beginning new tablet copy session on tablet f7a36f7ebd5d4342a259b093e45d4c32 from peer 3136daf7101445beadc1aa19bc01c227 at {username='slave'} at 127.21.64.200:39385: session id = 3136daf7101445beadc1aa19bc01c227-f7a36f7ebd5d4342a259b093e45d4c32
I20260810 01:59:15.848544 6909 raft_consensus.cc:1275] T c53fc4008faf445fa05e436b9c8e0282 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:15.849155 9054 consensus_queue.cc:1048] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:15.852233 3973 tablet_copy_source_session.cc:215] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871: Tablet Copy: opened 0 blocks and 1 log segments
W20260810 01:59:15.859351 4036 consensus_peers.cc:597] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 -> Peer 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197:38787): Couldn't send request to peer 4dd4cba155c941b4b7ad4d64c7431536. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c53fc4008faf445fa05e436b9c8e0282. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:15.860471 4311 raft_consensus.cc:1275] T c53fc4008faf445fa05e436b9c8e0282 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:15.861127 9054 consensus_queue.cc:1048] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:15.870405 3945 raft_consensus.cc:1275] T c53fc4008faf445fa05e436b9c8e0282 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:15.871327 9054 consensus_queue.cc:1048] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:15.884586 9154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7a36f7ebd5d4342a259b093e45d4c32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:15.887619 9094 raft_consensus.cc:2955] T 57f6f22d97c14ed98960e27ce2c8f3fb P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:15.894325 3941 raft_consensus.cc:2955] T 57f6f22d97c14ed98960e27ce2c8f3fb P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:15.899844 9154 tablet_copy_client.cc:806] T f7a36f7ebd5d4342a259b093e45d4c32 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:15.900084 9154 tablet_copy_client.cc:670] T f7a36f7ebd5d4342a259b093e45d4c32 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:15.907835 3565 catalog_manager.cc:5719] T 57f6f22d97c14ed98960e27ce2c8f3fb P 82f93d1d11364ceeb485585b4ae78871 reported cstate change: config changed from index -1 to 4, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:15.917479 4129 raft_consensus.cc:2955] T 57f6f22d97c14ed98960e27ce2c8f3fb P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:15.922021 9154 tablet_copy_client.cc:538] T f7a36f7ebd5d4342a259b093e45d4c32 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:15.931327 9054 raft_consensus.cc:2955] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
W20260810 01:59:15.940032 4038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.196:41943, user_credentials={real_user=slave}} blocked reactor thread for 48010.5us
I20260810 01:59:15.940907 9154 tablet_bootstrap.cc:492] T f7a36f7ebd5d4342a259b093e45d4c32 P 3136daf7101445beadc1aa19bc01c227: Bootstrap starting.
I20260810 01:59:15.940997 4311 consensus_queue.cc:237] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:15.940949 4310 raft_consensus.cc:2955] T c53fc4008faf445fa05e436b9c8e0282 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
W20260810 01:59:15.948257 4222 consensus_peers.cc:597] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e -> Peer 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317): Couldn't send request to peer 22ce0e487f0341fd9bf853393d6e7683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5528e3ba51a640eaa614f141440bb90b. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:15.950696 3572 catalog_manager.cc:5719] T c53fc4008faf445fa05e436b9c8e0282 P ca4469fc2dbc48488bc7ad7f482f129e reported cstate change: config changed from index 4 to 5, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New cstate: current_term: 1 leader_uuid: "17b49c694faf479ea2e5083470fc0302" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:15.956025 6909 raft_consensus.cc:2955] T c53fc4008faf445fa05e436b9c8e0282 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:15.959328 4132 raft_consensus.cc:1275] T 5528e3ba51a640eaa614f141440bb90b P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:15.960117 9233 consensus_queue.cc:1048] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:15.966569 3943 raft_consensus.cc:1275] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:15.967356 9233 consensus_queue.cc:1048] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:15.983649 4129 consensus_queue.cc:237] T f3d04e9457c944a8a72861680bdf9b7c P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:15.985118 3941 raft_consensus.cc:2955] T c53fc4008faf445fa05e436b9c8e0282 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:15.992497 9233 raft_consensus.cc:2955] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:15.997916 4131 raft_consensus.cc:2955] T 5528e3ba51a640eaa614f141440bb90b P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:16.010062 3941 raft_consensus.cc:2955] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:16.014801 3572 catalog_manager.cc:5719] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e reported cstate change: config changed from index -1 to 4, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:16.034363 3756 raft_consensus.cc:1275] T f3d04e9457c944a8a72861680bdf9b7c P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:16.036341 4311 raft_consensus.cc:1275] T f3d04e9457c944a8a72861680bdf9b7c P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:16.037089 9325 consensus_queue.cc:1048] T f3d04e9457c944a8a72861680bdf9b7c P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:16.040021 9325 consensus_queue.cc:1048] T f3d04e9457c944a8a72861680bdf9b7c P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260810 01:59:16.041086 4036 consensus_peers.cc:597] T f3d04e9457c944a8a72861680bdf9b7c P 17b49c694faf479ea2e5083470fc0302 -> Peer 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197:38787): Couldn't send request to peer 4dd4cba155c941b4b7ad4d64c7431536. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f3d04e9457c944a8a72861680bdf9b7c. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:16.050859 9344 ts_tablet_manager.cc:933] T 606ad043ee3344c39c9eef7cd1920d7e P 3136daf7101445beadc1aa19bc01c227: Initiating tablet copy from peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943)
I20260810 01:59:16.054596 9344 tablet_copy_client.cc:323] T 606ad043ee3344c39c9eef7cd1920d7e P 3136daf7101445beadc1aa19bc01c227: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.196:41943
I20260810 01:59:16.055362 4337 tablet_copy_service.cc:140] P ca4469fc2dbc48488bc7ad7f482f129e: Received BeginTabletCopySession request for tablet 606ad043ee3344c39c9eef7cd1920d7e from peer 3136daf7101445beadc1aa19bc01c227 ({username='slave'} at 127.21.64.200:36881)
I20260810 01:59:16.055563 4337 tablet_copy_service.cc:161] P ca4469fc2dbc48488bc7ad7f482f129e: Beginning new tablet copy session on tablet 606ad043ee3344c39c9eef7cd1920d7e from peer 3136daf7101445beadc1aa19bc01c227 at {username='slave'} at 127.21.64.200:36881: session id = 3136daf7101445beadc1aa19bc01c227-606ad043ee3344c39c9eef7cd1920d7e
I20260810 01:59:16.059641 4337 tablet_copy_source_session.cc:215] T 606ad043ee3344c39c9eef7cd1920d7e P ca4469fc2dbc48488bc7ad7f482f129e: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:16.061870 9344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 606ad043ee3344c39c9eef7cd1920d7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:16.073916 9117 tablet_bootstrap.cc:492] T 18a93b1a1ce1440b99bdd7a3bcf49064 P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:16.074637 9117 tablet_bootstrap.cc:492] T 18a93b1a1ce1440b99bdd7a3bcf49064 P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap complete.
I20260810 01:59:16.074947 9117 ts_tablet_manager.cc:1403] T 18a93b1a1ce1440b99bdd7a3bcf49064 P c5ed5317da9c464b93f979c405f0f6e4: Time spent bootstrapping tablet: real 0.311s user 0.068s sys 0.007s
I20260810 01:59:16.075989 9117 raft_consensus.cc:359] T 18a93b1a1ce1440b99bdd7a3bcf49064 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:16.076313 9117 raft_consensus.cc:740] T 18a93b1a1ce1440b99bdd7a3bcf49064 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ed5317da9c464b93f979c405f0f6e4, State: Initialized, Role: FOLLOWER
I20260810 01:59:16.076692 9117 consensus_queue.cc:260] T 18a93b1a1ce1440b99bdd7a3bcf49064 P c5ed5317da9c464b93f979c405f0f6e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:16.082556 9325 raft_consensus.cc:2955] T f3d04e9457c944a8a72861680bdf9b7c P 17b49c694faf479ea2e5083470fc0302 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:16.087122 4313 raft_consensus.cc:2955] T f3d04e9457c944a8a72861680bdf9b7c P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:16.092125 3756 raft_consensus.cc:2955] T f3d04e9457c944a8a72861680bdf9b7c P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:16.094237 3565 catalog_manager.cc:5719] T f3d04e9457c944a8a72861680bdf9b7c P 17b49c694faf479ea2e5083470fc0302 reported cstate change: config changed from index -1 to 4, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New cstate: current_term: 1 leader_uuid: "17b49c694faf479ea2e5083470fc0302" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:16.117486 9154 tablet_bootstrap.cc:492] T f7a36f7ebd5d4342a259b093e45d4c32 P 3136daf7101445beadc1aa19bc01c227: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:16.118180 9154 tablet_bootstrap.cc:492] T f7a36f7ebd5d4342a259b093e45d4c32 P 3136daf7101445beadc1aa19bc01c227: Bootstrap complete.
I20260810 01:59:16.118592 9154 ts_tablet_manager.cc:1403] T f7a36f7ebd5d4342a259b093e45d4c32 P 3136daf7101445beadc1aa19bc01c227: Time spent bootstrapping tablet: real 0.178s user 0.069s sys 0.012s
I20260810 01:59:16.120007 9154 raft_consensus.cc:359] T f7a36f7ebd5d4342a259b093e45d4c32 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:16.120343 9154 raft_consensus.cc:740] T f7a36f7ebd5d4342a259b093e45d4c32 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3136daf7101445beadc1aa19bc01c227, State: Initialized, Role: FOLLOWER
I20260810 01:59:16.120817 9154 consensus_queue.cc:260] T f7a36f7ebd5d4342a259b093e45d4c32 P 3136daf7101445beadc1aa19bc01c227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:16.121628 9154 ts_tablet_manager.cc:1434] T f7a36f7ebd5d4342a259b093e45d4c32 P 3136daf7101445beadc1aa19bc01c227: Time spent starting tablet: real 0.003s user 0.003s sys 0.001s
I20260810 01:59:16.123044 3973 tablet_copy_service.cc:342] P 82f93d1d11364ceeb485585b4ae78871: Request end of tablet copy session 3136daf7101445beadc1aa19bc01c227-f7a36f7ebd5d4342a259b093e45d4c32 received from {username='slave'} at 127.21.64.200:39385
I20260810 01:59:16.123206 3973 tablet_copy_service.cc:434] P 82f93d1d11364ceeb485585b4ae78871: ending tablet copy session 3136daf7101445beadc1aa19bc01c227-f7a36f7ebd5d4342a259b093e45d4c32 on tablet f7a36f7ebd5d4342a259b093e45d4c32 with peer 3136daf7101445beadc1aa19bc01c227
I20260810 01:59:16.134932 9344 tablet_copy_client.cc:806] T 606ad043ee3344c39c9eef7cd1920d7e P 3136daf7101445beadc1aa19bc01c227: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:16.135280 9344 tablet_copy_client.cc:670] T 606ad043ee3344c39c9eef7cd1920d7e P 3136daf7101445beadc1aa19bc01c227: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:16.140815 9344 tablet_copy_client.cc:538] T 606ad043ee3344c39c9eef7cd1920d7e P 3136daf7101445beadc1aa19bc01c227: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:16.141727 9117 ts_tablet_manager.cc:1434] T 18a93b1a1ce1440b99bdd7a3bcf49064 P c5ed5317da9c464b93f979c405f0f6e4: Time spent starting tablet: real 0.067s user 0.008s sys 0.033s
I20260810 01:59:16.142768 3973 tablet_copy_service.cc:342] P 82f93d1d11364ceeb485585b4ae78871: Request end of tablet copy session c5ed5317da9c464b93f979c405f0f6e4-18a93b1a1ce1440b99bdd7a3bcf49064 received from {username='slave'} at 127.21.64.199:41929
I20260810 01:59:16.142913 3973 tablet_copy_service.cc:434] P 82f93d1d11364ceeb485585b4ae78871: ending tablet copy session c5ed5317da9c464b93f979c405f0f6e4-18a93b1a1ce1440b99bdd7a3bcf49064 on tablet 18a93b1a1ce1440b99bdd7a3bcf49064 with peer c5ed5317da9c464b93f979c405f0f6e4
I20260810 01:59:16.152619 6739 raft_consensus.cc:1217] T 18a93b1a1ce1440b99bdd7a3bcf49064 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20260810 01:59:16.161298 9344 tablet_bootstrap.cc:492] T 606ad043ee3344c39c9eef7cd1920d7e P 3136daf7101445beadc1aa19bc01c227: Bootstrap starting.
I20260810 01:59:16.241706 6909 raft_consensus.cc:1217] T f7a36f7ebd5d4342a259b093e45d4c32 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20260810 01:59:16.259053 3941 consensus_queue.cc:237] T b63d0798e1ae4aea9b0272716d53d46d P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:16.273363 4129 raft_consensus.cc:1275] T b63d0798e1ae4aea9b0272716d53d46d P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:16.274174 8769 consensus_queue.cc:1048] T b63d0798e1ae4aea9b0272716d53d46d P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260810 01:59:16.275074 3858 consensus_peers.cc:597] T b63d0798e1ae4aea9b0272716d53d46d P 82f93d1d11364ceeb485585b4ae78871 -> Peer c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199:41689): Couldn't send request to peer c5ed5317da9c464b93f979c405f0f6e4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b63d0798e1ae4aea9b0272716d53d46d. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:16.281456 3756 raft_consensus.cc:1275] T b63d0798e1ae4aea9b0272716d53d46d P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:16.282235 8769 consensus_queue.cc:1048] T b63d0798e1ae4aea9b0272716d53d46d P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:16.291750 9344 tablet_bootstrap.cc:492] T 606ad043ee3344c39c9eef7cd1920d7e P 3136daf7101445beadc1aa19bc01c227: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:16.291819 8769 raft_consensus.cc:2955] T b63d0798e1ae4aea9b0272716d53d46d P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:16.292477 9344 tablet_bootstrap.cc:492] T 606ad043ee3344c39c9eef7cd1920d7e P 3136daf7101445beadc1aa19bc01c227: Bootstrap complete.
I20260810 01:59:16.292935 9344 ts_tablet_manager.cc:1403] T 606ad043ee3344c39c9eef7cd1920d7e P 3136daf7101445beadc1aa19bc01c227: Time spent bootstrapping tablet: real 0.132s user 0.084s sys 0.012s
I20260810 01:59:16.294250 9344 raft_consensus.cc:359] T 606ad043ee3344c39c9eef7cd1920d7e P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:16.294634 9344 raft_consensus.cc:740] T 606ad043ee3344c39c9eef7cd1920d7e P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3136daf7101445beadc1aa19bc01c227, State: Initialized, Role: FOLLOWER
I20260810 01:59:16.295130 9344 consensus_queue.cc:260] T 606ad043ee3344c39c9eef7cd1920d7e P 3136daf7101445beadc1aa19bc01c227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:16.295997 9344 ts_tablet_manager.cc:1434] T 606ad043ee3344c39c9eef7cd1920d7e P 3136daf7101445beadc1aa19bc01c227: Time spent starting tablet: real 0.003s user 0.001s sys 0.004s
I20260810 01:59:16.295764 3756 raft_consensus.cc:2955] T b63d0798e1ae4aea9b0272716d53d46d P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:16.297075 4337 tablet_copy_service.cc:342] P ca4469fc2dbc48488bc7ad7f482f129e: Request end of tablet copy session 3136daf7101445beadc1aa19bc01c227-606ad043ee3344c39c9eef7cd1920d7e received from {username='slave'} at 127.21.64.200:36881
I20260810 01:59:16.297277 4337 tablet_copy_service.cc:434] P ca4469fc2dbc48488bc7ad7f482f129e: ending tablet copy session 3136daf7101445beadc1aa19bc01c227-606ad043ee3344c39c9eef7cd1920d7e on tablet 606ad043ee3344c39c9eef7cd1920d7e with peer 3136daf7101445beadc1aa19bc01c227
I20260810 01:59:16.321837 4129 raft_consensus.cc:2955] T b63d0798e1ae4aea9b0272716d53d46d P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:16.326506 3565 catalog_manager.cc:5719] T b63d0798e1ae4aea9b0272716d53d46d P dc85be7d460a404f997177f57680850f reported cstate change: config changed from index -1 to 4, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:16.397431 9417 ts_tablet_manager.cc:933] T 57f6f22d97c14ed98960e27ce2c8f3fb P 4dd4cba155c941b4b7ad4d64c7431536: Initiating tablet copy from peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
I20260810 01:59:16.407931 9417 tablet_copy_client.cc:323] T 57f6f22d97c14ed98960e27ce2c8f3fb P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.193:36797
I20260810 01:59:16.408951 3787 tablet_copy_service.cc:140] P dc85be7d460a404f997177f57680850f: Received BeginTabletCopySession request for tablet 57f6f22d97c14ed98960e27ce2c8f3fb from peer 4dd4cba155c941b4b7ad4d64c7431536 ({username='slave'} at 127.21.64.197:44713)
I20260810 01:59:16.409204 3787 tablet_copy_service.cc:161] P dc85be7d460a404f997177f57680850f: Beginning new tablet copy session on tablet 57f6f22d97c14ed98960e27ce2c8f3fb from peer 4dd4cba155c941b4b7ad4d64c7431536 at {username='slave'} at 127.21.64.197:44713: session id = 4dd4cba155c941b4b7ad4d64c7431536-57f6f22d97c14ed98960e27ce2c8f3fb
I20260810 01:59:16.414182 3787 tablet_copy_source_session.cc:215] T 57f6f22d97c14ed98960e27ce2c8f3fb P dc85be7d460a404f997177f57680850f: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:16.417619 9417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57f6f22d97c14ed98960e27ce2c8f3fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:16.432542 9419 ts_tablet_manager.cc:933] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683: Initiating tablet copy from peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943)
I20260810 01:59:16.436210 9417 tablet_copy_client.cc:806] T 57f6f22d97c14ed98960e27ce2c8f3fb P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:16.436528 9417 tablet_copy_client.cc:670] T 57f6f22d97c14ed98960e27ce2c8f3fb P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:16.439205 9417 tablet_copy_client.cc:538] T 57f6f22d97c14ed98960e27ce2c8f3fb P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:16.445477 9417 tablet_bootstrap.cc:492] T 57f6f22d97c14ed98960e27ce2c8f3fb P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap starting.
I20260810 01:59:16.472607 9419 tablet_copy_client.cc:323] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.196:41943
I20260810 01:59:16.473873 4337 tablet_copy_service.cc:140] P ca4469fc2dbc48488bc7ad7f482f129e: Received BeginTabletCopySession request for tablet 5528e3ba51a640eaa614f141440bb90b from peer 22ce0e487f0341fd9bf853393d6e7683 ({username='slave'} at 127.21.64.198:60673)
I20260810 01:59:16.474097 4337 tablet_copy_service.cc:161] P ca4469fc2dbc48488bc7ad7f482f129e: Beginning new tablet copy session on tablet 5528e3ba51a640eaa614f141440bb90b from peer 22ce0e487f0341fd9bf853393d6e7683 at {username='slave'} at 127.21.64.198:60673: session id = 22ce0e487f0341fd9bf853393d6e7683-5528e3ba51a640eaa614f141440bb90b
I20260810 01:59:16.490056 9450 ts_tablet_manager.cc:933] T c53fc4008faf445fa05e436b9c8e0282 P 4dd4cba155c941b4b7ad4d64c7431536: Initiating tablet copy from peer 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189)
I20260810 01:59:16.492363 4131 consensus_queue.cc:237] T f3d04e9457c944a8a72861680bdf9b7c P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:16.493278 6909 raft_consensus.cc:1217] T 606ad043ee3344c39c9eef7cd1920d7e P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20260810 01:59:16.498234 3756 raft_consensus.cc:1275] T f3d04e9457c944a8a72861680bdf9b7c P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
W20260810 01:59:16.502789 4036 consensus_peers.cc:597] T f3d04e9457c944a8a72861680bdf9b7c P 17b49c694faf479ea2e5083470fc0302 -> Peer 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197:38787): Couldn't send request to peer 4dd4cba155c941b4b7ad4d64c7431536. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f3d04e9457c944a8a72861680bdf9b7c. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:16.504106 9325 consensus_queue.cc:1048] T f3d04e9457c944a8a72861680bdf9b7c P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:16.503993 3941 consensus_queue.cc:237] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:16.484563 4337 tablet_copy_source_session.cc:215] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:16.511233 9419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5528e3ba51a640eaa614f141440bb90b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:16.502154 4311 raft_consensus.cc:1275] T f3d04e9457c944a8a72861680bdf9b7c P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:16.514780 9325 consensus_queue.cc:1048] T f3d04e9457c944a8a72861680bdf9b7c P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260810 01:59:16.521289 3857 consensus_peers.cc:597] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 -> Peer 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317): Couldn't send request to peer 22ce0e487f0341fd9bf853393d6e7683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f7a36f7ebd5d4342a259b093e45d4c32. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:16.522696 6909 raft_consensus.cc:1275] T f7a36f7ebd5d4342a259b093e45d4c32 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:16.522744 9325 raft_consensus.cc:2955] T f3d04e9457c944a8a72861680bdf9b7c P 17b49c694faf479ea2e5083470fc0302 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:16.523618 9416 consensus_queue.cc:1048] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:16.534464 4311 raft_consensus.cc:2955] T f3d04e9457c944a8a72861680bdf9b7c P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:16.549746 6397 raft_consensus.cc:1275] T f7a36f7ebd5d4342a259b093e45d4c32 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:16.550855 4313 raft_consensus.cc:1275] T f7a36f7ebd5d4342a259b093e45d4c32 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:16.551542 9416 consensus_queue.cc:1048] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:16.554538 8766 consensus_queue.cc:1048] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:16.555864 3756 raft_consensus.cc:1275] T f7a36f7ebd5d4342a259b093e45d4c32 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:16.560627 8766 consensus_queue.cc:1048] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:16.565133 3761 raft_consensus.cc:2955] T f3d04e9457c944a8a72861680bdf9b7c P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:16.578519 3565 catalog_manager.cc:5719] T f3d04e9457c944a8a72861680bdf9b7c P dc85be7d460a404f997177f57680850f reported cstate change: config changed from index 4 to 5, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New cstate: current_term: 1 leader_uuid: "17b49c694faf479ea2e5083470fc0302" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
W20260810 01:59:16.581807 4041 consensus_peers.cc:597] T f3d04e9457c944a8a72861680bdf9b7c P 17b49c694faf479ea2e5083470fc0302 -> Peer c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199:41689): Couldn't send request to peer c5ed5317da9c464b93f979c405f0f6e4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f3d04e9457c944a8a72861680bdf9b7c. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:16.601682 9419 tablet_copy_client.cc:806] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:16.602298 9419 tablet_copy_client.cc:670] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:16.605901 9419 tablet_copy_client.cc:538] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:16.607808 9450 tablet_copy_client.cc:323] T c53fc4008faf445fa05e436b9c8e0282 P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.195:39189
I20260810 01:59:16.608680 4162 tablet_copy_service.cc:140] P 17b49c694faf479ea2e5083470fc0302: Received BeginTabletCopySession request for tablet c53fc4008faf445fa05e436b9c8e0282 from peer 4dd4cba155c941b4b7ad4d64c7431536 ({username='slave'} at 127.21.64.197:39923)
I20260810 01:59:16.608884 4162 tablet_copy_service.cc:161] P 17b49c694faf479ea2e5083470fc0302: Beginning new tablet copy session on tablet c53fc4008faf445fa05e436b9c8e0282 from peer 4dd4cba155c941b4b7ad4d64c7431536 at {username='slave'} at 127.21.64.197:39923: session id = 4dd4cba155c941b4b7ad4d64c7431536-c53fc4008faf445fa05e436b9c8e0282
I20260810 01:59:16.609256 8766 raft_consensus.cc:2955] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:16.612139 4162 tablet_copy_source_session.cc:215] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:16.613631 9450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c53fc4008faf445fa05e436b9c8e0282. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:16.617903 6397 raft_consensus.cc:2955] T f7a36f7ebd5d4342a259b093e45d4c32 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:16.621009 3565 catalog_manager.cc:5719] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 reported cstate change: config changed from index 5 to 6, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:16.629563 6909 raft_consensus.cc:2955] T f7a36f7ebd5d4342a259b093e45d4c32 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:16.637184 4311 raft_consensus.cc:2955] T f7a36f7ebd5d4342a259b093e45d4c32 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:16.641294 9450 tablet_copy_client.cc:806] T c53fc4008faf445fa05e436b9c8e0282 P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:16.650197 9450 tablet_copy_client.cc:670] T c53fc4008faf445fa05e436b9c8e0282 P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:16.652652 9450 tablet_copy_client.cc:538] T c53fc4008faf445fa05e436b9c8e0282 P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:16.656728 9450 tablet_bootstrap.cc:492] T c53fc4008faf445fa05e436b9c8e0282 P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap starting.
I20260810 01:59:16.661578 3756 raft_consensus.cc:2955] T f7a36f7ebd5d4342a259b093e45d4c32 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:16.674823 9419 tablet_bootstrap.cc:492] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap starting.
I20260810 01:59:16.705541 9480 ts_tablet_manager.cc:933] T b63d0798e1ae4aea9b0272716d53d46d P c5ed5317da9c464b93f979c405f0f6e4: Initiating tablet copy from peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 01:59:16.717890 9480 tablet_copy_client.cc:323] T b63d0798e1ae4aea9b0272716d53d46d P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.194:43893
I20260810 01:59:16.718899 3973 tablet_copy_service.cc:140] P 82f93d1d11364ceeb485585b4ae78871: Received BeginTabletCopySession request for tablet b63d0798e1ae4aea9b0272716d53d46d from peer c5ed5317da9c464b93f979c405f0f6e4 ({username='slave'} at 127.21.64.199:41929)
I20260810 01:59:16.719120 3973 tablet_copy_service.cc:161] P 82f93d1d11364ceeb485585b4ae78871: Beginning new tablet copy session on tablet b63d0798e1ae4aea9b0272716d53d46d from peer c5ed5317da9c464b93f979c405f0f6e4 at {username='slave'} at 127.21.64.199:41929: session id = c5ed5317da9c464b93f979c405f0f6e4-b63d0798e1ae4aea9b0272716d53d46d
I20260810 01:59:16.722885 3973 tablet_copy_source_session.cc:215] T b63d0798e1ae4aea9b0272716d53d46d P 82f93d1d11364ceeb485585b4ae78871: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:16.724746 9480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b63d0798e1ae4aea9b0272716d53d46d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:16.749010 9480 tablet_copy_client.cc:806] T b63d0798e1ae4aea9b0272716d53d46d P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:16.753077 9480 tablet_copy_client.cc:670] T b63d0798e1ae4aea9b0272716d53d46d P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:16.755300 9480 tablet_copy_client.cc:538] T b63d0798e1ae4aea9b0272716d53d46d P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:16.761206 9480 tablet_bootstrap.cc:492] T b63d0798e1ae4aea9b0272716d53d46d P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap starting.
I20260810 01:59:16.811148 9419 tablet_bootstrap.cc:492] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:16.811775 9419 tablet_bootstrap.cc:492] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap complete.
I20260810 01:59:16.812144 9419 ts_tablet_manager.cc:1403] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683: Time spent bootstrapping tablet: real 0.145s user 0.047s sys 0.010s
I20260810 01:59:16.813419 9419 raft_consensus.cc:359] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:16.813725 9419 raft_consensus.cc:740] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ce0e487f0341fd9bf853393d6e7683, State: Initialized, Role: FOLLOWER
I20260810 01:59:16.814030 9419 consensus_queue.cc:260] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:16.821286 9419 ts_tablet_manager.cc:1434] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683: Time spent starting tablet: real 0.009s user 0.007s sys 0.004s
I20260810 01:59:16.828246 4337 tablet_copy_service.cc:342] P ca4469fc2dbc48488bc7ad7f482f129e: Request end of tablet copy session 22ce0e487f0341fd9bf853393d6e7683-5528e3ba51a640eaa614f141440bb90b received from {username='slave'} at 127.21.64.198:60673
I20260810 01:59:16.828418 4337 tablet_copy_service.cc:434] P ca4469fc2dbc48488bc7ad7f482f129e: ending tablet copy session 22ce0e487f0341fd9bf853393d6e7683-5528e3ba51a640eaa614f141440bb90b on tablet 5528e3ba51a640eaa614f141440bb90b with peer 22ce0e487f0341fd9bf853393d6e7683
I20260810 01:59:16.831566 9417 tablet_bootstrap.cc:492] T 57f6f22d97c14ed98960e27ce2c8f3fb P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:16.832099 9417 tablet_bootstrap.cc:492] T 57f6f22d97c14ed98960e27ce2c8f3fb P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap complete.
I20260810 01:59:16.835495 4311 consensus_queue.cc:237] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
W20260810 01:59:16.841609 4222 consensus_peers.cc:597] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e -> Peer 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317): Couldn't send request to peer 22ce0e487f0341fd9bf853393d6e7683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0afbd7afdd834537b15c727355724562. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:16.842880 3756 raft_consensus.cc:1275] T 0afbd7afdd834537b15c727355724562 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:16.843657 9233 consensus_queue.cc:1048] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:16.848074 3941 raft_consensus.cc:1275] T 0afbd7afdd834537b15c727355724562 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:16.848829 9233 consensus_queue.cc:1048] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:16.884425 9233 raft_consensus.cc:2955] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:16.889611 3756 raft_consensus.cc:2955] T 0afbd7afdd834537b15c727355724562 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:16.832422 9417 ts_tablet_manager.cc:1403] T 57f6f22d97c14ed98960e27ce2c8f3fb P 4dd4cba155c941b4b7ad4d64c7431536: Time spent bootstrapping tablet: real 0.387s user 0.057s sys 0.013s
I20260810 01:59:16.897024 3565 catalog_manager.cc:5719] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e reported cstate change: config changed from index -1 to 4, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:16.898139 9417 raft_consensus.cc:359] T 57f6f22d97c14ed98960e27ce2c8f3fb P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:16.898394 9417 raft_consensus.cc:740] T 57f6f22d97c14ed98960e27ce2c8f3fb P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dd4cba155c941b4b7ad4d64c7431536, State: Initialized, Role: FOLLOWER
I20260810 01:59:16.898422 3941 raft_consensus.cc:2955] T 0afbd7afdd834537b15c727355724562 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:16.898669 9417 consensus_queue.cc:260] T 57f6f22d97c14ed98960e27ce2c8f3fb P 4dd4cba155c941b4b7ad4d64c7431536 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:16.899302 9417 ts_tablet_manager.cc:1434] T 57f6f22d97c14ed98960e27ce2c8f3fb P 4dd4cba155c941b4b7ad4d64c7431536: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260810 01:59:16.900507 3787 tablet_copy_service.cc:342] P dc85be7d460a404f997177f57680850f: Request end of tablet copy session 4dd4cba155c941b4b7ad4d64c7431536-57f6f22d97c14ed98960e27ce2c8f3fb received from {username='slave'} at 127.21.64.197:44713
I20260810 01:59:16.900684 3787 tablet_copy_service.cc:434] P dc85be7d460a404f997177f57680850f: ending tablet copy session 4dd4cba155c941b4b7ad4d64c7431536-57f6f22d97c14ed98960e27ce2c8f3fb on tablet 57f6f22d97c14ed98960e27ce2c8f3fb with peer 4dd4cba155c941b4b7ad4d64c7431536
I20260810 01:59:16.916100 9450 tablet_bootstrap.cc:492] T c53fc4008faf445fa05e436b9c8e0282 P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:16.916877 9450 tablet_bootstrap.cc:492] T c53fc4008faf445fa05e436b9c8e0282 P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap complete.
I20260810 01:59:16.917356 9450 ts_tablet_manager.cc:1403] T c53fc4008faf445fa05e436b9c8e0282 P 4dd4cba155c941b4b7ad4d64c7431536: Time spent bootstrapping tablet: real 0.261s user 0.059s sys 0.011s
I20260810 01:59:16.919946 9450 raft_consensus.cc:359] T c53fc4008faf445fa05e436b9c8e0282 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:16.920707 9450 raft_consensus.cc:740] T c53fc4008faf445fa05e436b9c8e0282 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dd4cba155c941b4b7ad4d64c7431536, State: Initialized, Role: FOLLOWER
I20260810 01:59:16.921042 9450 consensus_queue.cc:260] T c53fc4008faf445fa05e436b9c8e0282 P 4dd4cba155c941b4b7ad4d64c7431536 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:16.921847 9450 ts_tablet_manager.cc:1434] T c53fc4008faf445fa05e436b9c8e0282 P 4dd4cba155c941b4b7ad4d64c7431536: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 01:59:16.923090 4162 tablet_copy_service.cc:342] P 17b49c694faf479ea2e5083470fc0302: Request end of tablet copy session 4dd4cba155c941b4b7ad4d64c7431536-c53fc4008faf445fa05e436b9c8e0282 received from {username='slave'} at 127.21.64.197:39923
I20260810 01:59:16.923254 4162 tablet_copy_service.cc:434] P 17b49c694faf479ea2e5083470fc0302: ending tablet copy session 4dd4cba155c941b4b7ad4d64c7431536-c53fc4008faf445fa05e436b9c8e0282 on tablet c53fc4008faf445fa05e436b9c8e0282 with peer 4dd4cba155c941b4b7ad4d64c7431536
I20260810 01:59:16.943482 9541 ts_tablet_manager.cc:933] T f3d04e9457c944a8a72861680bdf9b7c P c5ed5317da9c464b93f979c405f0f6e4: Initiating tablet copy from peer 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189)
I20260810 01:59:16.963388 9541 tablet_copy_client.cc:323] T f3d04e9457c944a8a72861680bdf9b7c P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.195:39189
I20260810 01:59:16.972090 9480 tablet_bootstrap.cc:492] T b63d0798e1ae4aea9b0272716d53d46d P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:16.975353 9480 tablet_bootstrap.cc:492] T b63d0798e1ae4aea9b0272716d53d46d P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap complete.
I20260810 01:59:16.975772 9480 ts_tablet_manager.cc:1403] T b63d0798e1ae4aea9b0272716d53d46d P c5ed5317da9c464b93f979c405f0f6e4: Time spent bootstrapping tablet: real 0.215s user 0.050s sys 0.007s
I20260810 01:59:16.978725 9480 raft_consensus.cc:359] T b63d0798e1ae4aea9b0272716d53d46d P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:16.979213 9480 raft_consensus.cc:740] T b63d0798e1ae4aea9b0272716d53d46d P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ed5317da9c464b93f979c405f0f6e4, State: Initialized, Role: FOLLOWER
I20260810 01:59:16.979543 9480 consensus_queue.cc:260] T b63d0798e1ae4aea9b0272716d53d46d P c5ed5317da9c464b93f979c405f0f6e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:16.984889 9419 ts_tablet_manager.cc:933] T f7a36f7ebd5d4342a259b093e45d4c32 P 22ce0e487f0341fd9bf853393d6e7683: Initiating tablet copy from peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 01:59:16.998721 4162 tablet_copy_service.cc:140] P 17b49c694faf479ea2e5083470fc0302: Received BeginTabletCopySession request for tablet f3d04e9457c944a8a72861680bdf9b7c from peer c5ed5317da9c464b93f979c405f0f6e4 ({username='slave'} at 127.21.64.199:52993)
I20260810 01:59:16.998929 4162 tablet_copy_service.cc:161] P 17b49c694faf479ea2e5083470fc0302: Beginning new tablet copy session on tablet f3d04e9457c944a8a72861680bdf9b7c from peer c5ed5317da9c464b93f979c405f0f6e4 at {username='slave'} at 127.21.64.199:52993: session id = c5ed5317da9c464b93f979c405f0f6e4-f3d04e9457c944a8a72861680bdf9b7c
I20260810 01:59:17.000568 9419 tablet_copy_client.cc:323] T f7a36f7ebd5d4342a259b093e45d4c32 P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.194:43893
I20260810 01:59:17.001396 3973 tablet_copy_service.cc:140] P 82f93d1d11364ceeb485585b4ae78871: Received BeginTabletCopySession request for tablet f7a36f7ebd5d4342a259b093e45d4c32 from peer 22ce0e487f0341fd9bf853393d6e7683 ({username='slave'} at 127.21.64.198:54627)
I20260810 01:59:17.001644 3973 tablet_copy_service.cc:161] P 82f93d1d11364ceeb485585b4ae78871: Beginning new tablet copy session on tablet f7a36f7ebd5d4342a259b093e45d4c32 from peer 22ce0e487f0341fd9bf853393d6e7683 at {username='slave'} at 127.21.64.198:54627: session id = 22ce0e487f0341fd9bf853393d6e7683-f7a36f7ebd5d4342a259b093e45d4c32
I20260810 01:59:17.002606 4162 tablet_copy_source_session.cc:215] T f3d04e9457c944a8a72861680bdf9b7c P 17b49c694faf479ea2e5083470fc0302: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:17.004657 9541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3d04e9457c944a8a72861680bdf9b7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:17.006347 3973 tablet_copy_source_session.cc:215] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:17.008081 9419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7a36f7ebd5d4342a259b093e45d4c32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:17.018303 9541 tablet_copy_client.cc:806] T f3d04e9457c944a8a72861680bdf9b7c P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:17.018703 9541 tablet_copy_client.cc:670] T f3d04e9457c944a8a72861680bdf9b7c P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:17.020828 9541 tablet_copy_client.cc:538] T f3d04e9457c944a8a72861680bdf9b7c P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:17.031924 9541 tablet_bootstrap.cc:492] T f3d04e9457c944a8a72861680bdf9b7c P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap starting.
I20260810 01:59:17.073758 9480 ts_tablet_manager.cc:1434] T b63d0798e1ae4aea9b0272716d53d46d P c5ed5317da9c464b93f979c405f0f6e4: Time spent starting tablet: real 0.098s user 0.001s sys 0.010s
I20260810 01:59:17.075062 3973 tablet_copy_service.cc:342] P 82f93d1d11364ceeb485585b4ae78871: Request end of tablet copy session c5ed5317da9c464b93f979c405f0f6e4-b63d0798e1ae4aea9b0272716d53d46d received from {username='slave'} at 127.21.64.199:41929
I20260810 01:59:17.075250 3973 tablet_copy_service.cc:434] P 82f93d1d11364ceeb485585b4ae78871: ending tablet copy session c5ed5317da9c464b93f979c405f0f6e4-b63d0798e1ae4aea9b0272716d53d46d on tablet b63d0798e1ae4aea9b0272716d53d46d with peer c5ed5317da9c464b93f979c405f0f6e4
I20260810 01:59:17.075531 9419 tablet_copy_client.cc:806] T f7a36f7ebd5d4342a259b093e45d4c32 P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:17.075922 9419 tablet_copy_client.cc:670] T f7a36f7ebd5d4342a259b093e45d4c32 P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:17.079739 9419 tablet_copy_client.cc:538] T f7a36f7ebd5d4342a259b093e45d4c32 P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:17.111344 9417 ts_tablet_manager.cc:933] T f3d04e9457c944a8a72861680bdf9b7c P 4dd4cba155c941b4b7ad4d64c7431536: Initiating tablet copy from peer 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189)
I20260810 01:59:17.116456 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:17.136977 9417 tablet_copy_client.cc:323] T f3d04e9457c944a8a72861680bdf9b7c P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.195:39189
I20260810 01:59:17.138234 4162 tablet_copy_service.cc:140] P 17b49c694faf479ea2e5083470fc0302: Received BeginTabletCopySession request for tablet f3d04e9457c944a8a72861680bdf9b7c from peer 4dd4cba155c941b4b7ad4d64c7431536 ({username='slave'} at 127.21.64.197:39923)
I20260810 01:59:17.138550 4162 tablet_copy_service.cc:161] P 17b49c694faf479ea2e5083470fc0302: Beginning new tablet copy session on tablet f3d04e9457c944a8a72861680bdf9b7c from peer 4dd4cba155c941b4b7ad4d64c7431536 at {username='slave'} at 127.21.64.197:39923: session id = 4dd4cba155c941b4b7ad4d64c7431536-f3d04e9457c944a8a72861680bdf9b7c
I20260810 01:59:17.148640 4162 tablet_copy_source_session.cc:215] T f3d04e9457c944a8a72861680bdf9b7c P 17b49c694faf479ea2e5083470fc0302: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:17.158898 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:59:17.166253 9417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3d04e9457c944a8a72861680bdf9b7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:17.195643 9417 tablet_copy_client.cc:806] T f3d04e9457c944a8a72861680bdf9b7c P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:17.199045 9417 tablet_copy_client.cc:670] T f3d04e9457c944a8a72861680bdf9b7c P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:17.210528 9417 tablet_copy_client.cc:538] T f3d04e9457c944a8a72861680bdf9b7c P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:17.213579 9419 tablet_bootstrap.cc:492] T f7a36f7ebd5d4342a259b093e45d4c32 P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap starting.
I20260810 01:59:17.251715 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:17.266077 6715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:17.290235 6739 raft_consensus.cc:1217] T b63d0798e1ae4aea9b0272716d53d46d P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20260810 01:59:17.292647 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:17.300689 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:59:17.318765 6565 raft_consensus.cc:1217] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20260810 01:59:17.320231 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:17.326131 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:17.348428 6397 raft_consensus.cc:1217] T c53fc4008faf445fa05e436b9c8e0282 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20260810 01:59:17.355206 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:17.364184 9417 tablet_bootstrap.cc:492] T f3d04e9457c944a8a72861680bdf9b7c P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap starting.
I20260810 01:59:17.397329 6395 raft_consensus.cc:1217] T 57f6f22d97c14ed98960e27ce2c8f3fb P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20260810 01:59:17.404449 9623 ts_tablet_manager.cc:933] T 0afbd7afdd834537b15c727355724562 P 22ce0e487f0341fd9bf853393d6e7683: Initiating tablet copy from peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943)
I20260810 01:59:17.427762 9623 tablet_copy_client.cc:323] T 0afbd7afdd834537b15c727355724562 P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.196:41943
I20260810 01:59:17.428555 4337 tablet_copy_service.cc:140] P ca4469fc2dbc48488bc7ad7f482f129e: Received BeginTabletCopySession request for tablet 0afbd7afdd834537b15c727355724562 from peer 22ce0e487f0341fd9bf853393d6e7683 ({username='slave'} at 127.21.64.198:60673)
I20260810 01:59:17.428761 4337 tablet_copy_service.cc:161] P ca4469fc2dbc48488bc7ad7f482f129e: Beginning new tablet copy session on tablet 0afbd7afdd834537b15c727355724562 from peer 22ce0e487f0341fd9bf853393d6e7683 at {username='slave'} at 127.21.64.198:60673: session id = 22ce0e487f0341fd9bf853393d6e7683-0afbd7afdd834537b15c727355724562
I20260810 01:59:17.431975 4337 tablet_copy_source_session.cc:215] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:17.450945 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:17.451021 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:17.470046 6715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:17.486603 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:17.491658 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:17.553053 9623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0afbd7afdd834537b15c727355724562. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:17.571517 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:17.610605 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:17.643581 9623 tablet_copy_client.cc:806] T 0afbd7afdd834537b15c727355724562 P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:17.644110 9623 tablet_copy_client.cc:670] T 0afbd7afdd834537b15c727355724562 P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:17.662063 9623 tablet_copy_client.cc:538] T 0afbd7afdd834537b15c727355724562 P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:17.676925 9623 tablet_bootstrap.cc:492] T 0afbd7afdd834537b15c727355724562 P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap starting.
I20260810 01:59:17.694800 3943 consensus_queue.cc:237] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:17.728526 3756 raft_consensus.cc:1275] T fe8e1f0908234e46881258cfe79835f8 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260810 01:59:17.729350 3855 consensus_peers.cc:597] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 -> Peer 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995): Couldn't send request to peer 3136daf7101445beadc1aa19bc01c227. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fe8e1f0908234e46881258cfe79835f8. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:17.729718 9416 consensus_queue.cc:1048] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:17.730079 4129 raft_consensus.cc:1275] T fe8e1f0908234e46881258cfe79835f8 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:17.730914 9416 consensus_queue.cc:1048] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:17.747087 9541 tablet_bootstrap.cc:492] T f3d04e9457c944a8a72861680bdf9b7c P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:17.747629 9541 tablet_bootstrap.cc:492] T f3d04e9457c944a8a72861680bdf9b7c P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap complete.
I20260810 01:59:17.747922 9541 ts_tablet_manager.cc:1403] T f3d04e9457c944a8a72861680bdf9b7c P c5ed5317da9c464b93f979c405f0f6e4: Time spent bootstrapping tablet: real 0.716s user 0.048s sys 0.018s
I20260810 01:59:17.770946 8766 raft_consensus.cc:2955] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:17.777737 3756 raft_consensus.cc:2955] T fe8e1f0908234e46881258cfe79835f8 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:17.778016 4129 raft_consensus.cc:2955] T fe8e1f0908234e46881258cfe79835f8 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:17.781040 3562 catalog_manager.cc:5719] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 reported cstate change: config changed from index -1 to 4, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:17.791311 9541 raft_consensus.cc:359] T f3d04e9457c944a8a72861680bdf9b7c P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:17.791620 9541 raft_consensus.cc:740] T f3d04e9457c944a8a72861680bdf9b7c P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ed5317da9c464b93f979c405f0f6e4, State: Initialized, Role: FOLLOWER
I20260810 01:59:17.793146 9541 consensus_queue.cc:260] T f3d04e9457c944a8a72861680bdf9b7c P c5ed5317da9c464b93f979c405f0f6e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:17.829463 9541 ts_tablet_manager.cc:1434] T f3d04e9457c944a8a72861680bdf9b7c P c5ed5317da9c464b93f979c405f0f6e4: Time spent starting tablet: real 0.081s user 0.002s sys 0.003s
I20260810 01:59:17.830266 4162 tablet_copy_service.cc:342] P 17b49c694faf479ea2e5083470fc0302: Request end of tablet copy session c5ed5317da9c464b93f979c405f0f6e4-f3d04e9457c944a8a72861680bdf9b7c received from {username='slave'} at 127.21.64.199:52993
I20260810 01:59:17.830404 4162 tablet_copy_service.cc:434] P 17b49c694faf479ea2e5083470fc0302: ending tablet copy session c5ed5317da9c464b93f979c405f0f6e4-f3d04e9457c944a8a72861680bdf9b7c on tablet f3d04e9457c944a8a72861680bdf9b7c with peer c5ed5317da9c464b93f979c405f0f6e4
I20260810 01:59:17.848296 9419 tablet_bootstrap.cc:492] T f7a36f7ebd5d4342a259b093e45d4c32 P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:17.879448 9419 tablet_bootstrap.cc:492] T f7a36f7ebd5d4342a259b093e45d4c32 P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap complete.
I20260810 01:59:17.883324 9419 ts_tablet_manager.cc:1403] T f7a36f7ebd5d4342a259b093e45d4c32 P 22ce0e487f0341fd9bf853393d6e7683: Time spent bootstrapping tablet: real 0.670s user 0.059s sys 0.005s
I20260810 01:59:17.884646 9419 raft_consensus.cc:359] T f7a36f7ebd5d4342a259b093e45d4c32 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:17.885196 9419 raft_consensus.cc:740] T f7a36f7ebd5d4342a259b093e45d4c32 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ce0e487f0341fd9bf853393d6e7683, State: Initialized, Role: FOLLOWER
I20260810 01:59:17.885809 9419 consensus_queue.cc:260] T f7a36f7ebd5d4342a259b093e45d4c32 P 22ce0e487f0341fd9bf853393d6e7683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 1.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:17.898607 9419 ts_tablet_manager.cc:1434] T f7a36f7ebd5d4342a259b093e45d4c32 P 22ce0e487f0341fd9bf853393d6e7683: Time spent starting tablet: real 0.015s user 0.000s sys 0.004s
I20260810 01:59:17.899631 3973 tablet_copy_service.cc:342] P 82f93d1d11364ceeb485585b4ae78871: Request end of tablet copy session 22ce0e487f0341fd9bf853393d6e7683-f7a36f7ebd5d4342a259b093e45d4c32 received from {username='slave'} at 127.21.64.198:54627
I20260810 01:59:17.899781 3973 tablet_copy_service.cc:434] P 82f93d1d11364ceeb485585b4ae78871: ending tablet copy session 22ce0e487f0341fd9bf853393d6e7683-f7a36f7ebd5d4342a259b093e45d4c32 on tablet f7a36f7ebd5d4342a259b093e45d4c32 with peer 22ce0e487f0341fd9bf853393d6e7683
I20260810 01:59:17.917798 9417 tablet_bootstrap.cc:492] T f3d04e9457c944a8a72861680bdf9b7c P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:17.920040 9417 tablet_bootstrap.cc:492] T f3d04e9457c944a8a72861680bdf9b7c P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap complete.
I20260810 01:59:17.931344 9417 ts_tablet_manager.cc:1403] T f3d04e9457c944a8a72861680bdf9b7c P 4dd4cba155c941b4b7ad4d64c7431536: Time spent bootstrapping tablet: real 0.567s user 0.049s sys 0.003s
I20260810 01:59:17.932420 9417 raft_consensus.cc:359] T f3d04e9457c944a8a72861680bdf9b7c P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:17.938464 9417 raft_consensus.cc:740] T f3d04e9457c944a8a72861680bdf9b7c P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dd4cba155c941b4b7ad4d64c7431536, State: Initialized, Role: FOLLOWER
I20260810 01:59:17.939214 9417 consensus_queue.cc:260] T f3d04e9457c944a8a72861680bdf9b7c P 4dd4cba155c941b4b7ad4d64c7431536 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:17.967924 9623 tablet_bootstrap.cc:492] T 0afbd7afdd834537b15c727355724562 P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:17.972805 9623 tablet_bootstrap.cc:492] T 0afbd7afdd834537b15c727355724562 P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap complete.
I20260810 01:59:17.973224 9623 ts_tablet_manager.cc:1403] T 0afbd7afdd834537b15c727355724562 P 22ce0e487f0341fd9bf853393d6e7683: Time spent bootstrapping tablet: real 0.296s user 0.049s sys 0.004s
I20260810 01:59:17.977327 9623 raft_consensus.cc:359] T 0afbd7afdd834537b15c727355724562 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:17.977701 9623 raft_consensus.cc:740] T 0afbd7afdd834537b15c727355724562 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ce0e487f0341fd9bf853393d6e7683, State: Initialized, Role: FOLLOWER
I20260810 01:59:17.978104 9623 consensus_queue.cc:260] T 0afbd7afdd834537b15c727355724562 P 22ce0e487f0341fd9bf853393d6e7683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:17.978845 9623 ts_tablet_manager.cc:1434] T 0afbd7afdd834537b15c727355724562 P 22ce0e487f0341fd9bf853393d6e7683: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260810 01:59:17.980031 4337 tablet_copy_service.cc:342] P ca4469fc2dbc48488bc7ad7f482f129e: Request end of tablet copy session 22ce0e487f0341fd9bf853393d6e7683-0afbd7afdd834537b15c727355724562 received from {username='slave'} at 127.21.64.198:60673
I20260810 01:59:17.980175 4337 tablet_copy_service.cc:434] P ca4469fc2dbc48488bc7ad7f482f129e: ending tablet copy session 22ce0e487f0341fd9bf853393d6e7683-0afbd7afdd834537b15c727355724562 on tablet 0afbd7afdd834537b15c727355724562 with peer 22ce0e487f0341fd9bf853393d6e7683
I20260810 01:59:17.991796 9417 ts_tablet_manager.cc:1434] T f3d04e9457c944a8a72861680bdf9b7c P 4dd4cba155c941b4b7ad4d64c7431536: Time spent starting tablet: real 0.060s user 0.005s sys 0.000s
I20260810 01:59:17.993270 4162 tablet_copy_service.cc:342] P 17b49c694faf479ea2e5083470fc0302: Request end of tablet copy session 4dd4cba155c941b4b7ad4d64c7431536-f3d04e9457c944a8a72861680bdf9b7c received from {username='slave'} at 127.21.64.197:39923
I20260810 01:59:17.993489 4162 tablet_copy_service.cc:434] P 17b49c694faf479ea2e5083470fc0302: ending tablet copy session 4dd4cba155c941b4b7ad4d64c7431536-f3d04e9457c944a8a72861680bdf9b7c on tablet f3d04e9457c944a8a72861680bdf9b7c with peer 4dd4cba155c941b4b7ad4d64c7431536
I20260810 01:59:18.038931 6739 raft_consensus.cc:1217] T f3d04e9457c944a8a72861680bdf9b7c P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20260810 01:59:18.061272 6397 raft_consensus.cc:1217] T f3d04e9457c944a8a72861680bdf9b7c P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20260810 01:59:18.094173 6565 raft_consensus.cc:1217] T f7a36f7ebd5d4342a259b093e45d4c32 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.5->[1.6-1.6] Dedup: 1.6->[]
I20260810 01:59:18.137013 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:18.177681 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:59:18.252178 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:18.327569 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:18.329504 6715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:18.335145 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:18.362497 9748 ts_tablet_manager.cc:933] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227: Initiating tablet copy from peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 01:59:18.397918 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:18.417496 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:18.480125 9748 tablet_copy_client.cc:323] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.194:43893
I20260810 01:59:18.482645 3973 tablet_copy_service.cc:140] P 82f93d1d11364ceeb485585b4ae78871: Received BeginTabletCopySession request for tablet fe8e1f0908234e46881258cfe79835f8 from peer 3136daf7101445beadc1aa19bc01c227 ({username='slave'} at 127.21.64.200:39385)
I20260810 01:59:18.482883 3973 tablet_copy_service.cc:161] P 82f93d1d11364ceeb485585b4ae78871: Beginning new tablet copy session on tablet fe8e1f0908234e46881258cfe79835f8 from peer 3136daf7101445beadc1aa19bc01c227 at {username='slave'} at 127.21.64.200:39385: session id = 3136daf7101445beadc1aa19bc01c227-fe8e1f0908234e46881258cfe79835f8
I20260810 01:59:18.488986 3973 tablet_copy_source_session.cc:215] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:18.498399 9748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe8e1f0908234e46881258cfe79835f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:18.498415 6565 raft_consensus.cc:1217] T 0afbd7afdd834537b15c727355724562 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20260810 01:59:18.523942 9748 tablet_copy_client.cc:806] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:18.525254 9748 tablet_copy_client.cc:670] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:18.537473 9748 tablet_copy_client.cc:538] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:18.553653 9748 tablet_bootstrap.cc:492] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227: Bootstrap starting.
I20260810 01:59:18.848709 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:18.881628 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:18.891099 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:59:18.891543 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:18.894038 6715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:18.896796 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:18.939148 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:18.983884 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:18.993798 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:19.000074 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:19.000600 9748 tablet_bootstrap.cc:492] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:19.001097 9748 tablet_bootstrap.cc:492] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227: Bootstrap complete.
I20260810 01:59:19.014635 9748 ts_tablet_manager.cc:1403] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227: Time spent bootstrapping tablet: real 0.461s user 0.047s sys 0.014s
I20260810 01:59:19.018074 9748 raft_consensus.cc:359] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:19.021605 9748 raft_consensus.cc:740] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3136daf7101445beadc1aa19bc01c227, State: Initialized, Role: FOLLOWER
I20260810 01:59:19.041373 9748 consensus_queue.cc:260] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:19.049650 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:59:19.060644 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:19.091907 6715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260810 01:59:19.148439 3857 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.196:41943, user_credentials={real_user=slave}} blocked reactor thread for 94247.2us
I20260810 01:59:19.161523 9748 ts_tablet_manager.cc:1434] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227: Time spent starting tablet: real 0.144s user 0.000s sys 0.005s
I20260810 01:59:19.162331 3973 tablet_copy_service.cc:342] P 82f93d1d11364ceeb485585b4ae78871: Request end of tablet copy session 3136daf7101445beadc1aa19bc01c227-fe8e1f0908234e46881258cfe79835f8 received from {username='slave'} at 127.21.64.200:39385
I20260810 01:59:19.162524 3973 tablet_copy_service.cc:434] P 82f93d1d11364ceeb485585b4ae78871: ending tablet copy session 3136daf7101445beadc1aa19bc01c227-fe8e1f0908234e46881258cfe79835f8 on tablet fe8e1f0908234e46881258cfe79835f8 with peer 3136daf7101445beadc1aa19bc01c227
I20260810 01:59:19.174714 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:19.196364 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:19.211695 3943 consensus_queue.cc:237] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:19.212394 3945 consensus_queue.cc:237] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:19.225592 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:19.264828 3756 raft_consensus.cc:1275] T 2e72e04459b140cc9e20ad633b1ab5c4 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:19.266050 8766 consensus_queue.cc:1048] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:19.266682 4132 raft_consensus.cc:1275] T 2e72e04459b140cc9e20ad633b1ab5c4 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:19.267341 9416 consensus_queue.cc:1048] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260810 01:59:19.268532 3855 consensus_peers.cc:597] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871 -> Peer 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995): Couldn't send request to peer 3136daf7101445beadc1aa19bc01c227. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2e72e04459b140cc9e20ad633b1ab5c4. This is attempt 1: this message will repeat every 5th retry.
W20260810 01:59:19.284730 3858 consensus_peers.cc:597] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 -> Peer c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199:41689): Couldn't send request to peer c5ed5317da9c464b93f979c405f0f6e4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fe8e1f0908234e46881258cfe79835f8. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:19.284924 4132 raft_consensus.cc:1275] T fe8e1f0908234e46881258cfe79835f8 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:19.285530 6909 raft_consensus.cc:1275] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:19.285972 8766 consensus_queue.cc:1048] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:19.286429 3761 raft_consensus.cc:1275] T fe8e1f0908234e46881258cfe79835f8 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:19.287140 9416 consensus_queue.cc:1048] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:19.289659 9416 consensus_queue.cc:1048] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:19.307351 6908 raft_consensus.cc:2955] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:19.311126 4131 raft_consensus.cc:2955] T fe8e1f0908234e46881258cfe79835f8 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:19.312753 9868 raft_consensus.cc:2955] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:19.313606 3573 catalog_manager.cc:5719] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227 reported cstate change: config changed from index 4 to 5, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:19.318044 4131 raft_consensus.cc:2955] T 2e72e04459b140cc9e20ad633b1ab5c4 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:19.305271 8766 raft_consensus.cc:2955] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:19.327172 3565 catalog_manager.cc:5719] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871 reported cstate change: config changed from index -1 to 4, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:19.335408 3756 raft_consensus.cc:2955] T fe8e1f0908234e46881258cfe79835f8 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:19.345810 3761 raft_consensus.cc:2955] T 2e72e04459b140cc9e20ad633b1ab5c4 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:19.674834 4131 consensus_queue.cc:237] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:19.677932 3945 consensus_queue.cc:237] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
W20260810 01:59:19.681432 3855 consensus_peers.cc:597] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 -> Peer 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197:38787): Couldn't send request to peer 4dd4cba155c941b4b7ad4d64c7431536. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fe8e1f0908234e46881258cfe79835f8. This is attempt 1: this message will repeat every 5th retry.
W20260810 01:59:19.681733 3858 consensus_peers.cc:597] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 -> Peer c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199:41689): Couldn't send request to peer c5ed5317da9c464b93f979c405f0f6e4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fe8e1f0908234e46881258cfe79835f8. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:19.682389 3761 raft_consensus.cc:1275] T fe8e1f0908234e46881258cfe79835f8 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:19.682389 6909 raft_consensus.cc:1275] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:19.683547 4132 raft_consensus.cc:1275] T fe8e1f0908234e46881258cfe79835f8 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:19.683620 8766 consensus_queue.cc:1048] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:19.684103 8766 consensus_queue.cc:1048] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:19.684998 9890 consensus_queue.cc:1048] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:19.689518 8766 raft_consensus.cc:2955] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:19.693887 3761 raft_consensus.cc:2955] T fe8e1f0908234e46881258cfe79835f8 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:19.701669 3573 catalog_manager.cc:5719] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 reported cstate change: config changed from index 5 to 6, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:19.702093 6909 raft_consensus.cc:2955] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:19.703958 4132 raft_consensus.cc:2955] T fe8e1f0908234e46881258cfe79835f8 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:19.716316 3761 raft_consensus.cc:1275] T d05e147199e44b8ca712e18d22e7cce7 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260810 01:59:19.716535 4036 consensus_peers.cc:597] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302 -> Peer 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995): Couldn't send request to peer 3136daf7101445beadc1aa19bc01c227. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d05e147199e44b8ca712e18d22e7cce7. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:19.716969 9674 consensus_queue.cc:1048] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:19.717624 3943 raft_consensus.cc:1275] T d05e147199e44b8ca712e18d22e7cce7 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:19.718734 9674 consensus_queue.cc:1048] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:19.723460 9674 raft_consensus.cc:2955] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:19.724078 3943 raft_consensus.cc:2955] T d05e147199e44b8ca712e18d22e7cce7 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:19.753289 10014 ts_tablet_manager.cc:933] T 2e72e04459b140cc9e20ad633b1ab5c4 P 3136daf7101445beadc1aa19bc01c227: Initiating tablet copy from peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 01:59:19.754576 10014 tablet_copy_client.cc:323] T 2e72e04459b140cc9e20ad633b1ab5c4 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.194:43893
I20260810 01:59:19.758097 3973 tablet_copy_service.cc:140] P 82f93d1d11364ceeb485585b4ae78871: Received BeginTabletCopySession request for tablet 2e72e04459b140cc9e20ad633b1ab5c4 from peer 3136daf7101445beadc1aa19bc01c227 ({username='slave'} at 127.21.64.200:39385)
I20260810 01:59:19.758287 3973 tablet_copy_service.cc:161] P 82f93d1d11364ceeb485585b4ae78871: Beginning new tablet copy session on tablet 2e72e04459b140cc9e20ad633b1ab5c4 from peer 3136daf7101445beadc1aa19bc01c227 at {username='slave'} at 127.21.64.200:39385: session id = 3136daf7101445beadc1aa19bc01c227-2e72e04459b140cc9e20ad633b1ab5c4
I20260810 01:59:19.764554 3572 catalog_manager.cc:5719] T d05e147199e44b8ca712e18d22e7cce7 P 82f93d1d11364ceeb485585b4ae78871 reported cstate change: config changed from index -1 to 4, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New cstate: current_term: 1 leader_uuid: "17b49c694faf479ea2e5083470fc0302" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:19.768707 3973 tablet_copy_source_session.cc:215] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:19.771466 10014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e72e04459b140cc9e20ad633b1ab5c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:19.790015 3761 raft_consensus.cc:2955] T d05e147199e44b8ca712e18d22e7cce7 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:19.818143 10014 tablet_copy_client.cc:806] T 2e72e04459b140cc9e20ad633b1ab5c4 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:19.818629 10014 tablet_copy_client.cc:670] T 2e72e04459b140cc9e20ad633b1ab5c4 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:19.821384 10014 tablet_copy_client.cc:538] T 2e72e04459b140cc9e20ad633b1ab5c4 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:19.825752 10014 tablet_bootstrap.cc:492] T 2e72e04459b140cc9e20ad633b1ab5c4 P 3136daf7101445beadc1aa19bc01c227: Bootstrap starting.
I20260810 01:59:19.956110 10014 tablet_bootstrap.cc:492] T 2e72e04459b140cc9e20ad633b1ab5c4 P 3136daf7101445beadc1aa19bc01c227: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:19.956738 10014 tablet_bootstrap.cc:492] T 2e72e04459b140cc9e20ad633b1ab5c4 P 3136daf7101445beadc1aa19bc01c227: Bootstrap complete.
I20260810 01:59:19.957129 10014 ts_tablet_manager.cc:1403] T 2e72e04459b140cc9e20ad633b1ab5c4 P 3136daf7101445beadc1aa19bc01c227: Time spent bootstrapping tablet: real 0.131s user 0.057s sys 0.024s
I20260810 01:59:19.958178 10014 raft_consensus.cc:359] T 2e72e04459b140cc9e20ad633b1ab5c4 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:19.958467 10014 raft_consensus.cc:740] T 2e72e04459b140cc9e20ad633b1ab5c4 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3136daf7101445beadc1aa19bc01c227, State: Initialized, Role: FOLLOWER
I20260810 01:59:19.958810 10014 consensus_queue.cc:260] T 2e72e04459b140cc9e20ad633b1ab5c4 P 3136daf7101445beadc1aa19bc01c227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:19.959458 10014 ts_tablet_manager.cc:1434] T 2e72e04459b140cc9e20ad633b1ab5c4 P 3136daf7101445beadc1aa19bc01c227: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:59:19.960681 3973 tablet_copy_service.cc:342] P 82f93d1d11364ceeb485585b4ae78871: Request end of tablet copy session 3136daf7101445beadc1aa19bc01c227-2e72e04459b140cc9e20ad633b1ab5c4 received from {username='slave'} at 127.21.64.200:39385
I20260810 01:59:19.960835 3973 tablet_copy_service.cc:434] P 82f93d1d11364ceeb485585b4ae78871: ending tablet copy session 3136daf7101445beadc1aa19bc01c227-2e72e04459b140cc9e20ad633b1ab5c4 on tablet 2e72e04459b140cc9e20ad633b1ab5c4 with peer 3136daf7101445beadc1aa19bc01c227
I20260810 01:59:19.972472 4132 consensus_queue.cc:237] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:19.983616 3943 raft_consensus.cc:1275] T e70193bd4055469d870a76542eaef524 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:19.983887 4313 raft_consensus.cc:1275] T e70193bd4055469d870a76542eaef524 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260810 01:59:19.984908 4038 consensus_peers.cc:597] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302 -> Peer 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317): Couldn't send request to peer 22ce0e487f0341fd9bf853393d6e7683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e70193bd4055469d870a76542eaef524. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:19.985268 9866 consensus_queue.cc:1048] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:19.985848 9674 consensus_queue.cc:1048] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:20.053607 9674 raft_consensus.cc:2955] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:20.061479 4313 raft_consensus.cc:2955] T e70193bd4055469d870a76542eaef524 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:20.073400 3943 raft_consensus.cc:2955] T e70193bd4055469d870a76542eaef524 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:20.075891 3572 catalog_manager.cc:5719] T e70193bd4055469d870a76542eaef524 P ca4469fc2dbc48488bc7ad7f482f129e reported cstate change: config changed from index -1 to 4, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New cstate: current_term: 1 leader_uuid: "17b49c694faf479ea2e5083470fc0302" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:20.123901 10014 ts_tablet_manager.cc:933] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227: Initiating tablet copy from peer 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189)
I20260810 01:59:20.128520 6908 raft_consensus.cc:1217] T 2e72e04459b140cc9e20ad633b1ab5c4 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20260810 01:59:20.133553 4132 consensus_queue.cc:237] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:20.136759 10014 tablet_copy_client.cc:323] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.195:39189
I20260810 01:59:20.137156 3945 raft_consensus.cc:1275] T d05e147199e44b8ca712e18d22e7cce7 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:20.138108 4162 tablet_copy_service.cc:140] P 17b49c694faf479ea2e5083470fc0302: Received BeginTabletCopySession request for tablet d05e147199e44b8ca712e18d22e7cce7 from peer 3136daf7101445beadc1aa19bc01c227 ({username='slave'} at 127.21.64.200:35273)
I20260810 01:59:20.138311 4162 tablet_copy_service.cc:161] P 17b49c694faf479ea2e5083470fc0302: Beginning new tablet copy session on tablet d05e147199e44b8ca712e18d22e7cce7 from peer 3136daf7101445beadc1aa19bc01c227 at {username='slave'} at 127.21.64.200:35273: session id = 3136daf7101445beadc1aa19bc01c227-d05e147199e44b8ca712e18d22e7cce7
I20260810 01:59:20.142985 3761 raft_consensus.cc:1275] T d05e147199e44b8ca712e18d22e7cce7 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:20.144887 9674 consensus_queue.cc:1048] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260810 01:59:20.146808 4036 consensus_peers.cc:597] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302 -> Peer 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197:38787): Couldn't send request to peer 4dd4cba155c941b4b7ad4d64c7431536. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d05e147199e44b8ca712e18d22e7cce7. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:20.149853 9674 consensus_queue.cc:1048] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260810 01:59:20.150688 4036 consensus_peers.cc:597] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302 -> Peer 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995): Couldn't send request to peer 3136daf7101445beadc1aa19bc01c227. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d05e147199e44b8ca712e18d22e7cce7. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:20.155838 4162 tablet_copy_source_session.cc:215] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:20.160115 9674 raft_consensus.cc:2955] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:20.161406 3761 raft_consensus.cc:2955] T d05e147199e44b8ca712e18d22e7cce7 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:20.164978 10014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d05e147199e44b8ca712e18d22e7cce7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:20.181648 3573 catalog_manager.cc:5719] T d05e147199e44b8ca712e18d22e7cce7 P dc85be7d460a404f997177f57680850f reported cstate change: config changed from index 4 to 5, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New cstate: current_term: 1 leader_uuid: "17b49c694faf479ea2e5083470fc0302" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:20.223161 10153 ts_tablet_manager.cc:933] T fe8e1f0908234e46881258cfe79835f8 P 4dd4cba155c941b4b7ad4d64c7431536: Initiating tablet copy from peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 01:59:20.232146 3945 raft_consensus.cc:2955] T d05e147199e44b8ca712e18d22e7cce7 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:20.232864 10153 tablet_copy_client.cc:323] T fe8e1f0908234e46881258cfe79835f8 P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.194:43893
I20260810 01:59:20.233836 3973 tablet_copy_service.cc:140] P 82f93d1d11364ceeb485585b4ae78871: Received BeginTabletCopySession request for tablet fe8e1f0908234e46881258cfe79835f8 from peer 4dd4cba155c941b4b7ad4d64c7431536 ({username='slave'} at 127.21.64.197:54659)
I20260810 01:59:20.234050 3973 tablet_copy_service.cc:161] P 82f93d1d11364ceeb485585b4ae78871: Beginning new tablet copy session on tablet fe8e1f0908234e46881258cfe79835f8 from peer 4dd4cba155c941b4b7ad4d64c7431536 at {username='slave'} at 127.21.64.197:54659: session id = 4dd4cba155c941b4b7ad4d64c7431536-fe8e1f0908234e46881258cfe79835f8
I20260810 01:59:20.249872 10014 tablet_copy_client.cc:806] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:20.249949 3973 tablet_copy_source_session.cc:215] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:20.250397 10014 tablet_copy_client.cc:670] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:20.253772 10153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe8e1f0908234e46881258cfe79835f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:20.259523 10014 tablet_copy_client.cc:538] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:20.270512 10153 tablet_copy_client.cc:806] T fe8e1f0908234e46881258cfe79835f8 P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:20.270865 10153 tablet_copy_client.cc:670] T fe8e1f0908234e46881258cfe79835f8 P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:20.273106 10153 tablet_copy_client.cc:538] T fe8e1f0908234e46881258cfe79835f8 P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:20.277360 10153 tablet_bootstrap.cc:492] T fe8e1f0908234e46881258cfe79835f8 P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap starting.
I20260810 01:59:20.298606 10014 tablet_bootstrap.cc:492] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227: Bootstrap starting.
I20260810 01:59:20.422576 10193 ts_tablet_manager.cc:933] T e70193bd4055469d870a76542eaef524 P 22ce0e487f0341fd9bf853393d6e7683: Initiating tablet copy from peer 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189)
I20260810 01:59:20.455766 10173 ts_tablet_manager.cc:933] T fe8e1f0908234e46881258cfe79835f8 P c5ed5317da9c464b93f979c405f0f6e4: Initiating tablet copy from peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 01:59:20.459889 10193 tablet_copy_client.cc:323] T e70193bd4055469d870a76542eaef524 P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.195:39189
I20260810 01:59:20.460840 4162 tablet_copy_service.cc:140] P 17b49c694faf479ea2e5083470fc0302: Received BeginTabletCopySession request for tablet e70193bd4055469d870a76542eaef524 from peer 22ce0e487f0341fd9bf853393d6e7683 ({username='slave'} at 127.21.64.198:56113)
I20260810 01:59:20.461041 4162 tablet_copy_service.cc:161] P 17b49c694faf479ea2e5083470fc0302: Beginning new tablet copy session on tablet e70193bd4055469d870a76542eaef524 from peer 22ce0e487f0341fd9bf853393d6e7683 at {username='slave'} at 127.21.64.198:56113: session id = 22ce0e487f0341fd9bf853393d6e7683-e70193bd4055469d870a76542eaef524
I20260810 01:59:20.465255 4162 tablet_copy_source_session.cc:215] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:20.470954 10193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e70193bd4055469d870a76542eaef524. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:20.479945 10173 tablet_copy_client.cc:323] T fe8e1f0908234e46881258cfe79835f8 P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.194:43893
I20260810 01:59:20.480932 3973 tablet_copy_service.cc:140] P 82f93d1d11364ceeb485585b4ae78871: Received BeginTabletCopySession request for tablet fe8e1f0908234e46881258cfe79835f8 from peer c5ed5317da9c464b93f979c405f0f6e4 ({username='slave'} at 127.21.64.199:41929)
I20260810 01:59:20.481132 3973 tablet_copy_service.cc:161] P 82f93d1d11364ceeb485585b4ae78871: Beginning new tablet copy session on tablet fe8e1f0908234e46881258cfe79835f8 from peer c5ed5317da9c464b93f979c405f0f6e4 at {username='slave'} at 127.21.64.199:41929: session id = c5ed5317da9c464b93f979c405f0f6e4-fe8e1f0908234e46881258cfe79835f8
I20260810 01:59:20.485005 3973 tablet_copy_source_session.cc:215] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:20.499933 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:59:20.500558 10173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe8e1f0908234e46881258cfe79835f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:20.530566 10014 tablet_bootstrap.cc:492] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=4 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260810 01:59:20.531378 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:20.541005 10014 tablet_bootstrap.cc:492] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227: Bootstrap complete.
I20260810 01:59:20.542055 10014 ts_tablet_manager.cc:1403] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227: Time spent bootstrapping tablet: real 0.244s user 0.058s sys 0.003s
I20260810 01:59:20.543311 10014 raft_consensus.cc:359] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:20.546550 10014 raft_consensus.cc:740] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3136daf7101445beadc1aa19bc01c227, State: Initialized, Role: FOLLOWER
I20260810 01:59:20.547129 10014 consensus_queue.cc:260] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:20.551676 10014 ts_tablet_manager.cc:1434] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260810 01:59:20.558326 4162 tablet_copy_service.cc:342] P 17b49c694faf479ea2e5083470fc0302: Request end of tablet copy session 3136daf7101445beadc1aa19bc01c227-d05e147199e44b8ca712e18d22e7cce7 received from {username='slave'} at 127.21.64.200:35273
I20260810 01:59:20.558554 4162 tablet_copy_service.cc:434] P 17b49c694faf479ea2e5083470fc0302: ending tablet copy session 3136daf7101445beadc1aa19bc01c227-d05e147199e44b8ca712e18d22e7cce7 on tablet d05e147199e44b8ca712e18d22e7cce7 with peer 3136daf7101445beadc1aa19bc01c227
I20260810 01:59:20.586470 10233 ts_tablet_manager.cc:933] T d05e147199e44b8ca712e18d22e7cce7 P 4dd4cba155c941b4b7ad4d64c7431536: Initiating tablet copy from peer 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189)
I20260810 01:59:20.593626 10233 tablet_copy_client.cc:323] T d05e147199e44b8ca712e18d22e7cce7 P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.195:39189
I20260810 01:59:20.594485 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:20.595094 4162 tablet_copy_service.cc:140] P 17b49c694faf479ea2e5083470fc0302: Received BeginTabletCopySession request for tablet d05e147199e44b8ca712e18d22e7cce7 from peer 4dd4cba155c941b4b7ad4d64c7431536 ({username='slave'} at 127.21.64.197:39923)
I20260810 01:59:20.595306 4162 tablet_copy_service.cc:161] P 17b49c694faf479ea2e5083470fc0302: Beginning new tablet copy session on tablet d05e147199e44b8ca712e18d22e7cce7 from peer 4dd4cba155c941b4b7ad4d64c7431536 at {username='slave'} at 127.21.64.197:39923: session id = 4dd4cba155c941b4b7ad4d64c7431536-d05e147199e44b8ca712e18d22e7cce7
I20260810 01:59:20.601617 4162 tablet_copy_source_session.cc:215] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:20.603389 10233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d05e147199e44b8ca712e18d22e7cce7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:20.604696 10153 tablet_bootstrap.cc:492] T fe8e1f0908234e46881258cfe79835f8 P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:20.615585 10233 tablet_copy_client.cc:806] T d05e147199e44b8ca712e18d22e7cce7 P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:20.615901 10233 tablet_copy_client.cc:670] T d05e147199e44b8ca712e18d22e7cce7 P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:20.625896 10153 tablet_bootstrap.cc:492] T fe8e1f0908234e46881258cfe79835f8 P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap complete.
I20260810 01:59:20.626343 10153 ts_tablet_manager.cc:1403] T fe8e1f0908234e46881258cfe79835f8 P 4dd4cba155c941b4b7ad4d64c7431536: Time spent bootstrapping tablet: real 0.349s user 0.071s sys 0.016s
I20260810 01:59:20.626408 10233 tablet_copy_client.cc:538] T d05e147199e44b8ca712e18d22e7cce7 P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:20.627316 10153 raft_consensus.cc:359] T fe8e1f0908234e46881258cfe79835f8 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:20.627588 10153 raft_consensus.cc:740] T fe8e1f0908234e46881258cfe79835f8 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dd4cba155c941b4b7ad4d64c7431536, State: Initialized, Role: FOLLOWER
I20260810 01:59:20.627873 10153 consensus_queue.cc:260] T fe8e1f0908234e46881258cfe79835f8 P 4dd4cba155c941b4b7ad4d64c7431536 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 1.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:20.634866 10233 tablet_bootstrap.cc:492] T d05e147199e44b8ca712e18d22e7cce7 P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap starting.
I20260810 01:59:20.638334 10153 ts_tablet_manager.cc:1434] T fe8e1f0908234e46881258cfe79835f8 P 4dd4cba155c941b4b7ad4d64c7431536: Time spent starting tablet: real 0.012s user 0.003s sys 0.005s
I20260810 01:59:20.640202 3973 tablet_copy_service.cc:342] P 82f93d1d11364ceeb485585b4ae78871: Request end of tablet copy session 4dd4cba155c941b4b7ad4d64c7431536-fe8e1f0908234e46881258cfe79835f8 received from {username='slave'} at 127.21.64.197:54659
I20260810 01:59:20.640362 3973 tablet_copy_service.cc:434] P 82f93d1d11364ceeb485585b4ae78871: ending tablet copy session 4dd4cba155c941b4b7ad4d64c7431536-fe8e1f0908234e46881258cfe79835f8 on tablet fe8e1f0908234e46881258cfe79835f8 with peer 4dd4cba155c941b4b7ad4d64c7431536
I20260810 01:59:20.703006 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:20.714668 10014 tablet_replica.cc:333] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227: stopping tablet replica
I20260810 01:59:20.715255 10014 raft_consensus.cc:2243] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:59:20.715642 10014 pending_rounds.cc:70] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227: Trying to abort 1 pending ops.
I20260810 01:59:20.715775 10014 pending_rounds.cc:77] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227: Aborting op as it isn't in flight: id { term: 1 index: 5 } timestamp: 7316796047904546816 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "d05e147199e44b8ca712e18d22e7cce7" old_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } } new_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } } }
I20260810 01:59:20.716077 10014 raft_consensus.cc:2917] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Aborting config change with OpId 1.5: Aborted: Op aborted
I20260810 01:59:20.716220 10014 raft_consensus.cc:2889] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260810 01:59:20.716385 10014 raft_consensus.cc:2272] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:20.718165 10014 ts_tablet_manager.cc:1916] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:59:20.722653 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:20.725927 10014 ts_tablet_manager.cc:1929] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20260810 01:59:20.726171 10014 log.cc:1199] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/wal/wals/d05e147199e44b8ca712e18d22e7cce7
I20260810 01:59:20.726817 10014 ts_tablet_manager.cc:933] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227: Initiating tablet copy from peer 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189)
I20260810 01:59:20.732666 6715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:20.757526 10014 tablet_copy_client.cc:323] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.195:39189
I20260810 01:59:20.765606 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:20.780733 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:20.842504 10173 tablet_copy_client.cc:806] T fe8e1f0908234e46881258cfe79835f8 P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:20.842849 10173 tablet_copy_client.cc:670] T fe8e1f0908234e46881258cfe79835f8 P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:20.845182 10173 tablet_copy_client.cc:538] T fe8e1f0908234e46881258cfe79835f8 P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:20.855939 10193 tablet_copy_client.cc:806] T e70193bd4055469d870a76542eaef524 P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:20.856257 10193 tablet_copy_client.cc:670] T e70193bd4055469d870a76542eaef524 P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:20.856642 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:20.871389 10173 tablet_bootstrap.cc:492] T fe8e1f0908234e46881258cfe79835f8 P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap starting.
I20260810 01:59:20.874789 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:20.885089 4162 tablet_copy_service.cc:140] P 17b49c694faf479ea2e5083470fc0302: Received BeginTabletCopySession request for tablet d05e147199e44b8ca712e18d22e7cce7 from peer 3136daf7101445beadc1aa19bc01c227 ({username='slave'} at 127.21.64.200:35273)
I20260810 01:59:20.889791 4162 tablet_copy_service.cc:161] P 17b49c694faf479ea2e5083470fc0302: Beginning new tablet copy session on tablet d05e147199e44b8ca712e18d22e7cce7 from peer 3136daf7101445beadc1aa19bc01c227 at {username='slave'} at 127.21.64.200:35273: session id = 3136daf7101445beadc1aa19bc01c227-d05e147199e44b8ca712e18d22e7cce7
I20260810 01:59:20.917459 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:20.928249 4162 tablet_copy_source_session.cc:215] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:20.929575 10014 ts_tablet_manager.cc:1916] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260810 01:59:20.937366 6715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:20.955693 10014 ts_tablet_manager.cc:1929] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.5
I20260810 01:59:20.956055 10014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d05e147199e44b8ca712e18d22e7cce7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:20.965420 10014 tablet_copy_client.cc:806] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:20.965723 10014 tablet_copy_client.cc:670] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:20.970057 10193 tablet_copy_client.cc:538] T e70193bd4055469d870a76542eaef524 P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:20.978005 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:20.981910 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:59:20.982817 6395 raft_consensus.cc:1217] T fe8e1f0908234e46881258cfe79835f8 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.5->[1.6-1.6] Dedup: 1.6->[]
I20260810 01:59:20.997648 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:21.028174 10014 tablet_copy_client.cc:538] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:21.036530 10014 tablet_bootstrap.cc:492] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227: Bootstrap starting.
I20260810 01:59:21.065647 10193 tablet_bootstrap.cc:492] T e70193bd4055469d870a76542eaef524 P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap starting.
I20260810 01:59:21.081056 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:21.213933 10014 tablet_bootstrap.cc:492] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:21.214689 10014 tablet_bootstrap.cc:492] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227: Bootstrap complete.
I20260810 01:59:21.215077 10014 ts_tablet_manager.cc:1403] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227: Time spent bootstrapping tablet: real 0.179s user 0.051s sys 0.005s
I20260810 01:59:21.216112 10014 raft_consensus.cc:359] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:21.216456 10014 raft_consensus.cc:740] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3136daf7101445beadc1aa19bc01c227, State: Initialized, Role: FOLLOWER
I20260810 01:59:21.216825 10014 consensus_queue.cc:260] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:21.227209 10014 ts_tablet_manager.cc:1434] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227: Time spent starting tablet: real 0.012s user 0.002s sys 0.006s
I20260810 01:59:21.228076 4162 tablet_copy_service.cc:342] P 17b49c694faf479ea2e5083470fc0302: Request end of tablet copy session 3136daf7101445beadc1aa19bc01c227-d05e147199e44b8ca712e18d22e7cce7 received from {username='slave'} at 127.21.64.200:35273
I20260810 01:59:21.228240 4162 tablet_copy_service.cc:434] P 17b49c694faf479ea2e5083470fc0302: ending tablet copy session 3136daf7101445beadc1aa19bc01c227-d05e147199e44b8ca712e18d22e7cce7 on tablet d05e147199e44b8ca712e18d22e7cce7 with peer 3136daf7101445beadc1aa19bc01c227
I20260810 01:59:21.318629 6909 raft_consensus.cc:1217] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20260810 01:59:21.338084 10233 tablet_bootstrap.cc:492] T d05e147199e44b8ca712e18d22e7cce7 P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:21.338694 10233 tablet_bootstrap.cc:492] T d05e147199e44b8ca712e18d22e7cce7 P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap complete.
I20260810 01:59:21.339030 10233 ts_tablet_manager.cc:1403] T d05e147199e44b8ca712e18d22e7cce7 P 4dd4cba155c941b4b7ad4d64c7431536: Time spent bootstrapping tablet: real 0.704s user 0.067s sys 0.000s
I20260810 01:59:21.339884 10233 raft_consensus.cc:359] T d05e147199e44b8ca712e18d22e7cce7 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:21.353180 10233 raft_consensus.cc:740] T d05e147199e44b8ca712e18d22e7cce7 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dd4cba155c941b4b7ad4d64c7431536, State: Initialized, Role: FOLLOWER
I20260810 01:59:21.358744 10233 consensus_queue.cc:260] T d05e147199e44b8ca712e18d22e7cce7 P 4dd4cba155c941b4b7ad4d64c7431536 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:21.361445 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:21.362736 10233 ts_tablet_manager.cc:1434] T d05e147199e44b8ca712e18d22e7cce7 P 4dd4cba155c941b4b7ad4d64c7431536: Time spent starting tablet: real 0.024s user 0.000s sys 0.004s
I20260810 01:59:21.364373 4162 tablet_copy_service.cc:342] P 17b49c694faf479ea2e5083470fc0302: Request end of tablet copy session 4dd4cba155c941b4b7ad4d64c7431536-d05e147199e44b8ca712e18d22e7cce7 received from {username='slave'} at 127.21.64.197:39923
I20260810 01:59:21.364548 4162 tablet_copy_service.cc:434] P 17b49c694faf479ea2e5083470fc0302: ending tablet copy session 4dd4cba155c941b4b7ad4d64c7431536-d05e147199e44b8ca712e18d22e7cce7 on tablet d05e147199e44b8ca712e18d22e7cce7 with peer 4dd4cba155c941b4b7ad4d64c7431536
I20260810 01:59:21.391340 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:21.392542 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:59:21.398887 4132 consensus_queue.cc:237] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:21.411111 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:21.508023 10173 tablet_bootstrap.cc:492] T fe8e1f0908234e46881258cfe79835f8 P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:21.508649 10173 tablet_bootstrap.cc:492] T fe8e1f0908234e46881258cfe79835f8 P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap complete.
I20260810 01:59:21.509002 10173 ts_tablet_manager.cc:1403] T fe8e1f0908234e46881258cfe79835f8 P c5ed5317da9c464b93f979c405f0f6e4: Time spent bootstrapping tablet: real 0.638s user 0.065s sys 0.004s
I20260810 01:59:21.512753 10173 raft_consensus.cc:359] T fe8e1f0908234e46881258cfe79835f8 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:21.513816 10173 raft_consensus.cc:740] T fe8e1f0908234e46881258cfe79835f8 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ed5317da9c464b93f979c405f0f6e4, State: Initialized, Role: FOLLOWER
I20260810 01:59:21.515503 10173 consensus_queue.cc:260] T fe8e1f0908234e46881258cfe79835f8 P c5ed5317da9c464b93f979c405f0f6e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 1.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:21.518731 6715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:21.534835 6395 raft_consensus.cc:1217] T d05e147199e44b8ca712e18d22e7cce7 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20260810 01:59:21.555009 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:21.562350 10173 ts_tablet_manager.cc:1434] T fe8e1f0908234e46881258cfe79835f8 P c5ed5317da9c464b93f979c405f0f6e4: Time spent starting tablet: real 0.050s user 0.008s sys 0.000s
I20260810 01:59:21.567651 3973 tablet_copy_service.cc:342] P 82f93d1d11364ceeb485585b4ae78871: Request end of tablet copy session c5ed5317da9c464b93f979c405f0f6e4-fe8e1f0908234e46881258cfe79835f8 received from {username='slave'} at 127.21.64.199:41929
I20260810 01:59:21.567860 3973 tablet_copy_service.cc:434] P 82f93d1d11364ceeb485585b4ae78871: ending tablet copy session c5ed5317da9c464b93f979c405f0f6e4-fe8e1f0908234e46881258cfe79835f8 on tablet fe8e1f0908234e46881258cfe79835f8 with peer c5ed5317da9c464b93f979c405f0f6e4
W20260810 01:59:21.622407 3672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.196:41943, user_credentials={real_user=slave}} blocked reactor thread for 162142us
I20260810 01:59:21.628798 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260810 01:59:21.651562 4036 consensus_peers.cc:597] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302 -> Peer 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995): Couldn't send request to peer 3136daf7101445beadc1aa19bc01c227. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e70193bd4055469d870a76542eaef524. This is attempt 1: this message will repeat every 5th retry.
W20260810 01:59:21.653226 4038 consensus_peers.cc:597] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302 -> Peer 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317): Couldn't send request to peer 22ce0e487f0341fd9bf853393d6e7683. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:21.655108 3945 raft_consensus.cc:1275] T e70193bd4055469d870a76542eaef524 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:21.655776 10250 consensus_queue.cc:1048] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:21.660190 4311 raft_consensus.cc:1275] T e70193bd4055469d870a76542eaef524 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:21.660989 10250 consensus_queue.cc:1048] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:21.693737 10250 raft_consensus.cc:2955] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:21.720728 4313 raft_consensus.cc:2955] T e70193bd4055469d870a76542eaef524 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:21.736886 3573 catalog_manager.cc:5719] T e70193bd4055469d870a76542eaef524 P ca4469fc2dbc48488bc7ad7f482f129e reported cstate change: config changed from index 4 to 5, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New cstate: current_term: 1 leader_uuid: "17b49c694faf479ea2e5083470fc0302" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:21.762287 3945 raft_consensus.cc:2955] T e70193bd4055469d870a76542eaef524 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:21.788872 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:21.849591 10193 tablet_bootstrap.cc:492] T e70193bd4055469d870a76542eaef524 P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:21.850402 10193 tablet_bootstrap.cc:492] T e70193bd4055469d870a76542eaef524 P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap complete.
I20260810 01:59:21.850921 10193 ts_tablet_manager.cc:1403] T e70193bd4055469d870a76542eaef524 P 22ce0e487f0341fd9bf853393d6e7683: Time spent bootstrapping tablet: real 0.785s user 0.073s sys 0.010s
I20260810 01:59:21.851951 10193 raft_consensus.cc:359] T e70193bd4055469d870a76542eaef524 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:21.852362 10193 raft_consensus.cc:740] T e70193bd4055469d870a76542eaef524 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ce0e487f0341fd9bf853393d6e7683, State: Initialized, Role: FOLLOWER
I20260810 01:59:21.852792 10193 consensus_queue.cc:260] T e70193bd4055469d870a76542eaef524 P 22ce0e487f0341fd9bf853393d6e7683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:21.862229 10193 ts_tablet_manager.cc:1434] T e70193bd4055469d870a76542eaef524 P 22ce0e487f0341fd9bf853393d6e7683: Time spent starting tablet: real 0.011s user 0.005s sys 0.003s
I20260810 01:59:21.866357 4162 tablet_copy_service.cc:342] P 17b49c694faf479ea2e5083470fc0302: Request end of tablet copy session 22ce0e487f0341fd9bf853393d6e7683-e70193bd4055469d870a76542eaef524 received from {username='slave'} at 127.21.64.198:56113
I20260810 01:59:21.866528 4162 tablet_copy_service.cc:434] P 17b49c694faf479ea2e5083470fc0302: ending tablet copy session 22ce0e487f0341fd9bf853393d6e7683-e70193bd4055469d870a76542eaef524 on tablet e70193bd4055469d870a76542eaef524 with peer 22ce0e487f0341fd9bf853393d6e7683
I20260810 01:59:21.889485 6739 raft_consensus.cc:1217] T fe8e1f0908234e46881258cfe79835f8 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.5->[1.6-1.6] Dedup: 1.6->[]
I20260810 01:59:22.095397 4311 consensus_queue.cc:237] T eb90d508a0004daa8f10d562cefe5fd6 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:22.109627 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
W20260810 01:59:22.129974 4219 consensus_peers.cc:597] T eb90d508a0004daa8f10d562cefe5fd6 P ca4469fc2dbc48488bc7ad7f482f129e -> Peer 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995): Couldn't send request to peer 3136daf7101445beadc1aa19bc01c227. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eb90d508a0004daa8f10d562cefe5fd6. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:22.132597 4129 raft_consensus.cc:1275] T eb90d508a0004daa8f10d562cefe5fd6 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:22.133739 9877 consensus_queue.cc:1048] T eb90d508a0004daa8f10d562cefe5fd6 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:22.142743 3945 raft_consensus.cc:1275] T eb90d508a0004daa8f10d562cefe5fd6 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260810 01:59:22.143473 10280 consensus_queue.cc:1048] T eb90d508a0004daa8f10d562cefe5fd6 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 01:59:22.146044 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:22.148953 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:22.169665 6715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:22.181584 10491 ts_tablet_manager.cc:933] T e70193bd4055469d870a76542eaef524 P 3136daf7101445beadc1aa19bc01c227: Initiating tablet copy from peer 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189)
I20260810 01:59:22.184345 10280 raft_consensus.cc:2955] T eb90d508a0004daa8f10d562cefe5fd6 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:22.189741 4129 raft_consensus.cc:2955] T eb90d508a0004daa8f10d562cefe5fd6 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:22.199811 3945 raft_consensus.cc:2955] T eb90d508a0004daa8f10d562cefe5fd6 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:22.202085 3572 catalog_manager.cc:5719] T eb90d508a0004daa8f10d562cefe5fd6 P ca4469fc2dbc48488bc7ad7f482f129e reported cstate change: config changed from index -1 to 4, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:22.215492 10491 tablet_copy_client.cc:323] T e70193bd4055469d870a76542eaef524 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.195:39189
I20260810 01:59:22.216810 4162 tablet_copy_service.cc:140] P 17b49c694faf479ea2e5083470fc0302: Received BeginTabletCopySession request for tablet e70193bd4055469d870a76542eaef524 from peer 3136daf7101445beadc1aa19bc01c227 ({username='slave'} at 127.21.64.200:35273)
I20260810 01:59:22.217056 4162 tablet_copy_service.cc:161] P 17b49c694faf479ea2e5083470fc0302: Beginning new tablet copy session on tablet e70193bd4055469d870a76542eaef524 from peer 3136daf7101445beadc1aa19bc01c227 at {username='slave'} at 127.21.64.200:35273: session id = 3136daf7101445beadc1aa19bc01c227-e70193bd4055469d870a76542eaef524
I20260810 01:59:22.222205 4162 tablet_copy_source_session.cc:215] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:22.225716 10491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e70193bd4055469d870a76542eaef524. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:22.231603 6565 raft_consensus.cc:2955] T e70193bd4055469d870a76542eaef524 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:22.249918 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:22.252422 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:22.269050 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:22.275870 10491 tablet_copy_client.cc:806] T e70193bd4055469d870a76542eaef524 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:22.276571 10491 tablet_copy_client.cc:670] T e70193bd4055469d870a76542eaef524 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:22.281638 10491 tablet_copy_client.cc:538] T e70193bd4055469d870a76542eaef524 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:22.293169 10491 tablet_bootstrap.cc:492] T e70193bd4055469d870a76542eaef524 P 3136daf7101445beadc1aa19bc01c227: Bootstrap starting.
I20260810 01:59:22.338665 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
W20260810 01:59:22.365633 3857 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.196:41943, user_credentials={real_user=slave}} blocked reactor thread for 83068.7us
I20260810 01:59:22.648895 10491 tablet_bootstrap.cc:492] T e70193bd4055469d870a76542eaef524 P 3136daf7101445beadc1aa19bc01c227: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:22.649943 10491 tablet_bootstrap.cc:492] T e70193bd4055469d870a76542eaef524 P 3136daf7101445beadc1aa19bc01c227: Bootstrap complete.
I20260810 01:59:22.650337 10491 ts_tablet_manager.cc:1403] T e70193bd4055469d870a76542eaef524 P 3136daf7101445beadc1aa19bc01c227: Time spent bootstrapping tablet: real 0.357s user 0.063s sys 0.010s
I20260810 01:59:22.651675 10491 raft_consensus.cc:359] T e70193bd4055469d870a76542eaef524 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:22.652093 10491 raft_consensus.cc:740] T e70193bd4055469d870a76542eaef524 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3136daf7101445beadc1aa19bc01c227, State: Initialized, Role: FOLLOWER
I20260810 01:59:22.654420 10491 consensus_queue.cc:260] T e70193bd4055469d870a76542eaef524 P 3136daf7101445beadc1aa19bc01c227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:22.690290 10491 ts_tablet_manager.cc:1434] T e70193bd4055469d870a76542eaef524 P 3136daf7101445beadc1aa19bc01c227: Time spent starting tablet: real 0.040s user 0.012s sys 0.004s
I20260810 01:59:22.694059 4162 tablet_copy_service.cc:342] P 17b49c694faf479ea2e5083470fc0302: Request end of tablet copy session 3136daf7101445beadc1aa19bc01c227-e70193bd4055469d870a76542eaef524 received from {username='slave'} at 127.21.64.200:35273
I20260810 01:59:22.694286 4162 tablet_copy_service.cc:434] P 17b49c694faf479ea2e5083470fc0302: ending tablet copy session 3136daf7101445beadc1aa19bc01c227-e70193bd4055469d870a76542eaef524 on tablet e70193bd4055469d870a76542eaef524 with peer 3136daf7101445beadc1aa19bc01c227
I20260810 01:59:22.695731 10491 ts_tablet_manager.cc:933] T eb90d508a0004daa8f10d562cefe5fd6 P 3136daf7101445beadc1aa19bc01c227: Initiating tablet copy from peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943)
I20260810 01:59:22.712476 10491 tablet_copy_client.cc:323] T eb90d508a0004daa8f10d562cefe5fd6 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.196:41943
I20260810 01:59:22.713604 4337 tablet_copy_service.cc:140] P ca4469fc2dbc48488bc7ad7f482f129e: Received BeginTabletCopySession request for tablet eb90d508a0004daa8f10d562cefe5fd6 from peer 3136daf7101445beadc1aa19bc01c227 ({username='slave'} at 127.21.64.200:36881)
I20260810 01:59:22.713788 4337 tablet_copy_service.cc:161] P ca4469fc2dbc48488bc7ad7f482f129e: Beginning new tablet copy session on tablet eb90d508a0004daa8f10d562cefe5fd6 from peer 3136daf7101445beadc1aa19bc01c227 at {username='slave'} at 127.21.64.200:36881: session id = 3136daf7101445beadc1aa19bc01c227-eb90d508a0004daa8f10d562cefe5fd6
I20260810 01:59:22.717000 4337 tablet_copy_source_session.cc:215] T eb90d508a0004daa8f10d562cefe5fd6 P ca4469fc2dbc48488bc7ad7f482f129e: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:22.724828 10491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb90d508a0004daa8f10d562cefe5fd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:22.746677 10491 tablet_copy_client.cc:806] T eb90d508a0004daa8f10d562cefe5fd6 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:22.747090 10491 tablet_copy_client.cc:670] T eb90d508a0004daa8f10d562cefe5fd6 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:22.749128 10491 tablet_copy_client.cc:538] T eb90d508a0004daa8f10d562cefe5fd6 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:22.753218 10491 tablet_bootstrap.cc:492] T eb90d508a0004daa8f10d562cefe5fd6 P 3136daf7101445beadc1aa19bc01c227: Bootstrap starting.
I20260810 01:59:22.774515 6909 raft_consensus.cc:1217] T e70193bd4055469d870a76542eaef524 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20260810 01:59:22.921058 10491 tablet_bootstrap.cc:492] T eb90d508a0004daa8f10d562cefe5fd6 P 3136daf7101445beadc1aa19bc01c227: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:22.923568 10491 tablet_bootstrap.cc:492] T eb90d508a0004daa8f10d562cefe5fd6 P 3136daf7101445beadc1aa19bc01c227: Bootstrap complete.
I20260810 01:59:22.923940 10491 ts_tablet_manager.cc:1403] T eb90d508a0004daa8f10d562cefe5fd6 P 3136daf7101445beadc1aa19bc01c227: Time spent bootstrapping tablet: real 0.171s user 0.057s sys 0.010s
I20260810 01:59:22.940800 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:59:22.925097 10491 raft_consensus.cc:359] T eb90d508a0004daa8f10d562cefe5fd6 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:22.944536 10491 raft_consensus.cc:740] T eb90d508a0004daa8f10d562cefe5fd6 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3136daf7101445beadc1aa19bc01c227, State: Initialized, Role: FOLLOWER
I20260810 01:59:22.945269 10491 consensus_queue.cc:260] T eb90d508a0004daa8f10d562cefe5fd6 P 3136daf7101445beadc1aa19bc01c227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:22.947973 10491 ts_tablet_manager.cc:1434] T eb90d508a0004daa8f10d562cefe5fd6 P 3136daf7101445beadc1aa19bc01c227: Time spent starting tablet: real 0.024s user 0.002s sys 0.000s
I20260810 01:59:22.953769 4337 tablet_copy_service.cc:342] P ca4469fc2dbc48488bc7ad7f482f129e: Request end of tablet copy session 3136daf7101445beadc1aa19bc01c227-eb90d508a0004daa8f10d562cefe5fd6 received from {username='slave'} at 127.21.64.200:36881
I20260810 01:59:22.953970 4337 tablet_copy_service.cc:434] P ca4469fc2dbc48488bc7ad7f482f129e: ending tablet copy session 3136daf7101445beadc1aa19bc01c227-eb90d508a0004daa8f10d562cefe5fd6 on tablet eb90d508a0004daa8f10d562cefe5fd6 with peer 3136daf7101445beadc1aa19bc01c227
I20260810 01:59:22.984803 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:22.989965 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:23.000197 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:23.008134 6715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:23.008580 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:23.018105 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:23.028170 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:23.193204 6909 raft_consensus.cc:1217] T eb90d508a0004daa8f10d562cefe5fd6 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20260810 01:59:23.368358 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:59:23.386361 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:23.455413 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:23.477809 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:23.524420 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:23.569517 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:59:23.579389 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:23.591421 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:23.620102 6715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:23.624785 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:59:23.639844 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:23.660277 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:23.679333 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:23.703088 6715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:23.715860 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:23.731894 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:23.746058 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:23.759486 6715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:23.762275 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:23.778350 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:23.828869 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:23.839012 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:23.855054 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:23.884789 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
W20260810 01:59:24.189550 4038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.198:45317, user_credentials={real_user=slave}} blocked reactor thread for 71826.3us
I20260810 01:59:24.391002 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:59:24.394012 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:24.451757 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:24.460547 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:24.462209 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:24.472957 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:24.504292 6715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:24.504212 4311 consensus_queue.cc:237] T eb90d508a0004daa8f10d562cefe5fd6 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:24.532428 6908 raft_consensus.cc:1275] T eb90d508a0004daa8f10d562cefe5fd6 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:24.533531 10715 consensus_queue.cc:1048] T eb90d508a0004daa8f10d562cefe5fd6 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:24.534538 4132 raft_consensus.cc:1275] T eb90d508a0004daa8f10d562cefe5fd6 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:24.535094 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:24.536154 10715 consensus_queue.cc:1048] T eb90d508a0004daa8f10d562cefe5fd6 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:24.581925 10715 raft_consensus.cc:2955] T eb90d508a0004daa8f10d562cefe5fd6 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:24.587428 4129 raft_consensus.cc:2955] T eb90d508a0004daa8f10d562cefe5fd6 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:24.592916 3568 catalog_manager.cc:5719] T eb90d508a0004daa8f10d562cefe5fd6 P ca4469fc2dbc48488bc7ad7f482f129e reported cstate change: config changed from index 4 to 5, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:24.605132 6908 raft_consensus.cc:2955] T eb90d508a0004daa8f10d562cefe5fd6 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:24.701527 3917 tablet_service.cc:1558] Processing DeleteTablet for tablet eb90d508a0004daa8f10d562cefe5fd6 with delete_type TABLET_DATA_TOMBSTONED (TS 82f93d1d11364ceeb485585b4ae78871 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:51288
I20260810 01:59:24.714012 10973 tablet_replica.cc:333] T eb90d508a0004daa8f10d562cefe5fd6 P 82f93d1d11364ceeb485585b4ae78871: stopping tablet replica
I20260810 01:59:24.715209 10973 raft_consensus.cc:2243] T eb90d508a0004daa8f10d562cefe5fd6 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:59:24.717813 10973 raft_consensus.cc:2272] T eb90d508a0004daa8f10d562cefe5fd6 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:24.725188 10973 ts_tablet_manager.cc:1916] T eb90d508a0004daa8f10d562cefe5fd6 P 82f93d1d11364ceeb485585b4ae78871: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:59:24.798519 10973 ts_tablet_manager.cc:1929] T eb90d508a0004daa8f10d562cefe5fd6 P 82f93d1d11364ceeb485585b4ae78871: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.4
I20260810 01:59:24.799191 10973 log.cc:1199] T eb90d508a0004daa8f10d562cefe5fd6 P 82f93d1d11364ceeb485585b4ae78871: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal/wals/eb90d508a0004daa8f10d562cefe5fd6
I20260810 01:59:24.800781 3553 catalog_manager.cc:5050] TS 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): tablet eb90d508a0004daa8f10d562cefe5fd6 (table rebalance_test_table_3 [id=c515c90b2c71492f812b4df18501ee04]) successfully deleted
I20260810 01:59:25.050125 3943 consensus_queue.cc:237] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:25.083666 6737 raft_consensus.cc:1275] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:25.084818 10812 consensus_queue.cc:1048] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:25.100592 6395 raft_consensus.cc:1275] T da507bc24d964ce1a5835edad5177726 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:25.103259 10803 consensus_queue.cc:1048] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:25.104475 3761 raft_consensus.cc:1275] T da507bc24d964ce1a5835edad5177726 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:25.112830 10803 consensus_queue.cc:1048] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:25.132298 10803 raft_consensus.cc:2955] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:25.137830 6395 raft_consensus.cc:2955] T da507bc24d964ce1a5835edad5177726 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:25.146628 3568 catalog_manager.cc:5719] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 reported cstate change: config changed from index 5 to 6, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:25.154428 4105 tablet_service.cc:1558] Processing DeleteTablet for tablet da507bc24d964ce1a5835edad5177726 with delete_type TABLET_DATA_TOMBSTONED (TS 17b49c694faf479ea2e5083470fc0302 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:34952
I20260810 01:59:25.166420 6737 raft_consensus.cc:2955] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
W20260810 01:59:25.211618 4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.193:36797, user_credentials={real_user=slave}} blocked reactor thread for 100436us
I20260810 01:59:25.228636 11105 tablet_replica.cc:333] T da507bc24d964ce1a5835edad5177726 P 17b49c694faf479ea2e5083470fc0302: stopping tablet replica
I20260810 01:59:25.229439 11105 raft_consensus.cc:2243] T da507bc24d964ce1a5835edad5177726 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:59:25.236196 11105 raft_consensus.cc:2272] T da507bc24d964ce1a5835edad5177726 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:25.244573 3761 raft_consensus.cc:2955] T da507bc24d964ce1a5835edad5177726 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:25.253159 11105 ts_tablet_manager.cc:1916] T da507bc24d964ce1a5835edad5177726 P 17b49c694faf479ea2e5083470fc0302: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:59:25.291989 11105 ts_tablet_manager.cc:1929] T da507bc24d964ce1a5835edad5177726 P 17b49c694faf479ea2e5083470fc0302: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20260810 01:59:25.294422 11105 log.cc:1199] T da507bc24d964ce1a5835edad5177726 P 17b49c694faf479ea2e5083470fc0302: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/wal/wals/da507bc24d964ce1a5835edad5177726
I20260810 01:59:25.295869 3552 catalog_manager.cc:5050] TS 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189): tablet da507bc24d964ce1a5835edad5177726 (table rebalance_test_table_3 [id=c515c90b2c71492f812b4df18501ee04]) successfully deleted
I20260810 01:59:25.386463 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:59:25.411134 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:59:25.431860 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:25.438782 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:25.459409 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:25.505982 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:25.623286 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:25.630810 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:25.660923 6715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:25.663759 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:25.684088 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:25.702781 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:25.705962 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:25.747056 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:59:25.788427 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:25.792577 6715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:25.794903 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:25.832625 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:25.844987 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:25.851821 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:25.853242 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:25.854017 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:25.880725 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:25.884544 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:25.917695 6715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:25.933146 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:25.944837 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:26.046895 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:26.097755 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:59:26.107157 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:26.117604 6715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:26.124780 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:26.568215 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:59:26.574676 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:26.601046 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:26.658612 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:26.725641 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:26.767984 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:26.819656 6715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:26.849839 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:26.863586 4311 consensus_queue.cc:237] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:26.867280 4313 consensus_queue.cc:237] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:26.902107 6567 raft_consensus.cc:1275] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:26.903354 10280 consensus_queue.cc:1048] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:26.917079 6737 raft_consensus.cc:1275] T a586b7d625bb4c27a6343ae7918c8cea P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:26.919287 10280 consensus_queue.cc:1048] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:26.924160 4129 raft_consensus.cc:1275] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:26.925365 11360 consensus_queue.cc:1048] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:26.941596 4132 raft_consensus.cc:1275] T 5528e3ba51a640eaa614f141440bb90b P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:26.942914 10280 consensus_queue.cc:1048] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260810 01:59:26.959281 11363 log.cc:927] Time spent T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e: Append to log took a long time: real 0.059s user 0.000s sys 0.000s
I20260810 01:59:26.960467 10280 raft_consensus.cc:2955] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:26.977038 6737 raft_consensus.cc:2955] T a586b7d625bb4c27a6343ae7918c8cea P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:26.997295 4313 consensus_queue.cc:237] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:27.002954 3572 catalog_manager.cc:5719] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e reported cstate change: config changed from index 4 to 5, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:27.008424 11092 raft_consensus.cc:2955] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:27.033834 4129 raft_consensus.cc:2955] T 5528e3ba51a640eaa614f141440bb90b P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:27.040239 4132 raft_consensus.cc:2955] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:27.052826 6737 raft_consensus.cc:1275] T 1d377b919f4748c88efb249dfc964f17 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:27.053817 10280 consensus_queue.cc:1048] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:27.059334 6909 raft_consensus.cc:1275] T 1d377b919f4748c88efb249dfc964f17 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:27.061828 4131 raft_consensus.cc:1275] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:27.062062 10280 consensus_queue.cc:1048] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:27.062431 11092 consensus_queue.cc:1048] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260810 01:59:27.088016 4222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.198:45317, user_credentials={real_user=slave}} blocked reactor thread for 71322.4us
I20260810 01:59:27.093958 11360 raft_consensus.cc:2955] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:27.096841 6908 raft_consensus.cc:2955] T 1d377b919f4748c88efb249dfc964f17 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:27.100490 4131 raft_consensus.cc:2955] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:27.104001 6567 raft_consensus.cc:2955] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:27.115993 6737 raft_consensus.cc:2955] T 1d377b919f4748c88efb249dfc964f17 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:27.134044 3945 consensus_queue.cc:237] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:27.146360 3564 catalog_manager.cc:5719] T 1d377b919f4748c88efb249dfc964f17 P 3136daf7101445beadc1aa19bc01c227 reported cstate change: config changed from index 5 to 6, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:27.149025 3563 catalog_manager.cc:5719] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683 reported cstate change: config changed from index 4 to 5, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:27.155920 6908 raft_consensus.cc:1275] T 4a4350cf2ece4769b8547620ac5bedcb P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:27.157437 3756 raft_consensus.cc:1275] T 4a4350cf2ece4769b8547620ac5bedcb P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:27.158552 3735 tablet_service.cc:1558] Processing DeleteTablet for tablet a586b7d625bb4c27a6343ae7918c8cea with delete_type TABLET_DATA_TOMBSTONED (TS dc85be7d460a404f997177f57680850f not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:33870
I20260810 01:59:27.159816 11421 tablet_replica.cc:333] T a586b7d625bb4c27a6343ae7918c8cea P dc85be7d460a404f997177f57680850f: stopping tablet replica
I20260810 01:59:27.160356 11421 raft_consensus.cc:2243] T a586b7d625bb4c27a6343ae7918c8cea P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:59:27.160403 11104 consensus_queue.cc:1048] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:27.160682 11421 raft_consensus.cc:2272] T a586b7d625bb4c27a6343ae7918c8cea P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:27.160992 11104 consensus_queue.cc:1048] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:27.166483 11121 raft_consensus.cc:2955] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:27.168761 11421 ts_tablet_manager.cc:1916] T a586b7d625bb4c27a6343ae7918c8cea P dc85be7d460a404f997177f57680850f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:59:27.169380 3917 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d377b919f4748c88efb249dfc964f17 with delete_type TABLET_DATA_TOMBSTONED (TS 82f93d1d11364ceeb485585b4ae78871 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:51288
I20260810 01:59:27.170671 11435 tablet_replica.cc:333] T 1d377b919f4748c88efb249dfc964f17 P 82f93d1d11364ceeb485585b4ae78871: stopping tablet replica
I20260810 01:59:27.170523 6908 raft_consensus.cc:2955] T 4a4350cf2ece4769b8547620ac5bedcb P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:27.171322 11435 raft_consensus.cc:2243] T 1d377b919f4748c88efb249dfc964f17 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:59:27.173699 11435 raft_consensus.cc:2272] T 1d377b919f4748c88efb249dfc964f17 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:27.175211 11435 ts_tablet_manager.cc:1916] T 1d377b919f4748c88efb249dfc964f17 P 82f93d1d11364ceeb485585b4ae78871: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:59:27.180727 3917 tablet_service.cc:1558] Processing DeleteTablet for tablet 5528e3ba51a640eaa614f141440bb90b with delete_type TABLET_DATA_TOMBSTONED (TS 82f93d1d11364ceeb485585b4ae78871 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:51288
I20260810 01:59:27.184278 3756 raft_consensus.cc:2955] T 4a4350cf2ece4769b8547620ac5bedcb P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:27.200320 3562 catalog_manager.cc:5719] T 4a4350cf2ece4769b8547620ac5bedcb P dc85be7d460a404f997177f57680850f reported cstate change: config changed from index 4 to 5, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:27.210989 11435 ts_tablet_manager.cc:1929] T 1d377b919f4748c88efb249dfc964f17 P 82f93d1d11364ceeb485585b4ae78871: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20260810 01:59:27.213572 4286 tablet_service.cc:1558] Processing DeleteTablet for tablet 4a4350cf2ece4769b8547620ac5bedcb with delete_type TABLET_DATA_TOMBSTONED (TS ca4469fc2dbc48488bc7ad7f482f129e not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:40788
I20260810 01:59:27.215710 11421 ts_tablet_manager.cc:1929] T a586b7d625bb4c27a6343ae7918c8cea P dc85be7d460a404f997177f57680850f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.4
I20260810 01:59:27.215942 11421 log.cc:1199] T a586b7d625bb4c27a6343ae7918c8cea P dc85be7d460a404f997177f57680850f: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/wal/wals/a586b7d625bb4c27a6343ae7918c8cea
I20260810 01:59:27.217186 11435 log.cc:1199] T 1d377b919f4748c88efb249dfc964f17 P 82f93d1d11364ceeb485585b4ae78871: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal/wals/1d377b919f4748c88efb249dfc964f17
I20260810 01:59:27.218377 11435 tablet_replica.cc:333] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871: stopping tablet replica
I20260810 01:59:27.218969 11435 raft_consensus.cc:2243] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:59:27.219333 11435 raft_consensus.cc:2272] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:27.220649 3553 catalog_manager.cc:5050] TS 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): tablet 1d377b919f4748c88efb249dfc964f17 (table rebalance_test_table_5 [id=e211628d46b64734960dfd60d86708ce]) successfully deleted
I20260810 01:59:27.220872 11435 ts_tablet_manager.cc:1916] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:59:27.220928 3551 catalog_manager.cc:5050] TS dc85be7d460a404f997177f57680850f (127.21.64.193:36797): tablet a586b7d625bb4c27a6343ae7918c8cea (table rebalance_test_table_1 [id=945a223441a04ba2bf938b104bc91cf8]) successfully deleted
I20260810 01:59:27.228312 11445 tablet_replica.cc:333] T 4a4350cf2ece4769b8547620ac5bedcb P ca4469fc2dbc48488bc7ad7f482f129e: stopping tablet replica
I20260810 01:59:27.229102 11445 raft_consensus.cc:2243] T 4a4350cf2ece4769b8547620ac5bedcb P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:59:27.229586 11445 raft_consensus.cc:2272] T 4a4350cf2ece4769b8547620ac5bedcb P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:27.232436 11445 ts_tablet_manager.cc:1916] T 4a4350cf2ece4769b8547620ac5bedcb P ca4469fc2dbc48488bc7ad7f482f129e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:59:27.245841 11435 ts_tablet_manager.cc:1929] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.4
I20260810 01:59:27.249681 11435 log.cc:1199] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal/wals/5528e3ba51a640eaa614f141440bb90b
I20260810 01:59:27.251175 3553 catalog_manager.cc:5050] TS 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): tablet 5528e3ba51a640eaa614f141440bb90b (table rebalance_test_table_9 [id=372310cb713644ada1071e8eb628b0c9]) successfully deleted
I20260810 01:59:27.252851 11445 ts_tablet_manager.cc:1929] T 4a4350cf2ece4769b8547620ac5bedcb P ca4469fc2dbc48488bc7ad7f482f129e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.4
I20260810 01:59:27.271013 11445 log.cc:1199] T 4a4350cf2ece4769b8547620ac5bedcb P ca4469fc2dbc48488bc7ad7f482f129e: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal/wals/4a4350cf2ece4769b8547620ac5bedcb
I20260810 01:59:27.278079 3553 catalog_manager.cc:5050] TS ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): tablet 4a4350cf2ece4769b8547620ac5bedcb (table rebalance_test_table_8 [id=afa71147917d44a585bcbaa37497a2b1]) successfully deleted
I20260810 01:59:27.704367 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:59:27.764110 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:27.892782 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:27.911072 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:27.929697 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:27.935635 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:27.992718 6715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:28.004963 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:28.132323 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:59:28.214708 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:28.251832 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:59:28.301401 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:28.308750 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:28.333546 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:28.342298 6715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:28.371377 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:28.398342 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:28.420285 6715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:28.452883 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:28.470350 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:28.487948 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:28.508328 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:28.509516 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:28.514380 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:28.832882 4129 consensus_queue.cc:237] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:28.914824 6397 raft_consensus.cc:1275] T 4fc45932b9634d6d98d8a0204d4b121a P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:28.915113 3761 raft_consensus.cc:1275] T 4fc45932b9634d6d98d8a0204d4b121a P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:28.915704 6567 raft_consensus.cc:1275] T 4fc45932b9634d6d98d8a0204d4b121a P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:28.915962 11488 consensus_queue.cc:1048] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:28.916292 10832 consensus_queue.cc:1048] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:28.917030 10832 consensus_queue.cc:1048] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:28.946074 11488 raft_consensus.cc:2955] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:28.947938 6395 raft_consensus.cc:2955] T 4fc45932b9634d6d98d8a0204d4b121a P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:28.951000 6567 raft_consensus.cc:2955] T 4fc45932b9634d6d98d8a0204d4b121a P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:28.958926 3761 raft_consensus.cc:2955] T 4fc45932b9634d6d98d8a0204d4b121a P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:28.973115 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:28.975306 3573 catalog_manager.cc:5719] T 4fc45932b9634d6d98d8a0204d4b121a P dc85be7d460a404f997177f57680850f reported cstate change: config changed from index 5 to 6, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New cstate: current_term: 1 leader_uuid: "17b49c694faf479ea2e5083470fc0302" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:29.016827 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:59:29.018596 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:29.041165 4286 tablet_service.cc:1558] Processing DeleteTablet for tablet 4fc45932b9634d6d98d8a0204d4b121a with delete_type TABLET_DATA_TOMBSTONED (TS ca4469fc2dbc48488bc7ad7f482f129e not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:40788
I20260810 01:59:29.058493 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:29.077312 11809 tablet_replica.cc:333] T 4fc45932b9634d6d98d8a0204d4b121a P ca4469fc2dbc48488bc7ad7f482f129e: stopping tablet replica
I20260810 01:59:29.084316 11809 raft_consensus.cc:2243] T 4fc45932b9634d6d98d8a0204d4b121a P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:59:29.089078 11809 raft_consensus.cc:2272] T 4fc45932b9634d6d98d8a0204d4b121a P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:29.100976 11809 ts_tablet_manager.cc:1916] T 4fc45932b9634d6d98d8a0204d4b121a P ca4469fc2dbc48488bc7ad7f482f129e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:59:29.121228 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:29.127514 11809 ts_tablet_manager.cc:1929] T 4fc45932b9634d6d98d8a0204d4b121a P ca4469fc2dbc48488bc7ad7f482f129e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20260810 01:59:29.130342 11809 log.cc:1199] T 4fc45932b9634d6d98d8a0204d4b121a P ca4469fc2dbc48488bc7ad7f482f129e: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal/wals/4fc45932b9634d6d98d8a0204d4b121a
I20260810 01:59:29.132793 3553 catalog_manager.cc:5050] TS ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): tablet 4fc45932b9634d6d98d8a0204d4b121a (table rebalance_test_table_8 [id=afa71147917d44a585bcbaa37497a2b1]) successfully deleted
I20260810 01:59:29.139453 6715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:29.160148 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:29.216454 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:29.243877 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:29.269404 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:59:29.274003 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:29.286962 6715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:29.326030 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:29.337522 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:29.341502 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:29.398190 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260810 01:59:29.437505 3670 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.197:38787, user_credentials={real_user=slave}} blocked reactor thread for 45864.9us
I20260810 01:59:29.570817 4313 consensus_queue.cc:237] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:29.643321 6739 raft_consensus.cc:1275] T 1d377b919f4748c88efb249dfc964f17 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 01:59:29.645081 6908 raft_consensus.cc:1275] T 1d377b919f4748c88efb249dfc964f17 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 01:59:29.646051 11853 consensus_queue.cc:1048] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 01:59:29.646615 11853 consensus_queue.cc:1048] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 01:59:29.707093 11092 raft_consensus.cc:2955] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:29.711135 6907 raft_consensus.cc:2955] T 1d377b919f4748c88efb249dfc964f17 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:29.717428 3572 catalog_manager.cc:5719] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e reported cstate change: config changed from index 6 to 7, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:29.727409 6739 raft_consensus.cc:2955] T 1d377b919f4748c88efb249dfc964f17 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:29.739233 4105 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d377b919f4748c88efb249dfc964f17 with delete_type TABLET_DATA_TOMBSTONED (TS 17b49c694faf479ea2e5083470fc0302 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:34952
I20260810 01:59:29.776674 11908 tablet_replica.cc:333] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302: stopping tablet replica
I20260810 01:59:29.782402 11908 raft_consensus.cc:2243] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:59:29.782938 11908 raft_consensus.cc:2272] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:29.784580 11908 ts_tablet_manager.cc:1916] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:59:29.887549 11908 ts_tablet_manager.cc:1929] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20260810 01:59:29.911093 11908 log.cc:1199] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/wal/wals/1d377b919f4748c88efb249dfc964f17
I20260810 01:59:29.912482 3552 catalog_manager.cc:5050] TS 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189): tablet 1d377b919f4748c88efb249dfc964f17 (table rebalance_test_table_5 [id=e211628d46b64734960dfd60d86708ce]) successfully deleted
I20260810 01:59:29.953074 4313 consensus_queue.cc:237] T be4737d169be4419b5a0a0b656a3930f P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:29.967953 4129 raft_consensus.cc:1275] T be4737d169be4419b5a0a0b656a3930f P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:29.968329 6907 raft_consensus.cc:1275] T be4737d169be4419b5a0a0b656a3930f P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:29.968724 11092 consensus_queue.cc:1048] T be4737d169be4419b5a0a0b656a3930f P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:29.969033 11853 consensus_queue.cc:1048] T be4737d169be4419b5a0a0b656a3930f P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:29.977982 11092 raft_consensus.cc:2955] T be4737d169be4419b5a0a0b656a3930f P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:29.982447 6907 raft_consensus.cc:2955] T be4737d169be4419b5a0a0b656a3930f P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:29.996546 3563 catalog_manager.cc:5719] T be4737d169be4419b5a0a0b656a3930f P 3136daf7101445beadc1aa19bc01c227 reported cstate change: config changed from index 4 to 5, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:30.001709 3917 tablet_service.cc:1558] Processing DeleteTablet for tablet be4737d169be4419b5a0a0b656a3930f with delete_type TABLET_DATA_TOMBSTONED (TS 82f93d1d11364ceeb485585b4ae78871 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:51288
I20260810 01:59:30.022718 4131 raft_consensus.cc:2955] T be4737d169be4419b5a0a0b656a3930f P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:30.024825 11992 tablet_replica.cc:333] T be4737d169be4419b5a0a0b656a3930f P 82f93d1d11364ceeb485585b4ae78871: stopping tablet replica
I20260810 01:59:30.025069 11992 raft_consensus.cc:2243] T be4737d169be4419b5a0a0b656a3930f P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:59:30.025437 11992 raft_consensus.cc:2272] T be4737d169be4419b5a0a0b656a3930f P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:30.026319 11992 ts_tablet_manager.cc:1916] T be4737d169be4419b5a0a0b656a3930f P 82f93d1d11364ceeb485585b4ae78871: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:59:30.039361 11992 ts_tablet_manager.cc:1929] T be4737d169be4419b5a0a0b656a3930f P 82f93d1d11364ceeb485585b4ae78871: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.4
I20260810 01:59:30.039582 11992 log.cc:1199] T be4737d169be4419b5a0a0b656a3930f P 82f93d1d11364ceeb485585b4ae78871: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal/wals/be4737d169be4419b5a0a0b656a3930f
I20260810 01:59:30.040879 3553 catalog_manager.cc:5050] TS 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): tablet be4737d169be4419b5a0a0b656a3930f (table rebalance_test_table_0 [id=8fd8ee0beeb54ad9bee1c94775d09e8f]) successfully deleted
I20260810 01:59:30.108955 3756 consensus_queue.cc:237] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:30.122534 6567 raft_consensus.cc:1275] T 3a15b27dbdaf4092aea66c3670204fcc P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:30.123884 10950 consensus_queue.cc:1048] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:30.130901 6397 raft_consensus.cc:1275] T 3a15b27dbdaf4092aea66c3670204fcc P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:30.131477 4313 raft_consensus.cc:1275] T 3a15b27dbdaf4092aea66c3670204fcc P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:30.133013 11740 consensus_queue.cc:1048] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:30.133819 11740 consensus_queue.cc:1048] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:30.166306 4311 raft_consensus.cc:2955] T 3a15b27dbdaf4092aea66c3670204fcc P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:30.169651 10950 raft_consensus.cc:2955] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:30.181102 3572 catalog_manager.cc:5719] T 3a15b27dbdaf4092aea66c3670204fcc P ca4469fc2dbc48488bc7ad7f482f129e reported cstate change: config changed from index 5 to 6, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:30.181330 6397 raft_consensus.cc:2955] T 3a15b27dbdaf4092aea66c3670204fcc P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:30.191748 6567 raft_consensus.cc:2955] T 3a15b27dbdaf4092aea66c3670204fcc P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:30.205858 4105 tablet_service.cc:1558] Processing DeleteTablet for tablet 3a15b27dbdaf4092aea66c3670204fcc with delete_type TABLET_DATA_TOMBSTONED (TS 17b49c694faf479ea2e5083470fc0302 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:34952
I20260810 01:59:30.206606 11908 tablet_replica.cc:333] T 3a15b27dbdaf4092aea66c3670204fcc P 17b49c694faf479ea2e5083470fc0302: stopping tablet replica
I20260810 01:59:30.206946 11908 raft_consensus.cc:2243] T 3a15b27dbdaf4092aea66c3670204fcc P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:59:30.207440 11908 raft_consensus.cc:2272] T 3a15b27dbdaf4092aea66c3670204fcc P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:30.208498 11908 ts_tablet_manager.cc:1916] T 3a15b27dbdaf4092aea66c3670204fcc P 17b49c694faf479ea2e5083470fc0302: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:59:30.225162 11908 ts_tablet_manager.cc:1929] T 3a15b27dbdaf4092aea66c3670204fcc P 17b49c694faf479ea2e5083470fc0302: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20260810 01:59:30.225509 11908 log.cc:1199] T 3a15b27dbdaf4092aea66c3670204fcc P 17b49c694faf479ea2e5083470fc0302: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/wal/wals/3a15b27dbdaf4092aea66c3670204fcc
I20260810 01:59:30.227577 3552 catalog_manager.cc:5050] TS 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189): tablet 3a15b27dbdaf4092aea66c3670204fcc (table rebalance_test_table_1 [id=945a223441a04ba2bf938b104bc91cf8]) successfully deleted
I20260810 01:59:30.272827 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:59:30.354724 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:30.472180 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:30.492728 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:59:30.493574 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:30.527804 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:30.550411 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:30.601900 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:30.630481 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:30.655462 6715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:30.725488 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:59:30.742209 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:30.759445 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:30.790616 6715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:30.792848 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:30.801662 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:30.834700 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:30.863566 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:30.911731 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:30.912992 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:30.929644 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:30.935765 6715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:30.967789 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
W20260810 01:59:31.012408 4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.193:36797, user_credentials={real_user=slave}} blocked reactor thread for 89848.6us
I20260810 01:59:31.084873 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:31.536420 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:31.547566 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:31.592460 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:59:31.606621 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:31.615293 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:31.643725 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:31.668285 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:31.668288 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:31.671715 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:59:31.683053 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:31.710759 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:31.760625 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:31.800151 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:31.815146 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:31.948904 3761 consensus_queue.cc:237] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:31.953601 6715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:31.954454 6714 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:31.965695 3756 consensus_queue.cc:237] T 57f6f22d97c14ed98960e27ce2c8f3fb P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:31.976668 6397 raft_consensus.cc:1275] T 57f6f22d97c14ed98960e27ce2c8f3fb P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:31.977319 11740 consensus_queue.cc:1048] T 57f6f22d97c14ed98960e27ce2c8f3fb P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:31.978448 3945 raft_consensus.cc:1275] T 57f6f22d97c14ed98960e27ce2c8f3fb P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:31.980343 11740 consensus_queue.cc:1048] T 57f6f22d97c14ed98960e27ce2c8f3fb P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:31.992548 10950 raft_consensus.cc:2955] T 57f6f22d97c14ed98960e27ce2c8f3fb P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:31.993301 3945 raft_consensus.cc:2955] T 57f6f22d97c14ed98960e27ce2c8f3fb P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:31.999990 3564 catalog_manager.cc:5719] T 57f6f22d97c14ed98960e27ce2c8f3fb P 82f93d1d11364ceeb485585b4ae78871 reported cstate change: config changed from index 4 to 5, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:32.007658 6397 raft_consensus.cc:2955] T 57f6f22d97c14ed98960e27ce2c8f3fb P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:32.015516 4131 raft_consensus.cc:1275] T cf531b93380e43bfa103837bd6350834 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:32.016147 11740 consensus_queue.cc:1048] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:32.044903 11740 raft_consensus.cc:2955] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:32.052506 4131 raft_consensus.cc:2955] T cf531b93380e43bfa103837bd6350834 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:32.064016 3573 catalog_manager.cc:5719] T cf531b93380e43bfa103837bd6350834 P 17b49c694faf479ea2e5083470fc0302 reported cstate change: config changed from index 4 to 5, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
W20260810 01:59:32.065796 3672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.194:43893, user_credentials={real_user=slave}} blocked reactor thread for 68333.6us
I20260810 01:59:32.066941 6567 raft_consensus.cc:1275] T cf531b93380e43bfa103837bd6350834 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:32.074021 12358 consensus_queue.cc:1048] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:32.077917 6564 raft_consensus.cc:2955] T cf531b93380e43bfa103837bd6350834 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:32.121265 4105 tablet_service.cc:1558] Processing DeleteTablet for tablet 57f6f22d97c14ed98960e27ce2c8f3fb with delete_type TABLET_DATA_TOMBSTONED (TS 17b49c694faf479ea2e5083470fc0302 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:34952
I20260810 01:59:32.121666 4131 consensus_queue.cc:237] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:32.133447 4286 tablet_service.cc:1558] Processing DeleteTablet for tablet cf531b93380e43bfa103837bd6350834 with delete_type TABLET_DATA_TOMBSTONED (TS ca4469fc2dbc48488bc7ad7f482f129e not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:40788
I20260810 01:59:32.134222 6908 raft_consensus.cc:1275] T c53fc4008faf445fa05e436b9c8e0282 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:32.134882 11789 consensus_queue.cc:1048] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:32.155154 12396 tablet_replica.cc:333] T cf531b93380e43bfa103837bd6350834 P ca4469fc2dbc48488bc7ad7f482f129e: stopping tablet replica
I20260810 01:59:32.155552 12396 raft_consensus.cc:2243] T cf531b93380e43bfa103837bd6350834 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:59:32.156175 12396 raft_consensus.cc:2272] T cf531b93380e43bfa103837bd6350834 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:32.157047 12396 ts_tablet_manager.cc:1916] T cf531b93380e43bfa103837bd6350834 P ca4469fc2dbc48488bc7ad7f482f129e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:59:32.175042 3945 raft_consensus.cc:1275] T c53fc4008faf445fa05e436b9c8e0282 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:32.175635 6397 raft_consensus.cc:1275] T c53fc4008faf445fa05e436b9c8e0282 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:32.176596 11789 consensus_queue.cc:1048] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:32.177367 12396 ts_tablet_manager.cc:1929] T cf531b93380e43bfa103837bd6350834 P ca4469fc2dbc48488bc7ad7f482f129e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.4
I20260810 01:59:32.177551 12396 log.cc:1199] T cf531b93380e43bfa103837bd6350834 P ca4469fc2dbc48488bc7ad7f482f129e: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal/wals/cf531b93380e43bfa103837bd6350834
I20260810 01:59:32.185192 11789 consensus_queue.cc:1048] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:32.189085 3553 catalog_manager.cc:5050] TS ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): tablet cf531b93380e43bfa103837bd6350834 (table rebalance_test_table_3 [id=c515c90b2c71492f812b4df18501ee04]) successfully deleted
I20260810 01:59:32.189317 12391 tablet_replica.cc:333] T 57f6f22d97c14ed98960e27ce2c8f3fb P 17b49c694faf479ea2e5083470fc0302: stopping tablet replica
I20260810 01:59:32.189600 12391 raft_consensus.cc:2243] T 57f6f22d97c14ed98960e27ce2c8f3fb P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:59:32.189839 12391 raft_consensus.cc:2272] T 57f6f22d97c14ed98960e27ce2c8f3fb P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:32.190836 12391 ts_tablet_manager.cc:1916] T 57f6f22d97c14ed98960e27ce2c8f3fb P 17b49c694faf479ea2e5083470fc0302: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:59:32.192957 11789 raft_consensus.cc:2955] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:32.207841 6397 raft_consensus.cc:2955] T c53fc4008faf445fa05e436b9c8e0282 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:32.207991 6908 raft_consensus.cc:2955] T c53fc4008faf445fa05e436b9c8e0282 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:32.218547 3572 catalog_manager.cc:5719] T c53fc4008faf445fa05e436b9c8e0282 P 4dd4cba155c941b4b7ad4d64c7431536 reported cstate change: config changed from index 5 to 6, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New cstate: current_term: 1 leader_uuid: "17b49c694faf479ea2e5083470fc0302" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:32.220523 3943 raft_consensus.cc:2955] T c53fc4008faf445fa05e436b9c8e0282 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:32.231175 12391 ts_tablet_manager.cc:1929] T 57f6f22d97c14ed98960e27ce2c8f3fb P 17b49c694faf479ea2e5083470fc0302: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.4
I20260810 01:59:32.232009 12391 log.cc:1199] T 57f6f22d97c14ed98960e27ce2c8f3fb P 17b49c694faf479ea2e5083470fc0302: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/wal/wals/57f6f22d97c14ed98960e27ce2c8f3fb
I20260810 01:59:32.235128 3552 catalog_manager.cc:5050] TS 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189): tablet 57f6f22d97c14ed98960e27ce2c8f3fb (table rebalance_test_table_5 [id=e211628d46b64734960dfd60d86708ce]) successfully deleted
I20260810 01:59:32.236693 4286 tablet_service.cc:1558] Processing DeleteTablet for tablet c53fc4008faf445fa05e436b9c8e0282 with delete_type TABLET_DATA_TOMBSTONED (TS ca4469fc2dbc48488bc7ad7f482f129e not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:40788
I20260810 01:59:32.237059 12396 tablet_replica.cc:333] T c53fc4008faf445fa05e436b9c8e0282 P ca4469fc2dbc48488bc7ad7f482f129e: stopping tablet replica
I20260810 01:59:32.237277 12396 raft_consensus.cc:2243] T c53fc4008faf445fa05e436b9c8e0282 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:59:32.237540 12396 raft_consensus.cc:2272] T c53fc4008faf445fa05e436b9c8e0282 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:32.238369 12396 ts_tablet_manager.cc:1916] T c53fc4008faf445fa05e436b9c8e0282 P ca4469fc2dbc48488bc7ad7f482f129e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:59:32.245232 12396 ts_tablet_manager.cc:1929] T c53fc4008faf445fa05e436b9c8e0282 P ca4469fc2dbc48488bc7ad7f482f129e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20260810 01:59:32.245435 12396 log.cc:1199] T c53fc4008faf445fa05e436b9c8e0282 P ca4469fc2dbc48488bc7ad7f482f129e: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal/wals/c53fc4008faf445fa05e436b9c8e0282
I20260810 01:59:32.246310 3553 catalog_manager.cc:5050] TS ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): tablet c53fc4008faf445fa05e436b9c8e0282 (table rebalance_test_table_2 [id=5e8751d351ba4b7da7861e02b0c3c634]) successfully deleted
I20260810 01:59:32.473793 3945 consensus_queue.cc:237] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:32.476330 3761 consensus_queue.cc:237] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:32.487131 6394 raft_consensus.cc:1275] T fe8e1f0908234e46881258cfe79835f8 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 01:59:32.489475 11121 consensus_queue.cc:1048] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 01:59:32.493090 6739 raft_consensus.cc:1275] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:32.493515 4131 raft_consensus.cc:1275] T 389d3abfeadd4fe6a4efa74427d71c4d P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:32.493888 12358 consensus_queue.cc:1048] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:32.494189 12359 consensus_queue.cc:1048] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:32.500501 6737 raft_consensus.cc:1275] T fe8e1f0908234e46881258cfe79835f8 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 01:59:32.502473 11121 consensus_queue.cc:1048] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 01:59:32.513006 6908 raft_consensus.cc:1275] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 01:59:32.513865 11121 consensus_queue.cc:1048] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 01:59:32.518882 12358 raft_consensus.cc:2955] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:32.523478 4131 raft_consensus.cc:2955] T 389d3abfeadd4fe6a4efa74427d71c4d P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:32.531590 3572 catalog_manager.cc:5719] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f reported cstate change: config changed from index 4 to 5, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:32.536355 3761 raft_consensus.cc:1275] T fe8e1f0908234e46881258cfe79835f8 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 01:59:32.540884 12304 consensus_queue.cc:1048] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 01:59:32.544955 3917 tablet_service.cc:1558] Processing DeleteTablet for tablet 389d3abfeadd4fe6a4efa74427d71c4d with delete_type TABLET_DATA_TOMBSTONED (TS 82f93d1d11364ceeb485585b4ae78871 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:51288
I20260810 01:59:32.559105 12515 tablet_replica.cc:333] T 389d3abfeadd4fe6a4efa74427d71c4d P 82f93d1d11364ceeb485585b4ae78871: stopping tablet replica
I20260810 01:59:32.559372 12515 raft_consensus.cc:2243] T 389d3abfeadd4fe6a4efa74427d71c4d P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:59:32.560850 12515 raft_consensus.cc:2272] T 389d3abfeadd4fe6a4efa74427d71c4d P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:32.561905 12515 ts_tablet_manager.cc:1916] T 389d3abfeadd4fe6a4efa74427d71c4d P 82f93d1d11364ceeb485585b4ae78871: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260810 01:59:32.564498 12501 log.cc:927] Time spent T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871: Append to log took a long time: real 0.079s user 0.000s sys 0.000s
I20260810 01:59:32.568312 11121 raft_consensus.cc:2955] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:32.579946 6908 raft_consensus.cc:2955] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:32.580124 3761 raft_consensus.cc:2955] T fe8e1f0908234e46881258cfe79835f8 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:32.582594 3572 catalog_manager.cc:5719] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 reported cstate change: config changed from index 6 to 7, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:32.590488 4105 tablet_service.cc:1558] Processing DeleteTablet for tablet fe8e1f0908234e46881258cfe79835f8 with delete_type TABLET_DATA_TOMBSTONED (TS 17b49c694faf479ea2e5083470fc0302 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:34952
I20260810 01:59:32.590855 12391 tablet_replica.cc:333] T fe8e1f0908234e46881258cfe79835f8 P 17b49c694faf479ea2e5083470fc0302: stopping tablet replica
I20260810 01:59:32.591097 12391 raft_consensus.cc:2243] T fe8e1f0908234e46881258cfe79835f8 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:59:32.591516 12391 raft_consensus.cc:2272] T fe8e1f0908234e46881258cfe79835f8 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:32.592363 12391 ts_tablet_manager.cc:1916] T fe8e1f0908234e46881258cfe79835f8 P 17b49c694faf479ea2e5083470fc0302: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:59:32.607796 6394 raft_consensus.cc:2955] T fe8e1f0908234e46881258cfe79835f8 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:32.630002 12391 ts_tablet_manager.cc:1929] T fe8e1f0908234e46881258cfe79835f8 P 17b49c694faf479ea2e5083470fc0302: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20260810 01:59:32.630228 12391 log.cc:1199] T fe8e1f0908234e46881258cfe79835f8 P 17b49c694faf479ea2e5083470fc0302: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/wal/wals/fe8e1f0908234e46881258cfe79835f8
I20260810 01:59:32.631268 3552 catalog_manager.cc:5050] TS 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189): tablet fe8e1f0908234e46881258cfe79835f8 (table rebalance_test_table_4 [id=3e1f7b9b31614ed383207098de38230c]) successfully deleted
I20260810 01:59:32.641126 6737 raft_consensus.cc:2955] T fe8e1f0908234e46881258cfe79835f8 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:32.654071 6739 raft_consensus.cc:2955] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:32.655925 12515 ts_tablet_manager.cc:1929] T 389d3abfeadd4fe6a4efa74427d71c4d P 82f93d1d11364ceeb485585b4ae78871: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.4
I20260810 01:59:32.661070 12515 log.cc:1199] T 389d3abfeadd4fe6a4efa74427d71c4d P 82f93d1d11364ceeb485585b4ae78871: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal/wals/389d3abfeadd4fe6a4efa74427d71c4d
I20260810 01:59:32.662144 3553 catalog_manager.cc:5050] TS 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): tablet 389d3abfeadd4fe6a4efa74427d71c4d (table rebalance_test_table_9 [id=372310cb713644ada1071e8eb628b0c9]) successfully deleted
I20260810 01:59:33.177368 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:33.211134 6714 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:33.212163 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
W20260810 01:59:33.230499 3671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.195:39189, user_credentials={real_user=slave}} blocked reactor thread for 116323us
I20260810 01:59:33.239899 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:59:33.242718 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:33.268630 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:33.274091 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:33.275084 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:33.311777 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:59:33.319593 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:33.334339 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:33.363657 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:33.378890 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:33.405640 6714 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:33.406656 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:33.443676 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:33.451458 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:33.494591 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:33.526959 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:33.588492 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:33.619560 6714 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:33.631772 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:33.713765 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:33.808444 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
W20260810 01:59:33.835395 4038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.198:45317, user_credentials={real_user=slave}} blocked reactor thread for 44239.5us
W20260810 01:59:33.844265 4036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.197:38787, user_credentials={real_user=slave}} blocked reactor thread for 72144.9us
I20260810 01:59:33.884667 4105 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 01:59:33.909992 6884 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:33.914362 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:33.935201 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:33.946643 6714 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:33.951716 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:33.974800 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:33.994269 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:34.149217 4131 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d05e147199e44b8ca712e18d22e7cce7"
dest_uuid: "17b49c694faf479ea2e5083470fc0302"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:35454
I20260810 01:59:34.149602 4131 raft_consensus.cc:606] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302 [term 1 LEADER]: Received request to transfer leadership
I20260810 01:59:34.205519 12421 raft_consensus.cc:993] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302: : Instructing follower 3136daf7101445beadc1aa19bc01c227 to start an election
I20260810 01:59:34.205734 12740 raft_consensus.cc:1081] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302 [term 1 LEADER]: Signalling peer 3136daf7101445beadc1aa19bc01c227 to start an election
I20260810 01:59:34.208024 6908 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d05e147199e44b8ca712e18d22e7cce7"
dest_uuid: "3136daf7101445beadc1aa19bc01c227"
from {username='slave'} at 127.21.64.195:50491
I20260810 01:59:34.208420 6908 raft_consensus.cc:493] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260810 01:59:34.208693 6908 raft_consensus.cc:3060] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Advancing to term 2
I20260810 01:59:34.219873 6908 raft_consensus.cc:515] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:34.230209 6908 leader_election.cc:290] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227 [CANDIDATE]: Term 2 election: Requested vote from peers 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189), 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893), dc85be7d460a404f997177f57680850f (127.21.64.193:36797), 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197:38787)
I20260810 01:59:34.230453 4131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05e147199e44b8ca712e18d22e7cce7" candidate_uuid: "3136daf7101445beadc1aa19bc01c227" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: true dest_uuid: "17b49c694faf479ea2e5083470fc0302"
I20260810 01:59:34.230654 4131 raft_consensus.cc:3055] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302 [term 1 LEADER]: Stepping down as leader of term 1
I20260810 01:59:34.230726 4131 raft_consensus.cc:740] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 17b49c694faf479ea2e5083470fc0302, State: Running, Role: LEADER
I20260810 01:59:34.233158 3945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05e147199e44b8ca712e18d22e7cce7" candidate_uuid: "3136daf7101445beadc1aa19bc01c227" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: true dest_uuid: "82f93d1d11364ceeb485585b4ae78871"
I20260810 01:59:34.233399 3945 raft_consensus.cc:3060] T d05e147199e44b8ca712e18d22e7cce7 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Advancing to term 2
I20260810 01:59:34.236578 3945 raft_consensus.cc:2468] T d05e147199e44b8ca712e18d22e7cce7 P 82f93d1d11364ceeb485585b4ae78871 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3136daf7101445beadc1aa19bc01c227 in term 2.
I20260810 01:59:34.244575 4131 consensus_queue.cc:260] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:34.245270 4131 raft_consensus.cc:3060] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Advancing to term 2
I20260810 01:59:34.256675 4131 raft_consensus.cc:2468] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3136daf7101445beadc1aa19bc01c227 in term 2.
I20260810 01:59:34.259028 6825 leader_election.cc:304] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 17b49c694faf479ea2e5083470fc0302, 3136daf7101445beadc1aa19bc01c227, 82f93d1d11364ceeb485585b4ae78871; no voters:
I20260810 01:59:34.266409 6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05e147199e44b8ca712e18d22e7cce7" candidate_uuid: "3136daf7101445beadc1aa19bc01c227" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: true dest_uuid: "4dd4cba155c941b4b7ad4d64c7431536"
I20260810 01:59:34.266808 6397 raft_consensus.cc:3060] T d05e147199e44b8ca712e18d22e7cce7 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Advancing to term 2
I20260810 01:59:34.271647 6397 raft_consensus.cc:2468] T d05e147199e44b8ca712e18d22e7cce7 P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3136daf7101445beadc1aa19bc01c227 in term 2.
I20260810 01:59:34.294929 3756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05e147199e44b8ca712e18d22e7cce7" candidate_uuid: "3136daf7101445beadc1aa19bc01c227" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: true dest_uuid: "dc85be7d460a404f997177f57680850f"
I20260810 01:59:34.295184 3756 raft_consensus.cc:3060] T d05e147199e44b8ca712e18d22e7cce7 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Advancing to term 2
I20260810 01:59:34.309209 3756 raft_consensus.cc:2468] T d05e147199e44b8ca712e18d22e7cce7 P dc85be7d460a404f997177f57680850f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3136daf7101445beadc1aa19bc01c227 in term 2.
I20260810 01:59:34.310515 12842 raft_consensus.cc:2804] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 01:59:34.313396 12842 raft_consensus.cc:697] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227 [term 2 LEADER]: Becoming Leader. State: Replica: 3136daf7101445beadc1aa19bc01c227, State: Running, Role: LEADER
I20260810 01:59:34.314134 12842 consensus_queue.cc:237] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:34.326846 3563 catalog_manager.cc:5719] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227 reported cstate change: term changed from 1 to 2, leader changed from 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) to 3136daf7101445beadc1aa19bc01c227 (127.21.64.200). New cstate: current_term: 2 leader_uuid: "3136daf7101445beadc1aa19bc01c227" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:34.343912 4105 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:59:34.370877 3756 consensus_queue.cc:237] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:34.375140 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:34.391158 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:59:34.394646 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:34.450737 6564 raft_consensus.cc:1275] T df5b102a0b03406f9449cdd84dfd147e P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 01:59:34.451948 12358 consensus_queue.cc:1048] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 01:59:34.463030 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:34.483733 6739 raft_consensus.cc:1275] T df5b102a0b03406f9449cdd84dfd147e P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 01:59:34.483747 6397 raft_consensus.cc:1275] T df5b102a0b03406f9449cdd84dfd147e P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 01:59:34.484357 12358 consensus_queue.cc:1048] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 01:59:34.484859 12358 consensus_queue.cc:1048] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 01:59:34.488241 3945 raft_consensus.cc:1275] T df5b102a0b03406f9449cdd84dfd147e P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 01:59:34.488474 12358 raft_consensus.cc:2955] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:34.496519 6739 raft_consensus.cc:2955] T df5b102a0b03406f9449cdd84dfd147e P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:34.524312 12890 consensus_queue.cc:1048] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 01:59:34.534555 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:34.562767 6564 raft_consensus.cc:2955] T df5b102a0b03406f9449cdd84dfd147e P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:34.564410 3562 catalog_manager.cc:5719] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f reported cstate change: config changed from index 6 to 7, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:34.569370 4286 tablet_service.cc:1558] Processing DeleteTablet for tablet df5b102a0b03406f9449cdd84dfd147e with delete_type TABLET_DATA_TOMBSTONED (TS ca4469fc2dbc48488bc7ad7f482f129e not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:40788
W20260810 01:59:34.572472 3670 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.197:38787, user_credentials={real_user=slave}} blocked reactor thread for 71415.8us
I20260810 01:59:34.574945 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:34.576628 6397 raft_consensus.cc:2955] T df5b102a0b03406f9449cdd84dfd147e P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:34.582916 3945 raft_consensus.cc:2955] T df5b102a0b03406f9449cdd84dfd147e P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:34.617408 6714 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:34.644812 12931 tablet_replica.cc:333] T df5b102a0b03406f9449cdd84dfd147e P ca4469fc2dbc48488bc7ad7f482f129e: stopping tablet replica
I20260810 01:59:34.645177 12931 raft_consensus.cc:2243] T df5b102a0b03406f9449cdd84dfd147e P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:59:34.645630 12931 raft_consensus.cc:2272] T df5b102a0b03406f9449cdd84dfd147e P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:34.646517 12931 ts_tablet_manager.cc:1916] T df5b102a0b03406f9449cdd84dfd147e P ca4469fc2dbc48488bc7ad7f482f129e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:59:34.663009 4131 consensus_queue.cc:237] T f3d04e9457c944a8a72861680bdf9b7c P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:34.689226 12931 ts_tablet_manager.cc:1929] T df5b102a0b03406f9449cdd84dfd147e P ca4469fc2dbc48488bc7ad7f482f129e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20260810 01:59:34.689275 6739 raft_consensus.cc:1275] T f3d04e9457c944a8a72861680bdf9b7c P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:34.690093 6397 raft_consensus.cc:1275] T f3d04e9457c944a8a72861680bdf9b7c P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:34.690881 3756 raft_consensus.cc:1275] T f3d04e9457c944a8a72861680bdf9b7c P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:34.690917 12421 consensus_queue.cc:1048] T f3d04e9457c944a8a72861680bdf9b7c P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:34.691486 12421 consensus_queue.cc:1048] T f3d04e9457c944a8a72861680bdf9b7c P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:34.691811 12744 consensus_queue.cc:1048] T f3d04e9457c944a8a72861680bdf9b7c P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:34.693192 12931 log.cc:1199] T df5b102a0b03406f9449cdd84dfd147e P ca4469fc2dbc48488bc7ad7f482f129e: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal/wals/df5b102a0b03406f9449cdd84dfd147e
I20260810 01:59:34.694444 3553 catalog_manager.cc:5050] TS ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): tablet df5b102a0b03406f9449cdd84dfd147e (table rebalance_test_table_2 [id=5e8751d351ba4b7da7861e02b0c3c634]) successfully deleted
I20260810 01:59:34.722172 12740 raft_consensus.cc:2955] T f3d04e9457c944a8a72861680bdf9b7c P 17b49c694faf479ea2e5083470fc0302 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:34.724970 3761 raft_consensus.cc:2955] T f3d04e9457c944a8a72861680bdf9b7c P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:34.731282 3945 consensus_queue.cc:237] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:34.731442 6397 raft_consensus.cc:2955] T f3d04e9457c944a8a72861680bdf9b7c P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:34.740110 3562 catalog_manager.cc:5719] T f3d04e9457c944a8a72861680bdf9b7c P 4dd4cba155c941b4b7ad4d64c7431536 reported cstate change: config changed from index 5 to 6, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New cstate: current_term: 1 leader_uuid: "17b49c694faf479ea2e5083470fc0302" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:34.744419 6397 raft_consensus.cc:1275] T d05e147199e44b8ca712e18d22e7cce7 P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 FOLLOWER]: Refusing update from remote peer 3136daf7101445beadc1aa19bc01c227: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 2 index: 6. (index mismatch)
I20260810 01:59:34.749871 6737 raft_consensus.cc:2955] T f3d04e9457c944a8a72861680bdf9b7c P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:34.751011 12842 consensus_queue.cc:1048] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:34.756495 4286 tablet_service.cc:1558] Processing DeleteTablet for tablet f3d04e9457c944a8a72861680bdf9b7c with delete_type TABLET_DATA_TOMBSTONED (TS ca4469fc2dbc48488bc7ad7f482f129e not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:40788
I20260810 01:59:34.756909 12931 tablet_replica.cc:333] T f3d04e9457c944a8a72861680bdf9b7c P ca4469fc2dbc48488bc7ad7f482f129e: stopping tablet replica
I20260810 01:59:34.757133 12931 raft_consensus.cc:2243] T f3d04e9457c944a8a72861680bdf9b7c P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:59:34.758193 12931 raft_consensus.cc:2272] T f3d04e9457c944a8a72861680bdf9b7c P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:34.759193 12931 ts_tablet_manager.cc:1916] T f3d04e9457c944a8a72861680bdf9b7c P ca4469fc2dbc48488bc7ad7f482f129e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:59:34.761932 6739 raft_consensus.cc:1275] T 18a93b1a1ce1440b99bdd7a3bcf49064 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:34.761932 6909 raft_consensus.cc:1275] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:34.763015 11121 consensus_queue.cc:1048] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:34.763672 11121 consensus_queue.cc:1048] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:34.780476 4131 raft_consensus.cc:1275] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302 [term 2 FOLLOWER]: Refusing update from remote peer 3136daf7101445beadc1aa19bc01c227: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 2 index: 6. (index mismatch)
I20260810 01:59:34.780238 11121 raft_consensus.cc:2955] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:34.781733 12842 consensus_queue.cc:1048] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:34.785025 6737 raft_consensus.cc:2955] T 18a93b1a1ce1440b99bdd7a3bcf49064 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:34.798043 3756 raft_consensus.cc:1275] T d05e147199e44b8ca712e18d22e7cce7 P dc85be7d460a404f997177f57680850f [term 2 FOLLOWER]: Refusing update from remote peer 3136daf7101445beadc1aa19bc01c227: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 2 index: 6. (index mismatch)
I20260810 01:59:34.799569 12854 consensus_queue.cc:1048] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:34.801088 3943 raft_consensus.cc:1275] T d05e147199e44b8ca712e18d22e7cce7 P 82f93d1d11364ceeb485585b4ae78871 [term 2 FOLLOWER]: Refusing update from remote peer 3136daf7101445beadc1aa19bc01c227: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 2 index: 6. (index mismatch)
I20260810 01:59:34.803081 12854 consensus_queue.cc:1048] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:34.819386 3562 catalog_manager.cc:5719] T 18a93b1a1ce1440b99bdd7a3bcf49064 P c5ed5317da9c464b93f979c405f0f6e4 reported cstate change: config changed from index 5 to 6, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:34.824985 4286 tablet_service.cc:1558] Processing DeleteTablet for tablet 18a93b1a1ce1440b99bdd7a3bcf49064 with delete_type TABLET_DATA_TOMBSTONED (TS ca4469fc2dbc48488bc7ad7f482f129e not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:40788
I20260810 01:59:34.877813 12931 ts_tablet_manager.cc:1929] T f3d04e9457c944a8a72861680bdf9b7c P ca4469fc2dbc48488bc7ad7f482f129e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20260810 01:59:34.878096 12931 log.cc:1199] T f3d04e9457c944a8a72861680bdf9b7c P ca4469fc2dbc48488bc7ad7f482f129e: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal/wals/f3d04e9457c944a8a72861680bdf9b7c
I20260810 01:59:34.879130 12931 tablet_replica.cc:333] T 18a93b1a1ce1440b99bdd7a3bcf49064 P ca4469fc2dbc48488bc7ad7f482f129e: stopping tablet replica
I20260810 01:59:34.879276 3553 catalog_manager.cc:5050] TS ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): tablet f3d04e9457c944a8a72861680bdf9b7c (table rebalance_test_table_7 [id=b572363d270a4bfda571d46e96d0bfda]) successfully deleted
I20260810 01:59:34.879451 12931 raft_consensus.cc:2243] T 18a93b1a1ce1440b99bdd7a3bcf49064 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:59:34.879769 12931 raft_consensus.cc:2272] T 18a93b1a1ce1440b99bdd7a3bcf49064 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:34.881034 12931 ts_tablet_manager.cc:1916] T 18a93b1a1ce1440b99bdd7a3bcf49064 P ca4469fc2dbc48488bc7ad7f482f129e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:59:34.967568 4131 raft_consensus.cc:1275] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:34.967888 6909 raft_consensus.cc:2955] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:34.971513 13004 consensus_queue.cc:1048] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:34.978300 4131 raft_consensus.cc:2955] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:35.004492 12931 ts_tablet_manager.cc:1929] T 18a93b1a1ce1440b99bdd7a3bcf49064 P ca4469fc2dbc48488bc7ad7f482f129e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20260810 01:59:35.004664 12931 log.cc:1199] T 18a93b1a1ce1440b99bdd7a3bcf49064 P ca4469fc2dbc48488bc7ad7f482f129e: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal/wals/18a93b1a1ce1440b99bdd7a3bcf49064
I20260810 01:59:35.005844 3553 catalog_manager.cc:5050] TS ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): tablet 18a93b1a1ce1440b99bdd7a3bcf49064 (table rebalance_test_table_5 [id=e211628d46b64734960dfd60d86708ce]) successfully deleted
I20260810 01:59:35.151997 4105 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:59:35.233618 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:35.251665 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:35.275836 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:35.296092 4131 consensus_queue.cc:237] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:35.303387 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:59:35.316884 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:35.324499 6909 raft_consensus.cc:1275] T e70193bd4055469d870a76542eaef524 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:35.324928 6564 raft_consensus.cc:1275] T e70193bd4055469d870a76542eaef524 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:35.325649 12740 consensus_queue.cc:1048] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:35.328827 12740 consensus_queue.cc:1048] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:35.346856 3943 raft_consensus.cc:1275] T e70193bd4055469d870a76542eaef524 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:35.347635 12740 consensus_queue.cc:1048] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:35.454265 6714 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:35.465144 13174 raft_consensus.cc:2955] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:35.487383 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:35.506835 6909 raft_consensus.cc:2955] T e70193bd4055469d870a76542eaef524 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:35.512763 3943 raft_consensus.cc:2955] T e70193bd4055469d870a76542eaef524 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:35.519765 3563 catalog_manager.cc:5719] T e70193bd4055469d870a76542eaef524 P 3136daf7101445beadc1aa19bc01c227 reported cstate change: config changed from index 5 to 6, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New cstate: current_term: 1 leader_uuid: "17b49c694faf479ea2e5083470fc0302" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:35.565572 6564 raft_consensus.cc:2955] T e70193bd4055469d870a76542eaef524 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:35.625667 4105 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:59:35.643335 4286 tablet_service.cc:1558] Processing DeleteTablet for tablet e70193bd4055469d870a76542eaef524 with delete_type TABLET_DATA_TOMBSTONED (TS ca4469fc2dbc48488bc7ad7f482f129e not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:40788
I20260810 01:59:35.644258 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:35.657420 13213 tablet_replica.cc:333] T e70193bd4055469d870a76542eaef524 P ca4469fc2dbc48488bc7ad7f482f129e: stopping tablet replica
I20260810 01:59:35.659248 13213 raft_consensus.cc:2243] T e70193bd4055469d870a76542eaef524 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:59:35.660732 13213 raft_consensus.cc:2272] T e70193bd4055469d870a76542eaef524 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:35.661741 13213 ts_tablet_manager.cc:1916] T e70193bd4055469d870a76542eaef524 P ca4469fc2dbc48488bc7ad7f482f129e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:59:35.667711 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:59:35.679812 13213 ts_tablet_manager.cc:1929] T e70193bd4055469d870a76542eaef524 P ca4469fc2dbc48488bc7ad7f482f129e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20260810 01:59:35.685200 13213 log.cc:1199] T e70193bd4055469d870a76542eaef524 P ca4469fc2dbc48488bc7ad7f482f129e: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal/wals/e70193bd4055469d870a76542eaef524
I20260810 01:59:35.688150 3553 catalog_manager.cc:5050] TS ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): tablet e70193bd4055469d870a76542eaef524 (table rebalance_test_table_7 [id=b572363d270a4bfda571d46e96d0bfda]) successfully deleted
I20260810 01:59:35.711663 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:35.745014 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:35.760128 6714 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:35.780365 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:35.781338 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:35.851953 4105 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:59:35.881053 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:35.982641 4105 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:59:35.997890 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:59:36.025959 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:36.028985 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:36.087680 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:59:36.114216 6714 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:36.118467 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:36.129220 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:36.144357 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:36.234817 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:36.238113 6714 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:36.277944 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:36.284945 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:36.331000 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:36.651851 6909 consensus_queue.cc:237] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 2.6, Last appended by leader: 5, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:36.668958 3761 raft_consensus.cc:1275] T d05e147199e44b8ca712e18d22e7cce7 P dc85be7d460a404f997177f57680850f [term 2 FOLLOWER]: Refusing update from remote peer 3136daf7101445beadc1aa19bc01c227: Log matching property violated. Preceding OpId in replica: term: 2 index: 6. Preceding OpId from leader: term: 2 index: 7. (index mismatch)
I20260810 01:59:36.670181 6397 raft_consensus.cc:1275] T d05e147199e44b8ca712e18d22e7cce7 P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 FOLLOWER]: Refusing update from remote peer 3136daf7101445beadc1aa19bc01c227: Log matching property violated. Preceding OpId in replica: term: 2 index: 6. Preceding OpId from leader: term: 2 index: 7. (index mismatch)
I20260810 01:59:36.671193 3943 raft_consensus.cc:1275] T d05e147199e44b8ca712e18d22e7cce7 P 82f93d1d11364ceeb485585b4ae78871 [term 2 FOLLOWER]: Refusing update from remote peer 3136daf7101445beadc1aa19bc01c227: Log matching property violated. Preceding OpId in replica: term: 2 index: 6. Preceding OpId from leader: term: 2 index: 7. (index mismatch)
I20260810 01:59:36.673256 12842 consensus_queue.cc:1048] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 01:59:36.676577 13351 consensus_queue.cc:1048] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 01:59:36.680171 12842 consensus_queue.cc:1048] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260810 01:59:36.699388 3945 consensus_queue.cc:237] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:36.700269 12842 raft_consensus.cc:2955] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227 [term 2 LEADER]: Committing config change with OpId 2.7: config changed from index 5 to 7, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:36.701511 6397 raft_consensus.cc:2955] T d05e147199e44b8ca712e18d22e7cce7 P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 FOLLOWER]: Committing config change with OpId 2.7: config changed from index 5 to 7, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:36.722471 3563 catalog_manager.cc:5719] T d05e147199e44b8ca712e18d22e7cce7 P 4dd4cba155c941b4b7ad4d64c7431536 reported cstate change: config changed from index 5 to 7, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New cstate: current_term: 2 leader_uuid: "3136daf7101445beadc1aa19bc01c227" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
W20260810 01:59:36.759953 6826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.194:43893, user_credentials={real_user=slave}} blocked reactor thread for 50261.4us
I20260810 01:59:36.762146 3943 raft_consensus.cc:2955] T d05e147199e44b8ca712e18d22e7cce7 P 82f93d1d11364ceeb485585b4ae78871 [term 2 FOLLOWER]: Committing config change with OpId 2.7: config changed from index 5 to 7, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:36.765652 6564 raft_consensus.cc:1275] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:36.768097 4313 raft_consensus.cc:1275] T b6c5892f4de449fb8cb7f4cff7eb2e20 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:36.769582 4105 tablet_service.cc:1558] Processing DeleteTablet for tablet d05e147199e44b8ca712e18d22e7cce7 with delete_type TABLET_DATA_TOMBSTONED (TS 17b49c694faf479ea2e5083470fc0302 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:34952
I20260810 01:59:36.770237 12985 consensus_queue.cc:1048] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:36.773617 3761 raft_consensus.cc:2955] T d05e147199e44b8ca712e18d22e7cce7 P dc85be7d460a404f997177f57680850f [term 2 FOLLOWER]: Committing config change with OpId 2.7: config changed from index 5 to 7, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:36.796100 13218 consensus_queue.cc:1048] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:36.814358 13376 tablet_replica.cc:333] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302: stopping tablet replica
I20260810 01:59:36.814671 13376 raft_consensus.cc:2243] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260810 01:59:36.814949 13376 raft_consensus.cc:2272] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:36.815959 13376 ts_tablet_manager.cc:1916] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:59:36.817119 6397 raft_consensus.cc:1275] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:36.818032 13218 consensus_queue.cc:1048] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:36.835691 13218 raft_consensus.cc:2955] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:36.838862 13376 ts_tablet_manager.cc:1929] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.6
I20260810 01:59:36.839147 13376 log.cc:1199] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/wal/wals/d05e147199e44b8ca712e18d22e7cce7
I20260810 01:59:36.840083 3552 catalog_manager.cc:5050] TS 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189): tablet d05e147199e44b8ca712e18d22e7cce7 (table rebalance_test_table_7 [id=b572363d270a4bfda571d46e96d0bfda]) successfully deleted
I20260810 01:59:36.841214 4313 raft_consensus.cc:2955] T b6c5892f4de449fb8cb7f4cff7eb2e20 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:36.843838 6564 raft_consensus.cc:2955] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:36.853699 3569 catalog_manager.cc:5719] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 reported cstate change: config changed from index 5 to 6, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:36.861222 3735 tablet_service.cc:1558] Processing DeleteTablet for tablet b6c5892f4de449fb8cb7f4cff7eb2e20 with delete_type TABLET_DATA_TOMBSTONED (TS dc85be7d460a404f997177f57680850f not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:33870
I20260810 01:59:36.864355 13407 tablet_replica.cc:333] T b6c5892f4de449fb8cb7f4cff7eb2e20 P dc85be7d460a404f997177f57680850f: stopping tablet replica
I20260810 01:59:36.868290 13407 raft_consensus.cc:2243] T b6c5892f4de449fb8cb7f4cff7eb2e20 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:59:36.868873 13407 raft_consensus.cc:2272] T b6c5892f4de449fb8cb7f4cff7eb2e20 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:36.871867 13407 ts_tablet_manager.cc:1916] T b6c5892f4de449fb8cb7f4cff7eb2e20 P dc85be7d460a404f997177f57680850f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:59:36.876677 6397 raft_consensus.cc:2955] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:36.900110 13407 ts_tablet_manager.cc:1929] T b6c5892f4de449fb8cb7f4cff7eb2e20 P dc85be7d460a404f997177f57680850f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20260810 01:59:36.901388 13407 log.cc:1199] T b6c5892f4de449fb8cb7f4cff7eb2e20 P dc85be7d460a404f997177f57680850f: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/wal/wals/b6c5892f4de449fb8cb7f4cff7eb2e20
I20260810 01:59:36.903515 3551 catalog_manager.cc:5050] TS dc85be7d460a404f997177f57680850f (127.21.64.193:36797): tablet b6c5892f4de449fb8cb7f4cff7eb2e20 (table rebalance_test_table_4 [id=3e1f7b9b31614ed383207098de38230c]) successfully deleted
I20260810 01:59:36.958393 4313 consensus_queue.cc:237] T 606ad043ee3344c39c9eef7cd1920d7e P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:36.972537 6909 raft_consensus.cc:1275] T 606ad043ee3344c39c9eef7cd1920d7e P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:36.973694 13009 consensus_queue.cc:1048] T 606ad043ee3344c39c9eef7cd1920d7e P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:36.981702 4131 raft_consensus.cc:1275] T 606ad043ee3344c39c9eef7cd1920d7e P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:36.984090 13009 consensus_queue.cc:1048] T 606ad043ee3344c39c9eef7cd1920d7e P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:37.053174 13169 raft_consensus.cc:2955] T 606ad043ee3344c39c9eef7cd1920d7e P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:37.060786 4132 raft_consensus.cc:2955] T 606ad043ee3344c39c9eef7cd1920d7e P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:37.068357 3569 catalog_manager.cc:5719] T 606ad043ee3344c39c9eef7cd1920d7e P ca4469fc2dbc48488bc7ad7f482f129e reported cstate change: config changed from index 4 to 5, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:37.073457 3735 tablet_service.cc:1558] Processing DeleteTablet for tablet 606ad043ee3344c39c9eef7cd1920d7e with delete_type TABLET_DATA_TOMBSTONED (TS dc85be7d460a404f997177f57680850f not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:33870
I20260810 01:59:37.073877 13407 tablet_replica.cc:333] T 606ad043ee3344c39c9eef7cd1920d7e P dc85be7d460a404f997177f57680850f: stopping tablet replica
I20260810 01:59:37.074106 13407 raft_consensus.cc:2243] T 606ad043ee3344c39c9eef7cd1920d7e P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:59:37.074561 13407 raft_consensus.cc:2272] T 606ad043ee3344c39c9eef7cd1920d7e P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:37.075333 13407 ts_tablet_manager.cc:1916] T 606ad043ee3344c39c9eef7cd1920d7e P dc85be7d460a404f997177f57680850f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:59:37.099980 4132 consensus_queue.cc:237] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:37.106335 13407 ts_tablet_manager.cc:1929] T 606ad043ee3344c39c9eef7cd1920d7e P dc85be7d460a404f997177f57680850f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.4
I20260810 01:59:37.107095 13407 log.cc:1199] T 606ad043ee3344c39c9eef7cd1920d7e P dc85be7d460a404f997177f57680850f: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/wal/wals/606ad043ee3344c39c9eef7cd1920d7e
I20260810 01:59:37.108390 3551 catalog_manager.cc:5050] TS dc85be7d460a404f997177f57680850f (127.21.64.193:36797): tablet 606ad043ee3344c39c9eef7cd1920d7e (table rebalance_test_table_4 [id=3e1f7b9b31614ed383207098de38230c]) successfully deleted
I20260810 01:59:37.126516 6909 raft_consensus.cc:2955] T 606ad043ee3344c39c9eef7cd1920d7e P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:37.139799 6397 raft_consensus.cc:1275] T 4fc45932b9634d6d98d8a0204d4b121a P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 01:59:37.139992 6564 raft_consensus.cc:1275] T 4fc45932b9634d6d98d8a0204d4b121a P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 01:59:37.140810 13178 consensus_queue.cc:1048] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 01:59:37.141402 13178 consensus_queue.cc:1048] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 01:59:37.150110 4105 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:59:37.172387 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:59:37.190407 6397 raft_consensus.cc:2955] T 4fc45932b9634d6d98d8a0204d4b121a P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:37.201416 3569 catalog_manager.cc:5719] T 4fc45932b9634d6d98d8a0204d4b121a P 4dd4cba155c941b4b7ad4d64c7431536 reported cstate change: config changed from index 6 to 7, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New cstate: current_term: 1 leader_uuid: "17b49c694faf479ea2e5083470fc0302" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:37.211158 3735 tablet_service.cc:1558] Processing DeleteTablet for tablet 4fc45932b9634d6d98d8a0204d4b121a with delete_type TABLET_DATA_TOMBSTONED (TS dc85be7d460a404f997177f57680850f not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:33870
I20260810 01:59:37.211572 13407 tablet_replica.cc:333] T 4fc45932b9634d6d98d8a0204d4b121a P dc85be7d460a404f997177f57680850f: stopping tablet replica
I20260810 01:59:37.211817 13407 raft_consensus.cc:2243] T 4fc45932b9634d6d98d8a0204d4b121a P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:59:37.212100 13407 raft_consensus.cc:2272] T 4fc45932b9634d6d98d8a0204d4b121a P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:37.213161 13407 ts_tablet_manager.cc:1916] T 4fc45932b9634d6d98d8a0204d4b121a P dc85be7d460a404f997177f57680850f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:59:37.217625 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:37.222738 13407 ts_tablet_manager.cc:1929] T 4fc45932b9634d6d98d8a0204d4b121a P dc85be7d460a404f997177f57680850f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20260810 01:59:37.222889 13407 log.cc:1199] T 4fc45932b9634d6d98d8a0204d4b121a P dc85be7d460a404f997177f57680850f: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/wal/wals/4fc45932b9634d6d98d8a0204d4b121a
I20260810 01:59:37.223729 3551 catalog_manager.cc:5050] TS dc85be7d460a404f997177f57680850f (127.21.64.193:36797): tablet 4fc45932b9634d6d98d8a0204d4b121a (table rebalance_test_table_8 [id=afa71147917d44a585bcbaa37497a2b1]) successfully deleted
I20260810 01:59:37.221429 13503 raft_consensus.cc:2955] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:37.236928 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:37.251616 6714 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:37.268424 6564 raft_consensus.cc:2955] T 4fc45932b9634d6d98d8a0204d4b121a P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:37.269668 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:37.296663 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:37.386466 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:37.888397 4105 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:59:37.901430 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:37.974116 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:59:37.985249 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:38.015722 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:38.061019 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:38.086050 4105 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:59:38.098680 6714 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:38.105129 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:59:38.111093 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:38.126677 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:38.172289 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:38.224562 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:38.247900 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:38.264151 3943 consensus_queue.cc:237] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:38.284502 6909 raft_consensus.cc:1275] T 2e72e04459b140cc9e20ad633b1ab5c4 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:38.285599 13218 consensus_queue.cc:1048] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:38.291997 4132 raft_consensus.cc:1275] T 2e72e04459b140cc9e20ad633b1ab5c4 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:38.293455 13218 consensus_queue.cc:1048] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:38.306298 6714 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:38.327780 13218 raft_consensus.cc:2955] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:38.333092 4131 raft_consensus.cc:2955] T 2e72e04459b140cc9e20ad633b1ab5c4 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:38.342836 3563 catalog_manager.cc:5719] T 2e72e04459b140cc9e20ad633b1ab5c4 P 17b49c694faf479ea2e5083470fc0302 reported cstate change: config changed from index 4 to 5, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:38.356081 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:38.419785 6909 raft_consensus.cc:2955] T 2e72e04459b140cc9e20ad633b1ab5c4 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:38.466053 4105 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:59:38.501443 3735 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e72e04459b140cc9e20ad633b1ab5c4 with delete_type TABLET_DATA_TOMBSTONED (TS dc85be7d460a404f997177f57680850f not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:33870
I20260810 01:59:38.514916 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:38.577564 13732 tablet_replica.cc:333] T 2e72e04459b140cc9e20ad633b1ab5c4 P dc85be7d460a404f997177f57680850f: stopping tablet replica
I20260810 01:59:38.578023 13732 raft_consensus.cc:2243] T 2e72e04459b140cc9e20ad633b1ab5c4 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:59:38.578580 13732 raft_consensus.cc:2272] T 2e72e04459b140cc9e20ad633b1ab5c4 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:38.579605 13732 ts_tablet_manager.cc:1916] T 2e72e04459b140cc9e20ad633b1ab5c4 P dc85be7d460a404f997177f57680850f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:59:38.597002 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:38.616379 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:59:38.673056 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:38.696038 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:38.714984 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:38.716029 6714 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:38.761372 13732 ts_tablet_manager.cc:1929] T 2e72e04459b140cc9e20ad633b1ab5c4 P dc85be7d460a404f997177f57680850f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.4
I20260810 01:59:38.761652 13732 log.cc:1199] T 2e72e04459b140cc9e20ad633b1ab5c4 P dc85be7d460a404f997177f57680850f: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/wal/wals/2e72e04459b140cc9e20ad633b1ab5c4
I20260810 01:59:38.762712 3551 catalog_manager.cc:5050] TS dc85be7d460a404f997177f57680850f (127.21.64.193:36797): tablet 2e72e04459b140cc9e20ad633b1ab5c4 (table rebalance_test_table_1 [id=945a223441a04ba2bf938b104bc91cf8]) successfully deleted
I20260810 01:59:38.970338 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:39.210224 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:39.219672 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:59:39.258764 4105 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:59:39.266491 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:39.304350 6714 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:39.355286 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:39.384084 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:39.546885 3945 consensus_queue.cc:237] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
W20260810 01:59:39.551683 6824 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.193:36797, user_credentials={real_user=slave}} blocked reactor thread for 68410.7us
I20260810 01:59:39.566118 6737 raft_consensus.cc:1275] T fe8e1f0908234e46881258cfe79835f8 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260810 01:59:39.566277 6394 raft_consensus.cc:1275] T fe8e1f0908234e46881258cfe79835f8 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260810 01:59:39.567708 13708 consensus_queue.cc:1048] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 01:59:39.567811 6907 raft_consensus.cc:1275] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260810 01:59:39.568363 13709 consensus_queue.cc:1048] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 01:59:39.569118 13868 consensus_queue.cc:1048] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 01:59:39.595919 3945 consensus_queue.cc:237] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:39.598093 13709 raft_consensus.cc:2955] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:39.621918 3564 catalog_manager.cc:5719] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 reported cstate change: config changed from index 7 to 8, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:39.627177 4132 consensus_queue.cc:237] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:39.632493 6564 raft_consensus.cc:1275] T f7a36f7ebd5d4342a259b093e45d4c32 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 01:59:39.637216 13868 consensus_queue.cc:1048] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 01:59:39.638677 4313 raft_consensus.cc:1275] T f7a36f7ebd5d4342a259b093e45d4c32 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 01:59:39.641475 13888 consensus_queue.cc:1048] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 01:59:39.644454 6737 raft_consensus.cc:2955] T fe8e1f0908234e46881258cfe79835f8 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:39.646301 6394 raft_consensus.cc:1275] T c53fc4008faf445fa05e436b9c8e0282 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 01:59:39.647287 13806 consensus_queue.cc:1048] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 01:59:39.654949 6907 raft_consensus.cc:1275] T c53fc4008faf445fa05e436b9c8e0282 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 01:59:39.656658 13806 consensus_queue.cc:1048] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 01:59:39.659511 13806 raft_consensus.cc:2955] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:39.666716 6397 raft_consensus.cc:2955] T c53fc4008faf445fa05e436b9c8e0282 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
W20260810 01:59:39.672940 3855 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.197:38787, user_credentials={real_user=slave}} blocked reactor thread for 62949.5us
I20260810 01:59:39.677191 3562 catalog_manager.cc:5719] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 reported cstate change: config changed from index 6 to 7, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New cstate: current_term: 1 leader_uuid: "17b49c694faf479ea2e5083470fc0302" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:39.680006 6908 raft_consensus.cc:1275] T f7a36f7ebd5d4342a259b093e45d4c32 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 01:59:39.679764 6907 raft_consensus.cc:2955] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:39.683115 6395 raft_consensus.cc:2955] T fe8e1f0908234e46881258cfe79835f8 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:39.684854 6394 raft_consensus.cc:1275] T f7a36f7ebd5d4342a259b093e45d4c32 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 01:59:39.691372 13708 consensus_queue.cc:1048] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 01:59:39.695595 13708 consensus_queue.cc:1048] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 01:59:39.721887 13708 raft_consensus.cc:2955] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:39.732275 6564 raft_consensus.cc:2955] T f7a36f7ebd5d4342a259b093e45d4c32 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:39.739580 6909 raft_consensus.cc:2955] T c53fc4008faf445fa05e436b9c8e0282 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:39.740494 6907 raft_consensus.cc:2955] T f7a36f7ebd5d4342a259b093e45d4c32 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:39.757352 3565 catalog_manager.cc:5719] T f7a36f7ebd5d4342a259b093e45d4c32 P 22ce0e487f0341fd9bf853393d6e7683 reported cstate change: config changed from index 6 to 7, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:39.776226 4313 raft_consensus.cc:2955] T f7a36f7ebd5d4342a259b093e45d4c32 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:39.790449 6395 raft_consensus.cc:2955] T f7a36f7ebd5d4342a259b093e45d4c32 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:39.813390 3735 tablet_service.cc:1558] Processing DeleteTablet for tablet fe8e1f0908234e46881258cfe79835f8 with delete_type TABLET_DATA_TOMBSTONED (TS dc85be7d460a404f997177f57680850f not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:33870
I20260810 01:59:39.815719 3734 tablet_service.cc:1558] Processing DeleteTablet for tablet f7a36f7ebd5d4342a259b093e45d4c32 with delete_type TABLET_DATA_TOMBSTONED (TS dc85be7d460a404f997177f57680850f not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:33870
I20260810 01:59:39.822206 3917 tablet_service.cc:1558] Processing DeleteTablet for tablet c53fc4008faf445fa05e436b9c8e0282 with delete_type TABLET_DATA_TOMBSTONED (TS 82f93d1d11364ceeb485585b4ae78871 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:51288
I20260810 01:59:39.835361 13939 tablet_replica.cc:333] T fe8e1f0908234e46881258cfe79835f8 P dc85be7d460a404f997177f57680850f: stopping tablet replica
I20260810 01:59:39.835731 13939 raft_consensus.cc:2243] T fe8e1f0908234e46881258cfe79835f8 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:59:39.840420 13946 tablet_replica.cc:333] T c53fc4008faf445fa05e436b9c8e0282 P 82f93d1d11364ceeb485585b4ae78871: stopping tablet replica
I20260810 01:59:39.849572 13946 raft_consensus.cc:2243] T c53fc4008faf445fa05e436b9c8e0282 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:59:39.850262 13939 raft_consensus.cc:2272] T fe8e1f0908234e46881258cfe79835f8 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:39.850649 13946 raft_consensus.cc:2272] T c53fc4008faf445fa05e436b9c8e0282 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:39.851604 13946 ts_tablet_manager.cc:1916] T c53fc4008faf445fa05e436b9c8e0282 P 82f93d1d11364ceeb485585b4ae78871: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:59:39.854995 13939 ts_tablet_manager.cc:1916] T fe8e1f0908234e46881258cfe79835f8 P dc85be7d460a404f997177f57680850f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:59:39.894469 13939 ts_tablet_manager.cc:1929] T fe8e1f0908234e46881258cfe79835f8 P dc85be7d460a404f997177f57680850f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.7
I20260810 01:59:39.897126 13939 log.cc:1199] T fe8e1f0908234e46881258cfe79835f8 P dc85be7d460a404f997177f57680850f: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/wal/wals/fe8e1f0908234e46881258cfe79835f8
I20260810 01:59:39.901141 3551 catalog_manager.cc:5050] TS dc85be7d460a404f997177f57680850f (127.21.64.193:36797): tablet fe8e1f0908234e46881258cfe79835f8 (table rebalance_test_table_4 [id=3e1f7b9b31614ed383207098de38230c]) successfully deleted
I20260810 01:59:39.906883 13939 tablet_replica.cc:333] T f7a36f7ebd5d4342a259b093e45d4c32 P dc85be7d460a404f997177f57680850f: stopping tablet replica
I20260810 01:59:39.907155 13939 raft_consensus.cc:2243] T f7a36f7ebd5d4342a259b093e45d4c32 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:59:39.907461 13939 raft_consensus.cc:2272] T f7a36f7ebd5d4342a259b093e45d4c32 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:39.908299 13939 ts_tablet_manager.cc:1916] T f7a36f7ebd5d4342a259b093e45d4c32 P dc85be7d460a404f997177f57680850f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:59:39.909060 13946 ts_tablet_manager.cc:1929] T c53fc4008faf445fa05e436b9c8e0282 P 82f93d1d11364ceeb485585b4ae78871: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20260810 01:59:39.910108 13946 log.cc:1199] T c53fc4008faf445fa05e436b9c8e0282 P 82f93d1d11364ceeb485585b4ae78871: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal/wals/c53fc4008faf445fa05e436b9c8e0282
I20260810 01:59:39.912374 3553 catalog_manager.cc:5050] TS 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): tablet c53fc4008faf445fa05e436b9c8e0282 (table rebalance_test_table_2 [id=5e8751d351ba4b7da7861e02b0c3c634]) successfully deleted
I20260810 01:59:39.935953 13939 ts_tablet_manager.cc:1929] T f7a36f7ebd5d4342a259b093e45d4c32 P dc85be7d460a404f997177f57680850f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20260810 01:59:39.936121 13939 log.cc:1199] T f7a36f7ebd5d4342a259b093e45d4c32 P dc85be7d460a404f997177f57680850f: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/wal/wals/f7a36f7ebd5d4342a259b093e45d4c32
I20260810 01:59:39.937187 3551 catalog_manager.cc:5050] TS dc85be7d460a404f997177f57680850f (127.21.64.193:36797): tablet f7a36f7ebd5d4342a259b093e45d4c32 (table rebalance_test_table_6 [id=5b2df46262b142169af9a32c47535432]) successfully deleted
I20260810 01:59:40.112448 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:40.121763 4105 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:59:40.158053 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:59:40.177800 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:40.211961 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:40.225272 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:40.233860 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:40.272473 6714 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:40.308934 3761 consensus_queue.cc:237] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:40.323621 6564 raft_consensus.cc:1275] T cf531b93380e43bfa103837bd6350834 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:40.324523 13755 consensus_queue.cc:1048] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:40.339429 13755 raft_consensus.cc:2955] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:40.344314 6564 raft_consensus.cc:2955] T cf531b93380e43bfa103837bd6350834 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:40.354053 3562 catalog_manager.cc:5719] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f reported cstate change: config changed from index 5 to 6, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:40.385568 4105 tablet_service.cc:1558] Processing DeleteTablet for tablet cf531b93380e43bfa103837bd6350834 with delete_type TABLET_DATA_TOMBSTONED (TS 17b49c694faf479ea2e5083470fc0302 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:34952
I20260810 01:59:40.387035 14051 tablet_replica.cc:333] T cf531b93380e43bfa103837bd6350834 P 17b49c694faf479ea2e5083470fc0302: stopping tablet replica
I20260810 01:59:40.387691 3761 consensus_queue.cc:237] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:40.388522 14051 raft_consensus.cc:2243] T cf531b93380e43bfa103837bd6350834 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260810 01:59:40.391108 3670 consensus_peers.cc:597] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f -> Peer 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197:38787): Couldn't send request to peer 4dd4cba155c941b4b7ad4d64c7431536. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cf531b93380e43bfa103837bd6350834. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:40.391461 14051 raft_consensus.cc:2272] T cf531b93380e43bfa103837bd6350834 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:40.394285 14051 ts_tablet_manager.cc:1916] T cf531b93380e43bfa103837bd6350834 P 17b49c694faf479ea2e5083470fc0302: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:59:40.395889 6564 raft_consensus.cc:1275] T cf531b93380e43bfa103837bd6350834 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 01:59:40.397109 13549 consensus_queue.cc:1048] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 01:59:40.400779 13549 raft_consensus.cc:2955] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:40.403373 6567 raft_consensus.cc:2955] T cf531b93380e43bfa103837bd6350834 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:40.412724 3551 catalog_manager.cc:5232] ChangeConfig:ADD_PEER:VOTER RPC for tablet cf531b93380e43bfa103837bd6350834 with cas_config_opid_index 6: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260810 01:59:40.415635 3562 catalog_manager.cc:5719] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f reported cstate change: config changed from index 6 to 7, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:40.455736 14051 ts_tablet_manager.cc:1929] T cf531b93380e43bfa103837bd6350834 P 17b49c694faf479ea2e5083470fc0302: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20260810 01:59:40.455977 14051 log.cc:1199] T cf531b93380e43bfa103837bd6350834 P 17b49c694faf479ea2e5083470fc0302: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/wal/wals/cf531b93380e43bfa103837bd6350834
I20260810 01:59:40.456931 3552 catalog_manager.cc:5050] TS 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189): tablet cf531b93380e43bfa103837bd6350834 (table rebalance_test_table_3 [id=c515c90b2c71492f812b4df18501ee04]) successfully deleted
I20260810 01:59:40.821424 14152 ts_tablet_manager.cc:933] T cf531b93380e43bfa103837bd6350834 P 4dd4cba155c941b4b7ad4d64c7431536: Initiating tablet copy from peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
I20260810 01:59:40.864766 14152 tablet_copy_client.cc:323] T cf531b93380e43bfa103837bd6350834 P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.193:36797
I20260810 01:59:40.865890 3787 tablet_copy_service.cc:140] P dc85be7d460a404f997177f57680850f: Received BeginTabletCopySession request for tablet cf531b93380e43bfa103837bd6350834 from peer 4dd4cba155c941b4b7ad4d64c7431536 ({username='slave'} at 127.21.64.197:44713)
I20260810 01:59:40.866124 3787 tablet_copy_service.cc:161] P dc85be7d460a404f997177f57680850f: Beginning new tablet copy session on tablet cf531b93380e43bfa103837bd6350834 from peer 4dd4cba155c941b4b7ad4d64c7431536 at {username='slave'} at 127.21.64.197:44713: session id = 4dd4cba155c941b4b7ad4d64c7431536-cf531b93380e43bfa103837bd6350834
I20260810 01:59:40.871621 3787 tablet_copy_source_session.cc:215] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:40.878039 14152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf531b93380e43bfa103837bd6350834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:40.895781 4313 consensus_queue.cc:237] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:40.961813 14152 tablet_copy_client.cc:806] T cf531b93380e43bfa103837bd6350834 P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:40.962241 14152 tablet_copy_client.cc:670] T cf531b93380e43bfa103837bd6350834 P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:40.963709 6737 raft_consensus.cc:1275] T 7207ea155ba44c0a9ba216acd22dc1b4 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:40.964849 13658 consensus_queue.cc:1048] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:40.978650 13658 raft_consensus.cc:2955] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:40.981972 14152 tablet_copy_client.cc:538] T cf531b93380e43bfa103837bd6350834 P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:40.981725 6739 raft_consensus.cc:2955] T 7207ea155ba44c0a9ba216acd22dc1b4 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:40.988125 14152 tablet_bootstrap.cc:492] T cf531b93380e43bfa103837bd6350834 P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap starting.
I20260810 01:59:41.003741 3761 raft_consensus.cc:1275] T 7207ea155ba44c0a9ba216acd22dc1b4 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:41.004815 14098 consensus_queue.cc:1048] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:41.004791 3562 catalog_manager.cc:5719] T 7207ea155ba44c0a9ba216acd22dc1b4 P c5ed5317da9c464b93f979c405f0f6e4 reported cstate change: config changed from index 4 to 5, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:41.045236 3761 raft_consensus.cc:2955] T 7207ea155ba44c0a9ba216acd22dc1b4 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:41.061776 3917 tablet_service.cc:1558] Processing DeleteTablet for tablet 7207ea155ba44c0a9ba216acd22dc1b4 with delete_type TABLET_DATA_TOMBSTONED (TS 82f93d1d11364ceeb485585b4ae78871 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:51288
I20260810 01:59:41.092864 14218 tablet_replica.cc:333] T 7207ea155ba44c0a9ba216acd22dc1b4 P 82f93d1d11364ceeb485585b4ae78871: stopping tablet replica
I20260810 01:59:41.120343 14218 raft_consensus.cc:2243] T 7207ea155ba44c0a9ba216acd22dc1b4 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:59:41.125870 14218 raft_consensus.cc:2272] T 7207ea155ba44c0a9ba216acd22dc1b4 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:41.130415 14218 ts_tablet_manager.cc:1916] T 7207ea155ba44c0a9ba216acd22dc1b4 P 82f93d1d11364ceeb485585b4ae78871: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:59:41.142567 14218 ts_tablet_manager.cc:1929] T 7207ea155ba44c0a9ba216acd22dc1b4 P 82f93d1d11364ceeb485585b4ae78871: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.4
I20260810 01:59:41.142843 14218 log.cc:1199] T 7207ea155ba44c0a9ba216acd22dc1b4 P 82f93d1d11364ceeb485585b4ae78871: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal/wals/7207ea155ba44c0a9ba216acd22dc1b4
I20260810 01:59:41.143988 3553 catalog_manager.cc:5050] TS 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): tablet 7207ea155ba44c0a9ba216acd22dc1b4 (table rebalance_test_table_2 [id=5e8751d351ba4b7da7861e02b0c3c634]) successfully deleted
I20260810 01:59:41.154261 4105 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:59:41.219188 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:59:41.233979 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:41.258934 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:41.276015 4105 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:59:41.296795 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:59:41.316977 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:41.332130 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:41.383260 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:41.400183 4105 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:59:41.400954 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:41.411903 6714 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:41.472885 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:41.477114 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:59:41.488595 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:41.489598 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:41.527557 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:41.531076 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:41.552603 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:41.559427 6714 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:41.575765 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:41.601568 6714 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:41.648190 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
W20260810 01:59:41.734107 4036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.197:38787, user_credentials={real_user=slave}} blocked reactor thread for 62704.4us
I20260810 01:59:41.780220 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:41.959050 14152 tablet_bootstrap.cc:492] T cf531b93380e43bfa103837bd6350834 P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:41.979688 14152 tablet_bootstrap.cc:492] T cf531b93380e43bfa103837bd6350834 P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap complete.
I20260810 01:59:41.980813 14152 ts_tablet_manager.cc:1403] T cf531b93380e43bfa103837bd6350834 P 4dd4cba155c941b4b7ad4d64c7431536: Time spent bootstrapping tablet: real 0.992s user 0.059s sys 0.008s
I20260810 01:59:41.983760 14152 raft_consensus.cc:359] T cf531b93380e43bfa103837bd6350834 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:41.986263 14152 raft_consensus.cc:740] T cf531b93380e43bfa103837bd6350834 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dd4cba155c941b4b7ad4d64c7431536, State: Initialized, Role: FOLLOWER
I20260810 01:59:41.988838 14152 consensus_queue.cc:260] T cf531b93380e43bfa103837bd6350834 P 4dd4cba155c941b4b7ad4d64c7431536 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:42.051450 14152 ts_tablet_manager.cc:1434] T cf531b93380e43bfa103837bd6350834 P 4dd4cba155c941b4b7ad4d64c7431536: Time spent starting tablet: real 0.070s user 0.004s sys 0.003s
I20260810 01:59:42.052708 3787 tablet_copy_service.cc:342] P dc85be7d460a404f997177f57680850f: Request end of tablet copy session 4dd4cba155c941b4b7ad4d64c7431536-cf531b93380e43bfa103837bd6350834 received from {username='slave'} at 127.21.64.197:44713
I20260810 01:59:42.052829 3787 tablet_copy_service.cc:434] P dc85be7d460a404f997177f57680850f: ending tablet copy session 4dd4cba155c941b4b7ad4d64c7431536-cf531b93380e43bfa103837bd6350834 on tablet cf531b93380e43bfa103837bd6350834 with peer 4dd4cba155c941b4b7ad4d64c7431536
I20260810 01:59:42.399616 6395 raft_consensus.cc:1217] T cf531b93380e43bfa103837bd6350834 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260810 01:59:42.439582 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:42.440050 4105 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:59:42.511688 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:42.528376 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:42.547652 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:42.592968 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:59:42.593595 6714 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:42.633697 3759 consensus_queue.cc:237] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:42.655189 6739 raft_consensus.cc:1275] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:42.656118 13549 consensus_queue.cc:1048] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:42.660353 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:42.700516 13549 raft_consensus.cc:2955] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:42.707665 6739 raft_consensus.cc:2955] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:42.711087 3562 catalog_manager.cc:5719] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f reported cstate change: config changed from index 5 to 6, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:42.780753 3759 consensus_queue.cc:237] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:42.784502 4313 consensus_queue.cc:237] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:42.787971 6909 raft_consensus.cc:1275] T 8308d63e9002418b876c3d3ae0095d9f P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:42.789855 14305 consensus_queue.cc:1048] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:42.790401 6564 raft_consensus.cc:1275] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:42.791409 14305 consensus_queue.cc:1048] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:42.798202 14305 raft_consensus.cc:2955] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:42.800042 6564 raft_consensus.cc:2955] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:42.804211 4105 tablet_service.cc:1558] Processing DeleteTablet for tablet 389d3abfeadd4fe6a4efa74427d71c4d with delete_type TABLET_DATA_TOMBSTONED (TS 17b49c694faf479ea2e5083470fc0302 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:34952
I20260810 01:59:42.806381 6567 raft_consensus.cc:1275] T df5b102a0b03406f9449cdd84dfd147e P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260810 01:59:42.808225 3756 consensus_queue.cc:237] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:42.809800 6395 raft_consensus.cc:1275] T df5b102a0b03406f9449cdd84dfd147e P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260810 01:59:42.811046 14314 consensus_queue.cc:1048] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 01:59:42.812026 6739 raft_consensus.cc:1275] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 01:59:42.812585 13549 consensus_queue.cc:1048] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 01:59:42.813237 13549 consensus_queue.cc:1048] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 01:59:42.817392 6737 raft_consensus.cc:1275] T df5b102a0b03406f9449cdd84dfd147e P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260810 01:59:42.820768 13549 consensus_queue.cc:1048] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 01:59:42.821978 14493 tablet_replica.cc:333] T 389d3abfeadd4fe6a4efa74427d71c4d P 17b49c694faf479ea2e5083470fc0302: stopping tablet replica
I20260810 01:59:42.821810 13549 raft_consensus.cc:2955] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:42.822165 14493 raft_consensus.cc:2243] T 389d3abfeadd4fe6a4efa74427d71c4d P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:59:42.822369 14493 raft_consensus.cc:2272] T 389d3abfeadd4fe6a4efa74427d71c4d P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:42.824656 14493 ts_tablet_manager.cc:1916] T 389d3abfeadd4fe6a4efa74427d71c4d P 17b49c694faf479ea2e5083470fc0302: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:59:42.825614 6737 raft_consensus.cc:2955] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:42.835000 3574 catalog_manager.cc:5719] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4 reported cstate change: config changed from index 6 to 7, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:42.885149 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:42.884877 3574 catalog_manager.cc:5719] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683 reported cstate change: config changed from index 5 to 6, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:42.887238 14493 ts_tablet_manager.cc:1929] T 389d3abfeadd4fe6a4efa74427d71c4d P 17b49c694faf479ea2e5083470fc0302: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20260810 01:59:42.890368 3917 tablet_service.cc:1558] Processing DeleteTablet for tablet 8308d63e9002418b876c3d3ae0095d9f with delete_type TABLET_DATA_TOMBSTONED (TS 82f93d1d11364ceeb485585b4ae78871 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:51288
I20260810 01:59:42.893282 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:59:42.909469 14493 log.cc:1199] T 389d3abfeadd4fe6a4efa74427d71c4d P 17b49c694faf479ea2e5083470fc0302: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/wal/wals/389d3abfeadd4fe6a4efa74427d71c4d
I20260810 01:59:42.912029 3552 catalog_manager.cc:5050] TS 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189): tablet 389d3abfeadd4fe6a4efa74427d71c4d (table rebalance_test_table_9 [id=372310cb713644ada1071e8eb628b0c9]) successfully deleted
I20260810 01:59:42.916038 14519 tablet_replica.cc:333] T 8308d63e9002418b876c3d3ae0095d9f P 82f93d1d11364ceeb485585b4ae78871: stopping tablet replica
I20260810 01:59:42.918099 14519 raft_consensus.cc:2243] T 8308d63e9002418b876c3d3ae0095d9f P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:59:42.918442 14519 raft_consensus.cc:2272] T 8308d63e9002418b876c3d3ae0095d9f P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:42.919445 14519 ts_tablet_manager.cc:1916] T 8308d63e9002418b876c3d3ae0095d9f P 82f93d1d11364ceeb485585b4ae78871: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260810 01:59:42.926126 3673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.199:41689, user_credentials={real_user=slave}} blocked reactor thread for 66335.7us
I20260810 01:59:42.952122 6909 raft_consensus.cc:2955] T 8308d63e9002418b876c3d3ae0095d9f P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
W20260810 01:59:42.973912 3672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.198:45317, user_credentials={real_user=slave}} blocked reactor thread for 163242us
W20260810 01:59:42.979849 3672 consensus_peers.cc:597] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f -> Peer 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317): Couldn't send request to peer 22ce0e487f0341fd9bf853393d6e7683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 389d3abfeadd4fe6a4efa74427d71c4d. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:42.988931 3551 catalog_manager.cc:5232] ChangeConfig:ADD_PEER:VOTER RPC for tablet 389d3abfeadd4fe6a4efa74427d71c4d with cas_config_opid_index 6: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260810 01:59:42.990363 14314 raft_consensus.cc:2955] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:42.991113 6564 raft_consensus.cc:2955] T df5b102a0b03406f9449cdd84dfd147e P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:42.997294 3574 catalog_manager.cc:5719] T df5b102a0b03406f9449cdd84dfd147e P 22ce0e487f0341fd9bf853393d6e7683 reported cstate change: config changed from index 7 to 8, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:42.998342 3759 raft_consensus.cc:1275] T 8308d63e9002418b876c3d3ae0095d9f P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:43.003058 6734 raft_consensus.cc:2955] T df5b102a0b03406f9449cdd84dfd147e P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:43.010310 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:43.020859 6395 raft_consensus.cc:2955] T df5b102a0b03406f9449cdd84dfd147e P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:43.027644 14522 consensus_queue.cc:1048] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:43.038163 3759 raft_consensus.cc:2955] T 8308d63e9002418b876c3d3ae0095d9f P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:43.061861 3917 tablet_service.cc:1558] Processing DeleteTablet for tablet df5b102a0b03406f9449cdd84dfd147e with delete_type TABLET_DATA_TOMBSTONED (TS 82f93d1d11364ceeb485585b4ae78871 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:51288
I20260810 01:59:43.075966 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:43.077095 4105 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:59:43.110638 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:43.138010 6714 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:43.144207 14519 ts_tablet_manager.cc:1929] T 8308d63e9002418b876c3d3ae0095d9f P 82f93d1d11364ceeb485585b4ae78871: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20260810 01:59:43.144423 14519 log.cc:1199] T 8308d63e9002418b876c3d3ae0095d9f P 82f93d1d11364ceeb485585b4ae78871: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal/wals/8308d63e9002418b876c3d3ae0095d9f
I20260810 01:59:43.173383 3553 catalog_manager.cc:5050] TS 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): tablet 8308d63e9002418b876c3d3ae0095d9f (table rebalance_test_table_6 [id=5b2df46262b142169af9a32c47535432]) successfully deleted
I20260810 01:59:43.173921 14519 tablet_replica.cc:333] T df5b102a0b03406f9449cdd84dfd147e P 82f93d1d11364ceeb485585b4ae78871: stopping tablet replica
I20260810 01:59:43.174304 14519 raft_consensus.cc:2243] T df5b102a0b03406f9449cdd84dfd147e P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:59:43.174656 14519 raft_consensus.cc:2272] T df5b102a0b03406f9449cdd84dfd147e P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:43.175637 14519 ts_tablet_manager.cc:1916] T df5b102a0b03406f9449cdd84dfd147e P 82f93d1d11364ceeb485585b4ae78871: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:59:43.273617 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:43.284096 14519 ts_tablet_manager.cc:1929] T df5b102a0b03406f9449cdd84dfd147e P 82f93d1d11364ceeb485585b4ae78871: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.7
I20260810 01:59:43.284400 14519 log.cc:1199] T df5b102a0b03406f9449cdd84dfd147e P 82f93d1d11364ceeb485585b4ae78871: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal/wals/df5b102a0b03406f9449cdd84dfd147e
I20260810 01:59:43.285418 3553 catalog_manager.cc:5050] TS 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): tablet df5b102a0b03406f9449cdd84dfd147e (table rebalance_test_table_2 [id=5e8751d351ba4b7da7861e02b0c3c634]) successfully deleted
I20260810 01:59:43.433199 14577 ts_tablet_manager.cc:933] T 389d3abfeadd4fe6a4efa74427d71c4d P 22ce0e487f0341fd9bf853393d6e7683: Initiating tablet copy from peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
I20260810 01:59:43.459040 14577 tablet_copy_client.cc:323] T 389d3abfeadd4fe6a4efa74427d71c4d P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.193:36797
I20260810 01:59:43.460162 3787 tablet_copy_service.cc:140] P dc85be7d460a404f997177f57680850f: Received BeginTabletCopySession request for tablet 389d3abfeadd4fe6a4efa74427d71c4d from peer 22ce0e487f0341fd9bf853393d6e7683 ({username='slave'} at 127.21.64.198:55265)
I20260810 01:59:43.460372 3787 tablet_copy_service.cc:161] P dc85be7d460a404f997177f57680850f: Beginning new tablet copy session on tablet 389d3abfeadd4fe6a4efa74427d71c4d from peer 22ce0e487f0341fd9bf853393d6e7683 at {username='slave'} at 127.21.64.198:55265: session id = 22ce0e487f0341fd9bf853393d6e7683-389d3abfeadd4fe6a4efa74427d71c4d
I20260810 01:59:43.463665 3787 tablet_copy_source_session.cc:215] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:43.465510 14577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 389d3abfeadd4fe6a4efa74427d71c4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:43.478456 14577 tablet_copy_client.cc:806] T 389d3abfeadd4fe6a4efa74427d71c4d P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:43.478796 14577 tablet_copy_client.cc:670] T 389d3abfeadd4fe6a4efa74427d71c4d P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:43.481781 14577 tablet_copy_client.cc:538] T 389d3abfeadd4fe6a4efa74427d71c4d P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:43.497905 14577 tablet_bootstrap.cc:492] T 389d3abfeadd4fe6a4efa74427d71c4d P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap starting.
I20260810 01:59:43.619822 14577 tablet_bootstrap.cc:492] T 389d3abfeadd4fe6a4efa74427d71c4d P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:43.620736 14577 tablet_bootstrap.cc:492] T 389d3abfeadd4fe6a4efa74427d71c4d P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap complete.
I20260810 01:59:43.621089 14577 ts_tablet_manager.cc:1403] T 389d3abfeadd4fe6a4efa74427d71c4d P 22ce0e487f0341fd9bf853393d6e7683: Time spent bootstrapping tablet: real 0.128s user 0.060s sys 0.034s
I20260810 01:59:43.622305 14577 raft_consensus.cc:359] T 389d3abfeadd4fe6a4efa74427d71c4d P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:43.623184 14577 raft_consensus.cc:740] T 389d3abfeadd4fe6a4efa74427d71c4d P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ce0e487f0341fd9bf853393d6e7683, State: Initialized, Role: FOLLOWER
I20260810 01:59:43.623668 14577 consensus_queue.cc:260] T 389d3abfeadd4fe6a4efa74427d71c4d P 22ce0e487f0341fd9bf853393d6e7683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:43.631685 14577 ts_tablet_manager.cc:1434] T 389d3abfeadd4fe6a4efa74427d71c4d P 22ce0e487f0341fd9bf853393d6e7683: Time spent starting tablet: real 0.010s user 0.002s sys 0.007s
I20260810 01:59:43.633718 3787 tablet_copy_service.cc:342] P dc85be7d460a404f997177f57680850f: Request end of tablet copy session 22ce0e487f0341fd9bf853393d6e7683-389d3abfeadd4fe6a4efa74427d71c4d received from {username='slave'} at 127.21.64.198:55265
I20260810 01:59:43.633862 3787 tablet_copy_service.cc:434] P dc85be7d460a404f997177f57680850f: ending tablet copy session 22ce0e487f0341fd9bf853393d6e7683-389d3abfeadd4fe6a4efa74427d71c4d on tablet 389d3abfeadd4fe6a4efa74427d71c4d with peer 22ce0e487f0341fd9bf853393d6e7683
I20260810 01:59:43.698069 3943 consensus_queue.cc:237] T b63d0798e1ae4aea9b0272716d53d46d P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:43.728641 3945 consensus_queue.cc:237] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:43.730558 6734 raft_consensus.cc:1275] T b63d0798e1ae4aea9b0272716d53d46d P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:43.731331 13888 consensus_queue.cc:1048] T b63d0798e1ae4aea9b0272716d53d46d P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:43.738901 3759 raft_consensus.cc:1275] T b63d0798e1ae4aea9b0272716d53d46d P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:43.739774 13888 consensus_queue.cc:1048] T b63d0798e1ae4aea9b0272716d53d46d P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:43.744905 13888 raft_consensus.cc:2955] T b63d0798e1ae4aea9b0272716d53d46d P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:43.750330 3759 raft_consensus.cc:2955] T b63d0798e1ae4aea9b0272716d53d46d P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:43.751573 3574 catalog_manager.cc:5719] T b63d0798e1ae4aea9b0272716d53d46d P 82f93d1d11364ceeb485585b4ae78871 reported cstate change: config changed from index 4 to 5, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:43.762913 6564 raft_consensus.cc:1275] T f7a36f7ebd5d4342a259b093e45d4c32 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260810 01:59:43.763164 6909 raft_consensus.cc:1275] T f7a36f7ebd5d4342a259b093e45d4c32 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260810 01:59:43.764312 6395 raft_consensus.cc:1275] T f7a36f7ebd5d4342a259b093e45d4c32 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260810 01:59:43.765591 14685 consensus_queue.cc:1048] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 01:59:43.765985 13868 consensus_queue.cc:1048] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 01:59:43.766359 13888 consensus_queue.cc:1048] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 01:59:43.772105 6734 raft_consensus.cc:2955] T b63d0798e1ae4aea9b0272716d53d46d P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:43.796387 14698 raft_consensus.cc:2955] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:43.804298 6907 raft_consensus.cc:2955] T f7a36f7ebd5d4342a259b093e45d4c32 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:43.809149 6564 raft_consensus.cc:2955] T f7a36f7ebd5d4342a259b093e45d4c32 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:43.831283 3568 catalog_manager.cc:5719] T f7a36f7ebd5d4342a259b093e45d4c32 P 3136daf7101445beadc1aa19bc01c227 reported cstate change: config changed from index 7 to 8, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:43.841144 6397 raft_consensus.cc:2955] T f7a36f7ebd5d4342a259b093e45d4c32 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:43.848417 6567 raft_consensus.cc:1217] T 389d3abfeadd4fe6a4efa74427d71c4d P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260810 01:59:43.864674 4105 tablet_service.cc:1558] Processing DeleteTablet for tablet b63d0798e1ae4aea9b0272716d53d46d with delete_type TABLET_DATA_TOMBSTONED (TS 17b49c694faf479ea2e5083470fc0302 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:34952
I20260810 01:59:43.889258 4286 tablet_service.cc:1558] Processing DeleteTablet for tablet f7a36f7ebd5d4342a259b093e45d4c32 with delete_type TABLET_DATA_TOMBSTONED (TS ca4469fc2dbc48488bc7ad7f482f129e not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:40788
I20260810 01:59:43.899049 14734 tablet_replica.cc:333] T f7a36f7ebd5d4342a259b093e45d4c32 P ca4469fc2dbc48488bc7ad7f482f129e: stopping tablet replica
I20260810 01:59:43.899411 14734 raft_consensus.cc:2243] T f7a36f7ebd5d4342a259b093e45d4c32 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:59:43.899885 14734 raft_consensus.cc:2272] T f7a36f7ebd5d4342a259b093e45d4c32 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:43.901592 14724 tablet_replica.cc:333] T b63d0798e1ae4aea9b0272716d53d46d P 17b49c694faf479ea2e5083470fc0302: stopping tablet replica
I20260810 01:59:43.901826 14724 raft_consensus.cc:2243] T b63d0798e1ae4aea9b0272716d53d46d P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:59:43.902103 14724 raft_consensus.cc:2272] T b63d0798e1ae4aea9b0272716d53d46d P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:43.903004 14724 ts_tablet_manager.cc:1916] T b63d0798e1ae4aea9b0272716d53d46d P 17b49c694faf479ea2e5083470fc0302: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:59:43.920253 14734 ts_tablet_manager.cc:1916] T f7a36f7ebd5d4342a259b093e45d4c32 P ca4469fc2dbc48488bc7ad7f482f129e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:59:44.108767 4105 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:59:44.112011 4105 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:59:44.144850 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:44.145854 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:59:44.170831 14734 ts_tablet_manager.cc:1929] T f7a36f7ebd5d4342a259b093e45d4c32 P ca4469fc2dbc48488bc7ad7f482f129e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.7
I20260810 01:59:44.171125 14734 log.cc:1199] T f7a36f7ebd5d4342a259b093e45d4c32 P ca4469fc2dbc48488bc7ad7f482f129e: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal/wals/f7a36f7ebd5d4342a259b093e45d4c32
I20260810 01:59:44.172295 3553 catalog_manager.cc:5050] TS ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): tablet f7a36f7ebd5d4342a259b093e45d4c32 (table rebalance_test_table_6 [id=5b2df46262b142169af9a32c47535432]) successfully deleted
I20260810 01:59:44.176977 14724 ts_tablet_manager.cc:1929] T b63d0798e1ae4aea9b0272716d53d46d P 17b49c694faf479ea2e5083470fc0302: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.4
I20260810 01:59:44.177145 14724 log.cc:1199] T b63d0798e1ae4aea9b0272716d53d46d P 17b49c694faf479ea2e5083470fc0302: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/wal/wals/b63d0798e1ae4aea9b0272716d53d46d
I20260810 01:59:44.178429 3552 catalog_manager.cc:5050] TS 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189): tablet b63d0798e1ae4aea9b0272716d53d46d (table rebalance_test_table_0 [id=8fd8ee0beeb54ad9bee1c94775d09e8f]) successfully deleted
I20260810 01:59:44.222084 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:44.242345 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:59:44.273741 6714 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:44.310715 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:44.347122 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:44.348199 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:44.349076 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:44.365131 6714 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:44.405711 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:44.425751 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:44.458979 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:44.511067 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:44.521525 4105 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:59:44.539341 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:44.576712 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:44.610800 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:44.626459 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:59:44.646507 6714 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:44.675735 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:44.777801 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:45.211210 3759 consensus_queue.cc:237] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:45.222527 6395 raft_consensus.cc:1275] T abf302f27a12414a8647dab82ab8101f P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:45.246668 14955 consensus_queue.cc:1048] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:45.248404 6739 raft_consensus.cc:1275] T abf302f27a12414a8647dab82ab8101f P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:45.251673 14854 consensus_queue.cc:1048] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:45.290330 4132 raft_consensus.cc:1275] T abf302f27a12414a8647dab82ab8101f P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:45.292863 14854 consensus_queue.cc:1048] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:45.294515 14854 raft_consensus.cc:2955] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:45.300446 6734 raft_consensus.cc:2955] T abf302f27a12414a8647dab82ab8101f P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:45.311000 3573 catalog_manager.cc:5719] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f reported cstate change: config changed from index 5 to 6, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:45.320837 6395 raft_consensus.cc:2955] T abf302f27a12414a8647dab82ab8101f P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:45.338627 3945 consensus_queue.cc:237] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:45.355983 4131 raft_consensus.cc:2955] T abf302f27a12414a8647dab82ab8101f P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:45.363528 4105 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:59:45.376448 6734 raft_consensus.cc:1275] T 18a93b1a1ce1440b99bdd7a3bcf49064 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 01:59:45.377322 14834 consensus_queue.cc:1048] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 01:59:45.387465 6909 raft_consensus.cc:1275] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 01:59:45.389726 13888 consensus_queue.cc:1048] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 01:59:45.396580 13888 raft_consensus.cc:2955] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:45.401690 6909 raft_consensus.cc:2955] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:45.427145 3759 consensus_queue.cc:237] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:45.435648 6734 raft_consensus.cc:2955] T 18a93b1a1ce1440b99bdd7a3bcf49064 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:45.438421 3563 catalog_manager.cc:5719] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871 reported cstate change: config changed from index 6 to 7, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:45.445304 6567 raft_consensus.cc:1275] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:45.446012 3943 raft_consensus.cc:1275] T 252899385eaa45b392974d2768e3cf01 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:45.447006 14955 consensus_queue.cc:1048] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:45.447496 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:59:45.447605 14955 consensus_queue.cc:1048] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:45.484022 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:45.499635 6714 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:45.504930 4105 tablet_service.cc:1558] Processing DeleteTablet for tablet 18a93b1a1ce1440b99bdd7a3bcf49064 with delete_type TABLET_DATA_TOMBSTONED (TS 17b49c694faf479ea2e5083470fc0302 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:34952
I20260810 01:59:45.524976 14854 raft_consensus.cc:2955] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:45.530076 6564 raft_consensus.cc:2955] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:45.536306 15051 tablet_replica.cc:333] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302: stopping tablet replica
I20260810 01:59:45.540155 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:45.544623 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:45.548852 3568 catalog_manager.cc:5719] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f reported cstate change: config changed from index 4 to 5, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:45.565425 15051 raft_consensus.cc:2243] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:59:45.565828 15051 raft_consensus.cc:2272] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:45.565968 4286 tablet_service.cc:1558] Processing DeleteTablet for tablet abf302f27a12414a8647dab82ab8101f with delete_type TABLET_DATA_TOMBSTONED (TS ca4469fc2dbc48488bc7ad7f482f129e not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:40788
I20260810 01:59:45.566767 15051 ts_tablet_manager.cc:1916] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:59:45.573882 15051 ts_tablet_manager.cc:1929] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20260810 01:59:45.574079 15051 log.cc:1199] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/wal/wals/18a93b1a1ce1440b99bdd7a3bcf49064
I20260810 01:59:45.575031 3552 catalog_manager.cc:5050] TS 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189): tablet 18a93b1a1ce1440b99bdd7a3bcf49064 (table rebalance_test_table_5 [id=e211628d46b64734960dfd60d86708ce]) successfully deleted
I20260810 01:59:45.594867 4105 tablet_service.cc:1558] Processing DeleteTablet for tablet 252899385eaa45b392974d2768e3cf01 with delete_type TABLET_DATA_TOMBSTONED (TS 17b49c694faf479ea2e5083470fc0302 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:34952
I20260810 01:59:45.595100 4284 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:45.595526 15051 tablet_replica.cc:333] T 252899385eaa45b392974d2768e3cf01 P 17b49c694faf479ea2e5083470fc0302: stopping tablet replica
I20260810 01:59:45.595739 15051 raft_consensus.cc:2243] T 252899385eaa45b392974d2768e3cf01 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:59:45.595943 15051 raft_consensus.cc:2272] T 252899385eaa45b392974d2768e3cf01 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:45.596999 15051 ts_tablet_manager.cc:1916] T 252899385eaa45b392974d2768e3cf01 P 17b49c694faf479ea2e5083470fc0302: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:59:45.599783 3945 raft_consensus.cc:2955] T 252899385eaa45b392974d2768e3cf01 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:45.606858 15051 ts_tablet_manager.cc:1929] T 252899385eaa45b392974d2768e3cf01 P 17b49c694faf479ea2e5083470fc0302: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.4
I20260810 01:59:45.607092 15051 log.cc:1199] T 252899385eaa45b392974d2768e3cf01 P 17b49c694faf479ea2e5083470fc0302: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/wal/wals/252899385eaa45b392974d2768e3cf01
I20260810 01:59:45.608762 3552 catalog_manager.cc:5050] TS 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189): tablet 252899385eaa45b392974d2768e3cf01 (table rebalance_test_table_8 [id=afa71147917d44a585bcbaa37497a2b1]) successfully deleted
I20260810 01:59:45.634747 15060 tablet_replica.cc:333] T abf302f27a12414a8647dab82ab8101f P ca4469fc2dbc48488bc7ad7f482f129e: stopping tablet replica
I20260810 01:59:45.634745 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:45.634970 15060 raft_consensus.cc:2243] T abf302f27a12414a8647dab82ab8101f P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:59:45.635376 15060 raft_consensus.cc:2272] T abf302f27a12414a8647dab82ab8101f P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:45.636247 15060 ts_tablet_manager.cc:1916] T abf302f27a12414a8647dab82ab8101f P ca4469fc2dbc48488bc7ad7f482f129e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:59:45.696457 15060 ts_tablet_manager.cc:1929] T abf302f27a12414a8647dab82ab8101f P ca4469fc2dbc48488bc7ad7f482f129e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20260810 01:59:45.697453 15060 log.cc:1199] T abf302f27a12414a8647dab82ab8101f P ca4469fc2dbc48488bc7ad7f482f129e: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal/wals/abf302f27a12414a8647dab82ab8101f
I20260810 01:59:45.703141 4105 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:59:45.715801 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:59:45.743415 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:45.790643 3553 catalog_manager.cc:5050] TS ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): tablet abf302f27a12414a8647dab82ab8101f (table rebalance_test_table_6 [id=5b2df46262b142169af9a32c47535432]) successfully deleted
W20260810 01:59:45.813834 4036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.193:36797, user_credentials={real_user=slave}} blocked reactor thread for 89086.8us
I20260810 01:59:45.859974 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:45.861930 6714 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:45.900359 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:45.928894 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:45.986027 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:46.314931 3943 consensus_queue.cc:237] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:46.336846 6907 raft_consensus.cc:1275] T 8e8d13caf8054b1daf09b2b114843766 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:46.338414 4313 raft_consensus.cc:1275] T 8e8d13caf8054b1daf09b2b114843766 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:46.339959 14834 consensus_queue.cc:1048] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:46.342100 13888 consensus_queue.cc:1048] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:46.357157 14834 raft_consensus.cc:2955] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:46.363956 4313 raft_consensus.cc:2955] T 8e8d13caf8054b1daf09b2b114843766 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:46.365306 6907 raft_consensus.cc:2955] T 8e8d13caf8054b1daf09b2b114843766 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:46.387670 4105 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:59:46.399950 3569 catalog_manager.cc:5719] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 reported cstate change: config changed from index 4 to 5, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:46.448128 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:59:46.481736 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:46.486819 6907 consensus_queue.cc:237] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 2.7, Last appended by leader: 5, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:46.490619 6395 raft_consensus.cc:1275] T d05e147199e44b8ca712e18d22e7cce7 P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 FOLLOWER]: Refusing update from remote peer 3136daf7101445beadc1aa19bc01c227: Log matching property violated. Preceding OpId in replica: term: 2 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
I20260810 01:59:46.491319 12842 consensus_queue.cc:1048] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 01:59:46.497481 4105 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e8d13caf8054b1daf09b2b114843766 with delete_type TABLET_DATA_TOMBSTONED (TS 17b49c694faf479ea2e5083470fc0302 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:34952
I20260810 01:59:46.499137 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:46.510138 3759 raft_consensus.cc:1275] T d05e147199e44b8ca712e18d22e7cce7 P dc85be7d460a404f997177f57680850f [term 2 FOLLOWER]: Refusing update from remote peer 3136daf7101445beadc1aa19bc01c227: Log matching property violated. Preceding OpId in replica: term: 2 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
I20260810 01:59:46.510883 12842 consensus_queue.cc:1048] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 01:59:46.558223 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:46.594143 6714 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:46.642990 15265 raft_consensus.cc:2955] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227 [term 2 LEADER]: Committing config change with OpId 2.8: config changed from index 7 to 8, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:46.660446 15252 tablet_replica.cc:333] T 8e8d13caf8054b1daf09b2b114843766 P 17b49c694faf479ea2e5083470fc0302: stopping tablet replica
I20260810 01:59:46.660704 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:46.660734 15252 raft_consensus.cc:2243] T 8e8d13caf8054b1daf09b2b114843766 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:59:46.660979 15252 raft_consensus.cc:2272] T 8e8d13caf8054b1daf09b2b114843766 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:46.661975 15252 ts_tablet_manager.cc:1916] T 8e8d13caf8054b1daf09b2b114843766 P 17b49c694faf479ea2e5083470fc0302: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:59:46.653198 6395 raft_consensus.cc:2955] T d05e147199e44b8ca712e18d22e7cce7 P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 FOLLOWER]: Committing config change with OpId 2.8: config changed from index 7 to 8, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:46.690486 15252 ts_tablet_manager.cc:1929] T 8e8d13caf8054b1daf09b2b114843766 P 17b49c694faf479ea2e5083470fc0302: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.4
I20260810 01:59:46.690642 15252 log.cc:1199] T 8e8d13caf8054b1daf09b2b114843766 P 17b49c694faf479ea2e5083470fc0302: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/wal/wals/8e8d13caf8054b1daf09b2b114843766
I20260810 01:59:46.692785 3552 catalog_manager.cc:5050] TS 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189): tablet 8e8d13caf8054b1daf09b2b114843766 (table rebalance_test_table_9 [id=372310cb713644ada1071e8eb628b0c9]) successfully deleted
I20260810 01:59:46.699394 3562 catalog_manager.cc:5719] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227 reported cstate change: config changed from index 7 to 8, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New cstate: current_term: 2 leader_uuid: "3136daf7101445beadc1aa19bc01c227" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:46.707571 3917 tablet_service.cc:1558] Processing DeleteTablet for tablet d05e147199e44b8ca712e18d22e7cce7 with delete_type TABLET_DATA_TOMBSTONED (TS 82f93d1d11364ceeb485585b4ae78871 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:51288
W20260810 01:59:46.724583 6824 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.193:36797, user_credentials={real_user=slave}} blocked reactor thread for 68756us
I20260810 01:59:46.726991 15284 tablet_replica.cc:333] T d05e147199e44b8ca712e18d22e7cce7 P 82f93d1d11364ceeb485585b4ae78871: stopping tablet replica
I20260810 01:59:46.729776 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:46.730564 3759 raft_consensus.cc:2955] T d05e147199e44b8ca712e18d22e7cce7 P dc85be7d460a404f997177f57680850f [term 2 FOLLOWER]: Committing config change with OpId 2.8: config changed from index 7 to 8, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:46.740327 15284 raft_consensus.cc:2243] T d05e147199e44b8ca712e18d22e7cce7 P 82f93d1d11364ceeb485585b4ae78871 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260810 01:59:46.740674 15284 raft_consensus.cc:2272] T d05e147199e44b8ca712e18d22e7cce7 P 82f93d1d11364ceeb485585b4ae78871 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:46.743001 15284 ts_tablet_manager.cc:1916] T d05e147199e44b8ca712e18d22e7cce7 P 82f93d1d11364ceeb485585b4ae78871: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:59:46.765192 15284 ts_tablet_manager.cc:1929] T d05e147199e44b8ca712e18d22e7cce7 P 82f93d1d11364ceeb485585b4ae78871: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.7
I20260810 01:59:46.767858 15284 log.cc:1199] T d05e147199e44b8ca712e18d22e7cce7 P 82f93d1d11364ceeb485585b4ae78871: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal/wals/d05e147199e44b8ca712e18d22e7cce7
I20260810 01:59:46.770642 3553 catalog_manager.cc:5050] TS 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): tablet d05e147199e44b8ca712e18d22e7cce7 (table rebalance_test_table_7 [id=b572363d270a4bfda571d46e96d0bfda]) successfully deleted
I20260810 01:59:46.872560 4105 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:59:46.926761 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:46.969056 6714 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:46.992236 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:59:46.998890 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:47.037559 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:47.042972 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:47.062129 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:47.224961 4105 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:59:47.276880 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:59:47.285405 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:47.320544 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:47.326249 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:47.326856 4313 consensus_queue.cc:237] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:47.358671 6739 raft_consensus.cc:1275] T a586b7d625bb4c27a6343ae7918c8cea P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:47.359529 14489 consensus_queue.cc:1048] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:47.364490 6714 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:47.373584 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:47.466463 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:47.477977 14489 raft_consensus.cc:2955] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:47.483707 6739 raft_consensus.cc:2955] T a586b7d625bb4c27a6343ae7918c8cea P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:47.497813 3568 catalog_manager.cc:5719] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e reported cstate change: config changed from index 5 to 6, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:47.555430 4313 consensus_queue.cc:237] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:47.556552 4105 tablet_service.cc:1558] Processing DeleteTablet for tablet a586b7d625bb4c27a6343ae7918c8cea with delete_type TABLET_DATA_TOMBSTONED (TS 17b49c694faf479ea2e5083470fc0302 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:34952
I20260810 01:59:47.558147 6734 raft_consensus.cc:1275] T a586b7d625bb4c27a6343ae7918c8cea P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 01:59:47.558852 14522 consensus_queue.cc:1048] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260810 01:59:47.559724 4219 consensus_peers.cc:597] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e -> Peer 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995): Couldn't send request to peer 3136daf7101445beadc1aa19bc01c227. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a586b7d625bb4c27a6343ae7918c8cea. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:47.562235 14522 raft_consensus.cc:2955] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:47.566036 6739 raft_consensus.cc:2955] T a586b7d625bb4c27a6343ae7918c8cea P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:47.576596 3553 catalog_manager.cc:5232] ChangeConfig:ADD_PEER:VOTER RPC for tablet a586b7d625bb4c27a6343ae7918c8cea with cas_config_opid_index 6: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260810 01:59:47.577347 15441 tablet_replica.cc:333] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302: stopping tablet replica
I20260810 01:59:47.577615 15441 raft_consensus.cc:2243] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:59:47.577847 15441 raft_consensus.cc:2272] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:47.578308 3562 catalog_manager.cc:5719] T a586b7d625bb4c27a6343ae7918c8cea P c5ed5317da9c464b93f979c405f0f6e4 reported cstate change: config changed from index 6 to 7, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:47.578727 15441 ts_tablet_manager.cc:1916] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:59:47.611215 15441 ts_tablet_manager.cc:1929] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20260810 01:59:47.616163 15441 log.cc:1199] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/wal/wals/a586b7d625bb4c27a6343ae7918c8cea
I20260810 01:59:47.617527 3552 catalog_manager.cc:5050] TS 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189): tablet a586b7d625bb4c27a6343ae7918c8cea (table rebalance_test_table_1 [id=945a223441a04ba2bf938b104bc91cf8]) successfully deleted
I20260810 01:59:47.631343 4313 consensus_queue.cc:237] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:47.638526 6907 raft_consensus.cc:1275] T 8308d63e9002418b876c3d3ae0095d9f P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 01:59:47.639207 6565 raft_consensus.cc:1275] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 01:59:47.641891 14489 consensus_queue.cc:1048] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 01:59:47.644119 14522 consensus_queue.cc:1048] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 01:59:47.650323 14489 raft_consensus.cc:2955] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:47.655033 6567 raft_consensus.cc:2955] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:47.665549 6907 raft_consensus.cc:2955] T 8308d63e9002418b876c3d3ae0095d9f P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:47.673887 3568 catalog_manager.cc:5719] T 8308d63e9002418b876c3d3ae0095d9f P 3136daf7101445beadc1aa19bc01c227 reported cstate change: config changed from index 6 to 7, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:47.681551 3735 tablet_service.cc:1558] Processing DeleteTablet for tablet 8308d63e9002418b876c3d3ae0095d9f with delete_type TABLET_DATA_TOMBSTONED (TS dc85be7d460a404f997177f57680850f not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:33870
I20260810 01:59:47.685262 15490 tablet_replica.cc:333] T 8308d63e9002418b876c3d3ae0095d9f P dc85be7d460a404f997177f57680850f: stopping tablet replica
I20260810 01:59:47.685580 15490 raft_consensus.cc:2243] T 8308d63e9002418b876c3d3ae0095d9f P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:59:47.685849 15490 raft_consensus.cc:2272] T 8308d63e9002418b876c3d3ae0095d9f P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:47.686703 15490 ts_tablet_manager.cc:1916] T 8308d63e9002418b876c3d3ae0095d9f P dc85be7d460a404f997177f57680850f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:59:47.696328 15490 ts_tablet_manager.cc:1929] T 8308d63e9002418b876c3d3ae0095d9f P dc85be7d460a404f997177f57680850f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20260810 01:59:47.696516 15490 log.cc:1199] T 8308d63e9002418b876c3d3ae0095d9f P dc85be7d460a404f997177f57680850f: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/wal/wals/8308d63e9002418b876c3d3ae0095d9f
I20260810 01:59:47.697911 3551 catalog_manager.cc:5050] TS dc85be7d460a404f997177f57680850f (127.21.64.193:36797): tablet 8308d63e9002418b876c3d3ae0095d9f (table rebalance_test_table_6 [id=5b2df46262b142169af9a32c47535432]) successfully deleted
I20260810 01:59:47.942134 4105 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:59:47.999208 15582 ts_tablet_manager.cc:933] T a586b7d625bb4c27a6343ae7918c8cea P 3136daf7101445beadc1aa19bc01c227: Initiating tablet copy from peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943)
I20260810 01:59:48.002223 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:48.023732 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:59:48.027251 15582 tablet_copy_client.cc:323] T a586b7d625bb4c27a6343ae7918c8cea P 3136daf7101445beadc1aa19bc01c227: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.196:41943
I20260810 01:59:48.028007 4337 tablet_copy_service.cc:140] P ca4469fc2dbc48488bc7ad7f482f129e: Received BeginTabletCopySession request for tablet a586b7d625bb4c27a6343ae7918c8cea from peer 3136daf7101445beadc1aa19bc01c227 ({username='slave'} at 127.21.64.200:36881)
I20260810 01:59:48.028149 4337 tablet_copy_service.cc:161] P ca4469fc2dbc48488bc7ad7f482f129e: Beginning new tablet copy session on tablet a586b7d625bb4c27a6343ae7918c8cea from peer 3136daf7101445beadc1aa19bc01c227 at {username='slave'} at 127.21.64.200:36881: session id = 3136daf7101445beadc1aa19bc01c227-a586b7d625bb4c27a6343ae7918c8cea
I20260810 01:59:48.032101 4337 tablet_copy_source_session.cc:215] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:48.038578 15582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a586b7d625bb4c27a6343ae7918c8cea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:48.054719 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:48.076339 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:48.077955 15582 tablet_copy_client.cc:806] T a586b7d625bb4c27a6343ae7918c8cea P 3136daf7101445beadc1aa19bc01c227: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:48.078275 15582 tablet_copy_client.cc:670] T a586b7d625bb4c27a6343ae7918c8cea P 3136daf7101445beadc1aa19bc01c227: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:48.106134 15582 tablet_copy_client.cc:538] T a586b7d625bb4c27a6343ae7918c8cea P 3136daf7101445beadc1aa19bc01c227: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:48.107965 3943 consensus_queue.cc:237] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:48.115540 15582 tablet_bootstrap.cc:492] T a586b7d625bb4c27a6343ae7918c8cea P 3136daf7101445beadc1aa19bc01c227: Bootstrap starting.
I20260810 01:59:48.121942 6907 raft_consensus.cc:1275] T 4a4350cf2ece4769b8547620ac5bedcb P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:48.122684 13888 consensus_queue.cc:1048] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:48.162156 13888 raft_consensus.cc:2955] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:48.166206 6909 raft_consensus.cc:2955] T 4a4350cf2ece4769b8547620ac5bedcb P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:48.170416 3563 catalog_manager.cc:5719] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 reported cstate change: config changed from index 5 to 6, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:48.177978 3735 tablet_service.cc:1558] Processing DeleteTablet for tablet 4a4350cf2ece4769b8547620ac5bedcb with delete_type TABLET_DATA_TOMBSTONED (TS dc85be7d460a404f997177f57680850f not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:33870
I20260810 01:59:48.179010 15490 tablet_replica.cc:333] T 4a4350cf2ece4769b8547620ac5bedcb P dc85be7d460a404f997177f57680850f: stopping tablet replica
I20260810 01:59:48.179277 15490 raft_consensus.cc:2243] T 4a4350cf2ece4769b8547620ac5bedcb P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:59:48.179564 15490 raft_consensus.cc:2272] T 4a4350cf2ece4769b8547620ac5bedcb P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:48.179592 3943 consensus_queue.cc:237] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:48.180359 15490 ts_tablet_manager.cc:1916] T 4a4350cf2ece4769b8547620ac5bedcb P dc85be7d460a404f997177f57680850f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:59:48.187759 15490 ts_tablet_manager.cc:1929] T 4a4350cf2ece4769b8547620ac5bedcb P dc85be7d460a404f997177f57680850f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20260810 01:59:48.188112 15490 log.cc:1199] T 4a4350cf2ece4769b8547620ac5bedcb P dc85be7d460a404f997177f57680850f: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/wal/wals/4a4350cf2ece4769b8547620ac5bedcb
I20260810 01:59:48.190258 3551 catalog_manager.cc:5050] TS dc85be7d460a404f997177f57680850f (127.21.64.193:36797): tablet 4a4350cf2ece4769b8547620ac5bedcb (table rebalance_test_table_8 [id=afa71147917d44a585bcbaa37497a2b1]) successfully deleted
W20260810 01:59:48.196295 3858 consensus_peers.cc:597] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 -> Peer c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199:41689): Couldn't send request to peer c5ed5317da9c464b93f979c405f0f6e4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4a4350cf2ece4769b8547620ac5bedcb. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:48.228519 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:48.252352 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:48.267797 6714 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:48.270169 15582 tablet_bootstrap.cc:492] T a586b7d625bb4c27a6343ae7918c8cea P 3136daf7101445beadc1aa19bc01c227: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:48.270946 15582 tablet_bootstrap.cc:492] T a586b7d625bb4c27a6343ae7918c8cea P 3136daf7101445beadc1aa19bc01c227: Bootstrap complete.
I20260810 01:59:48.271338 15582 ts_tablet_manager.cc:1403] T a586b7d625bb4c27a6343ae7918c8cea P 3136daf7101445beadc1aa19bc01c227: Time spent bootstrapping tablet: real 0.156s user 0.054s sys 0.000s
I20260810 01:59:48.272251 15582 raft_consensus.cc:359] T a586b7d625bb4c27a6343ae7918c8cea P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:48.272445 15582 raft_consensus.cc:740] T a586b7d625bb4c27a6343ae7918c8cea P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3136daf7101445beadc1aa19bc01c227, State: Initialized, Role: FOLLOWER
I20260810 01:59:48.272790 15582 consensus_queue.cc:260] T a586b7d625bb4c27a6343ae7918c8cea P 3136daf7101445beadc1aa19bc01c227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:48.273522 15582 ts_tablet_manager.cc:1434] T a586b7d625bb4c27a6343ae7918c8cea P 3136daf7101445beadc1aa19bc01c227: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 01:59:48.302568 4105 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:59:48.332576 6907 raft_consensus.cc:1275] T 4a4350cf2ece4769b8547620ac5bedcb P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 01:59:48.333676 13888 consensus_queue.cc:1048] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 01:59:48.338414 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:59:48.350919 4337 tablet_copy_service.cc:342] P ca4469fc2dbc48488bc7ad7f482f129e: Request end of tablet copy session 3136daf7101445beadc1aa19bc01c227-a586b7d625bb4c27a6343ae7918c8cea received from {username='slave'} at 127.21.64.200:36881
I20260810 01:59:48.351075 4337 tablet_copy_service.cc:434] P ca4469fc2dbc48488bc7ad7f482f129e: ending tablet copy session 3136daf7101445beadc1aa19bc01c227-a586b7d625bb4c27a6343ae7918c8cea on tablet a586b7d625bb4c27a6343ae7918c8cea with peer 3136daf7101445beadc1aa19bc01c227
I20260810 01:59:48.352191 15592 raft_consensus.cc:2955] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:48.356971 6908 raft_consensus.cc:2955] T 4a4350cf2ece4769b8547620ac5bedcb P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:48.359521 3553 catalog_manager.cc:5232] ChangeConfig:ADD_PEER:VOTER RPC for tablet 4a4350cf2ece4769b8547620ac5bedcb with cas_config_opid_index 6: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260810 01:59:48.359850 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:48.364746 3563 catalog_manager.cc:5719] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 reported cstate change: config changed from index 6 to 7, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:48.380301 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:48.388600 6908 raft_consensus.cc:1217] T a586b7d625bb4c27a6343ae7918c8cea P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260810 01:59:48.459223 6714 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:48.494871 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:48.537410 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:48.563879 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:48.807035 15708 ts_tablet_manager.cc:933] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4: Initiating tablet copy from peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 01:59:48.836184 15708 tablet_copy_client.cc:323] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.194:43893
I20260810 01:59:48.837095 3973 tablet_copy_service.cc:140] P 82f93d1d11364ceeb485585b4ae78871: Received BeginTabletCopySession request for tablet 4a4350cf2ece4769b8547620ac5bedcb from peer c5ed5317da9c464b93f979c405f0f6e4 ({username='slave'} at 127.21.64.199:41929)
I20260810 01:59:48.837306 3973 tablet_copy_service.cc:161] P 82f93d1d11364ceeb485585b4ae78871: Beginning new tablet copy session on tablet 4a4350cf2ece4769b8547620ac5bedcb from peer c5ed5317da9c464b93f979c405f0f6e4 at {username='slave'} at 127.21.64.199:41929: session id = c5ed5317da9c464b93f979c405f0f6e4-4a4350cf2ece4769b8547620ac5bedcb
I20260810 01:59:48.840749 3973 tablet_copy_source_session.cc:215] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:48.844221 15708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a4350cf2ece4769b8547620ac5bedcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:48.861518 15708 tablet_copy_client.cc:806] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:48.861788 15708 tablet_copy_client.cc:670] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:48.873673 15708 tablet_copy_client.cc:538] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:48.878803 15708 tablet_bootstrap.cc:492] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap starting.
I20260810 01:59:48.918712 4313 consensus_queue.cc:237] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:48.947055 6567 raft_consensus.cc:1275] T 0afbd7afdd834537b15c727355724562 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:48.947935 15637 consensus_queue.cc:1048] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:48.949992 3759 raft_consensus.cc:1275] T 0afbd7afdd834537b15c727355724562 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:59:48.952615 15637 consensus_queue.cc:1048] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 01:59:48.965644 15637 raft_consensus.cc:2955] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:48.971452 3759 raft_consensus.cc:2955] T 0afbd7afdd834537b15c727355724562 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:48.978785 3563 catalog_manager.cc:5719] T 0afbd7afdd834537b15c727355724562 P dc85be7d460a404f997177f57680850f reported cstate change: config changed from index 4 to 5, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:49.025578 6565 raft_consensus.cc:2955] T 0afbd7afdd834537b15c727355724562 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:49.040091 15708 tablet_bootstrap.cc:492] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:49.040707 15708 tablet_bootstrap.cc:492] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap complete.
I20260810 01:59:49.041060 15708 ts_tablet_manager.cc:1403] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4: Time spent bootstrapping tablet: real 0.162s user 0.060s sys 0.008s
I20260810 01:59:49.045135 15708 raft_consensus.cc:359] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:49.045557 15708 raft_consensus.cc:740] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ed5317da9c464b93f979c405f0f6e4, State: Initialized, Role: FOLLOWER
I20260810 01:59:49.047652 15708 consensus_queue.cc:260] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:49.055224 3917 tablet_service.cc:1558] Processing DeleteTablet for tablet 0afbd7afdd834537b15c727355724562 with delete_type TABLET_DATA_TOMBSTONED (TS 82f93d1d11364ceeb485585b4ae78871 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:51288
I20260810 01:59:49.063720 15708 ts_tablet_manager.cc:1434] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4: Time spent starting tablet: real 0.022s user 0.004s sys 0.003s
I20260810 01:59:49.065436 3973 tablet_copy_service.cc:342] P 82f93d1d11364ceeb485585b4ae78871: Request end of tablet copy session c5ed5317da9c464b93f979c405f0f6e4-4a4350cf2ece4769b8547620ac5bedcb received from {username='slave'} at 127.21.64.199:41929
I20260810 01:59:49.065598 3973 tablet_copy_service.cc:434] P 82f93d1d11364ceeb485585b4ae78871: ending tablet copy session c5ed5317da9c464b93f979c405f0f6e4-4a4350cf2ece4769b8547620ac5bedcb on tablet 4a4350cf2ece4769b8547620ac5bedcb with peer c5ed5317da9c464b93f979c405f0f6e4
I20260810 01:59:49.065974 15788 tablet_replica.cc:333] T 0afbd7afdd834537b15c727355724562 P 82f93d1d11364ceeb485585b4ae78871: stopping tablet replica
I20260810 01:59:49.066519 15788 raft_consensus.cc:2243] T 0afbd7afdd834537b15c727355724562 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:59:49.067219 15788 raft_consensus.cc:2272] T 0afbd7afdd834537b15c727355724562 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:49.072460 15788 ts_tablet_manager.cc:1916] T 0afbd7afdd834537b15c727355724562 P 82f93d1d11364ceeb485585b4ae78871: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:59:49.081874 15788 ts_tablet_manager.cc:1929] T 0afbd7afdd834537b15c727355724562 P 82f93d1d11364ceeb485585b4ae78871: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.4
I20260810 01:59:49.082064 15788 log.cc:1199] T 0afbd7afdd834537b15c727355724562 P 82f93d1d11364ceeb485585b4ae78871: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal/wals/0afbd7afdd834537b15c727355724562
I20260810 01:59:49.083000 3553 catalog_manager.cc:5050] TS 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): tablet 0afbd7afdd834537b15c727355724562 (table rebalance_test_table_0 [id=8fd8ee0beeb54ad9bee1c94775d09e8f]) successfully deleted
I20260810 01:59:49.213943 6739 raft_consensus.cc:1217] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260810 01:59:49.287417 4105 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:59:49.311467 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:59:49.341495 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:49.370891 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:49.406041 6714 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:49.408718 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:49.462716 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:49.539765 4105 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:59:49.563167 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:49.600447 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:49.611893 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
W20260810 01:59:49.665455 3672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.196:41943, user_credentials={real_user=slave}} blocked reactor thread for 96265.6us
I20260810 01:59:49.669268 6714 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:49.701977 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:49.713726 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:49.729724 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:49.751155 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:50.187834 3759 consensus_queue.cc:237] T 57f6f22d97c14ed98960e27ce2c8f3fb P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:50.199831 6395 raft_consensus.cc:1275] T 57f6f22d97c14ed98960e27ce2c8f3fb P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:50.200764 15964 consensus_queue.cc:1048] T 57f6f22d97c14ed98960e27ce2c8f3fb P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:50.248980 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:50.274597 15964 raft_consensus.cc:2955] T 57f6f22d97c14ed98960e27ce2c8f3fb P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:50.282902 4105 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260810 01:59:50.288393 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:50.306031 6395 raft_consensus.cc:2955] T 57f6f22d97c14ed98960e27ce2c8f3fb P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:50.310771 3568 catalog_manager.cc:5719] T 57f6f22d97c14ed98960e27ce2c8f3fb P dc85be7d460a404f997177f57680850f reported cstate change: config changed from index 5 to 6, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:50.330232 6714 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:50.334781 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:50.355619 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:50.376112 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
W20260810 01:59:50.377306 4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.200:32995, user_credentials={real_user=slave}} blocked reactor thread for 64796.3us
I20260810 01:59:50.402005 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:50.437615 3917 tablet_service.cc:1558] Processing DeleteTablet for tablet 57f6f22d97c14ed98960e27ce2c8f3fb with delete_type TABLET_DATA_TOMBSTONED (TS 82f93d1d11364ceeb485585b4ae78871 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:51288
I20260810 01:59:50.438939 3759 consensus_queue.cc:237] T 57f6f22d97c14ed98960e27ce2c8f3fb P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
W20260810 01:59:50.441123 3672 consensus_peers.cc:597] T 57f6f22d97c14ed98960e27ce2c8f3fb P dc85be7d460a404f997177f57680850f -> Peer 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317): Couldn't send request to peer 22ce0e487f0341fd9bf853393d6e7683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 57f6f22d97c14ed98960e27ce2c8f3fb. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:50.442391 6395 raft_consensus.cc:1275] T 57f6f22d97c14ed98960e27ce2c8f3fb P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 01:59:50.443264 15964 consensus_queue.cc:1048] T 57f6f22d97c14ed98960e27ce2c8f3fb P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 01:59:50.447168 15964 raft_consensus.cc:2955] T 57f6f22d97c14ed98960e27ce2c8f3fb P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:50.451459 6397 raft_consensus.cc:2955] T 57f6f22d97c14ed98960e27ce2c8f3fb P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:50.455492 3551 catalog_manager.cc:5232] ChangeConfig:ADD_PEER:VOTER RPC for tablet 57f6f22d97c14ed98960e27ce2c8f3fb with cas_config_opid_index 6: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260810 01:59:50.459849 3568 catalog_manager.cc:5719] T 57f6f22d97c14ed98960e27ce2c8f3fb P 4dd4cba155c941b4b7ad4d64c7431536 reported cstate change: config changed from index 6 to 7, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:50.463090 16144 tablet_replica.cc:333] T 57f6f22d97c14ed98960e27ce2c8f3fb P 82f93d1d11364ceeb485585b4ae78871: stopping tablet replica
I20260810 01:59:50.463374 16144 raft_consensus.cc:2243] T 57f6f22d97c14ed98960e27ce2c8f3fb P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:59:50.463759 16144 raft_consensus.cc:2272] T 57f6f22d97c14ed98960e27ce2c8f3fb P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:50.465122 16144 ts_tablet_manager.cc:1916] T 57f6f22d97c14ed98960e27ce2c8f3fb P 82f93d1d11364ceeb485585b4ae78871: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:59:50.501536 16144 ts_tablet_manager.cc:1929] T 57f6f22d97c14ed98960e27ce2c8f3fb P 82f93d1d11364ceeb485585b4ae78871: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20260810 01:59:50.501703 16144 log.cc:1199] T 57f6f22d97c14ed98960e27ce2c8f3fb P 82f93d1d11364ceeb485585b4ae78871: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal/wals/57f6f22d97c14ed98960e27ce2c8f3fb
I20260810 01:59:50.502745 3553 catalog_manager.cc:5050] TS 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): tablet 57f6f22d97c14ed98960e27ce2c8f3fb (table rebalance_test_table_5 [id=e211628d46b64734960dfd60d86708ce]) successfully deleted
I20260810 01:59:50.588512 4311 consensus_queue.cc:237] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:50.608701 6565 raft_consensus.cc:1275] T 0afbd7afdd834537b15c727355724562 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:50.610251 15637 consensus_queue.cc:1048] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:50.616118 15637 raft_consensus.cc:2955] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:50.621917 6565 raft_consensus.cc:2955] T 0afbd7afdd834537b15c727355724562 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:50.623276 3568 catalog_manager.cc:5719] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e reported cstate change: config changed from index 5 to 6, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:50.636089 3735 tablet_service.cc:1558] Processing DeleteTablet for tablet 0afbd7afdd834537b15c727355724562 with delete_type TABLET_DATA_TOMBSTONED (TS dc85be7d460a404f997177f57680850f not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:33870
I20260810 01:59:50.636351 4311 consensus_queue.cc:237] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
W20260810 01:59:50.639171 4219 consensus_peers.cc:597] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e -> Peer 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995): Couldn't send request to peer 3136daf7101445beadc1aa19bc01c227. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0afbd7afdd834537b15c727355724562. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:50.648145 16191 tablet_replica.cc:333] T 0afbd7afdd834537b15c727355724562 P dc85be7d460a404f997177f57680850f: stopping tablet replica
I20260810 01:59:50.648425 16191 raft_consensus.cc:2243] T 0afbd7afdd834537b15c727355724562 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:59:50.648836 16191 raft_consensus.cc:2272] T 0afbd7afdd834537b15c727355724562 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:50.649746 6565 raft_consensus.cc:1275] T 0afbd7afdd834537b15c727355724562 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 01:59:50.649801 16191 ts_tablet_manager.cc:1916] T 0afbd7afdd834537b15c727355724562 P dc85be7d460a404f997177f57680850f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:59:50.650473 16119 consensus_queue.cc:1048] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 01:59:50.655701 16119 raft_consensus.cc:2955] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:50.659926 6567 raft_consensus.cc:2955] T 0afbd7afdd834537b15c727355724562 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:50.671968 3553 catalog_manager.cc:5232] ChangeConfig:ADD_PEER:VOTER RPC for tablet 0afbd7afdd834537b15c727355724562 with cas_config_opid_index 6: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260810 01:59:50.675742 3568 catalog_manager.cc:5719] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e reported cstate change: config changed from index 6 to 7, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:50.679071 4132 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e70193bd4055469d870a76542eaef524"
dest_uuid: "17b49c694faf479ea2e5083470fc0302"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:34848
I20260810 01:59:50.679282 4132 raft_consensus.cc:606] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302 [term 1 LEADER]: Received request to transfer leadership
I20260810 01:59:50.683740 16191 ts_tablet_manager.cc:1929] T 0afbd7afdd834537b15c727355724562 P dc85be7d460a404f997177f57680850f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20260810 01:59:50.697842 16191 log.cc:1199] T 0afbd7afdd834537b15c727355724562 P dc85be7d460a404f997177f57680850f: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/wal/wals/0afbd7afdd834537b15c727355724562
I20260810 01:59:50.707749 3551 catalog_manager.cc:5050] TS dc85be7d460a404f997177f57680850f (127.21.64.193:36797): tablet 0afbd7afdd834537b15c727355724562 (table rebalance_test_table_0 [id=8fd8ee0beeb54ad9bee1c94775d09e8f]) successfully deleted
I20260810 01:59:50.794021 16238 raft_consensus.cc:993] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302: : Instructing follower 82f93d1d11364ceeb485585b4ae78871 to start an election
I20260810 01:59:50.794872 15676 raft_consensus.cc:1081] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302 [term 1 LEADER]: Signalling peer 82f93d1d11364ceeb485585b4ae78871 to start an election
I20260810 01:59:50.796193 3943 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e70193bd4055469d870a76542eaef524"
dest_uuid: "82f93d1d11364ceeb485585b4ae78871"
from {username='slave'} at 127.21.64.195:35335
I20260810 01:59:50.796624 3943 raft_consensus.cc:493] T e70193bd4055469d870a76542eaef524 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260810 01:59:50.796768 3943 raft_consensus.cc:3060] T e70193bd4055469d870a76542eaef524 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Advancing to term 2
I20260810 01:59:50.802194 3943 raft_consensus.cc:515] T e70193bd4055469d870a76542eaef524 P 82f93d1d11364ceeb485585b4ae78871 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:50.804409 4132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70193bd4055469d870a76542eaef524" candidate_uuid: "82f93d1d11364ceeb485585b4ae78871" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: true dest_uuid: "17b49c694faf479ea2e5083470fc0302"
I20260810 01:59:50.806143 6567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70193bd4055469d870a76542eaef524" candidate_uuid: "82f93d1d11364ceeb485585b4ae78871" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: true dest_uuid: "22ce0e487f0341fd9bf853393d6e7683"
I20260810 01:59:50.806612 6567 raft_consensus.cc:3060] T e70193bd4055469d870a76542eaef524 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Advancing to term 2
I20260810 01:59:50.812554 6567 raft_consensus.cc:2468] T e70193bd4055469d870a76542eaef524 P 22ce0e487f0341fd9bf853393d6e7683 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82f93d1d11364ceeb485585b4ae78871 in term 2.
I20260810 01:59:50.815457 3943 leader_election.cc:290] T e70193bd4055469d870a76542eaef524 P 82f93d1d11364ceeb485585b4ae78871 [CANDIDATE]: Term 2 election: Requested vote from peers 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189), 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317), 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995)
I20260810 01:59:50.816375 4132 raft_consensus.cc:3055] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302 [term 1 LEADER]: Stepping down as leader of term 1
I20260810 01:59:50.816473 4132 raft_consensus.cc:740] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 17b49c694faf479ea2e5083470fc0302, State: Running, Role: LEADER
I20260810 01:59:50.816730 4132 consensus_queue.cc:260] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 6, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:50.817145 4132 raft_consensus.cc:3060] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Advancing to term 2
I20260810 01:59:50.820809 4132 raft_consensus.cc:2468] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82f93d1d11364ceeb485585b4ae78871 in term 2.
I20260810 01:59:50.828120 3856 leader_election.cc:304] T e70193bd4055469d870a76542eaef524 P 82f93d1d11364ceeb485585b4ae78871 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17b49c694faf479ea2e5083470fc0302, 22ce0e487f0341fd9bf853393d6e7683, 82f93d1d11364ceeb485585b4ae78871; no voters:
I20260810 01:59:50.828510 14834 raft_consensus.cc:2804] T e70193bd4055469d870a76542eaef524 P 82f93d1d11364ceeb485585b4ae78871 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 01:59:50.828634 14834 raft_consensus.cc:697] T e70193bd4055469d870a76542eaef524 P 82f93d1d11364ceeb485585b4ae78871 [term 2 LEADER]: Becoming Leader. State: Replica: 82f93d1d11364ceeb485585b4ae78871, State: Running, Role: LEADER
I20260810 01:59:50.828917 14834 consensus_queue.cc:237] T e70193bd4055469d870a76542eaef524 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 6, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:50.860333 16263 ts_tablet_manager.cc:933] T 57f6f22d97c14ed98960e27ce2c8f3fb P 22ce0e487f0341fd9bf853393d6e7683: Initiating tablet copy from peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
I20260810 01:59:50.862371 3568 catalog_manager.cc:5719] T e70193bd4055469d870a76542eaef524 P 82f93d1d11364ceeb485585b4ae78871 reported cstate change: term changed from 1 to 2, leader changed from 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) to 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194). New cstate: current_term: 2 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:50.878473 16263 tablet_copy_client.cc:323] T 57f6f22d97c14ed98960e27ce2c8f3fb P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.193:36797
I20260810 01:59:50.879194 3787 tablet_copy_service.cc:140] P dc85be7d460a404f997177f57680850f: Received BeginTabletCopySession request for tablet 57f6f22d97c14ed98960e27ce2c8f3fb from peer 22ce0e487f0341fd9bf853393d6e7683 ({username='slave'} at 127.21.64.198:55265)
I20260810 01:59:50.879371 3787 tablet_copy_service.cc:161] P dc85be7d460a404f997177f57680850f: Beginning new tablet copy session on tablet 57f6f22d97c14ed98960e27ce2c8f3fb from peer 22ce0e487f0341fd9bf853393d6e7683 at {username='slave'} at 127.21.64.198:55265: session id = 22ce0e487f0341fd9bf853393d6e7683-57f6f22d97c14ed98960e27ce2c8f3fb
I20260810 01:59:50.882545 3787 tablet_copy_source_session.cc:215] T 57f6f22d97c14ed98960e27ce2c8f3fb P dc85be7d460a404f997177f57680850f: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:50.884243 16263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57f6f22d97c14ed98960e27ce2c8f3fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:50.894613 6907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70193bd4055469d870a76542eaef524" candidate_uuid: "82f93d1d11364ceeb485585b4ae78871" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: true dest_uuid: "3136daf7101445beadc1aa19bc01c227"
I20260810 01:59:50.894891 6907 raft_consensus.cc:3060] T e70193bd4055469d870a76542eaef524 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Advancing to term 2
I20260810 01:59:50.898414 6907 raft_consensus.cc:2468] T e70193bd4055469d870a76542eaef524 P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82f93d1d11364ceeb485585b4ae78871 in term 2.
I20260810 01:59:50.920305 16263 tablet_copy_client.cc:806] T 57f6f22d97c14ed98960e27ce2c8f3fb P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:50.920713 16263 tablet_copy_client.cc:670] T 57f6f22d97c14ed98960e27ce2c8f3fb P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:50.923599 16263 tablet_copy_client.cc:538] T 57f6f22d97c14ed98960e27ce2c8f3fb P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:50.933641 16263 tablet_bootstrap.cc:492] T 57f6f22d97c14ed98960e27ce2c8f3fb P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap starting.
I20260810 01:59:51.012821 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:51.050088 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 01:59:51.063325 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:59:51.092588 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:51.110445 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:51.111186 6714 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:51.157428 3917 tablet_service.cc:1467] Tablet server has 10 leaders and 0 scanners
I20260810 01:59:51.187695 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:51.281728 16364 ts_tablet_manager.cc:933] T 0afbd7afdd834537b15c727355724562 P 3136daf7101445beadc1aa19bc01c227: Initiating tablet copy from peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943)
I20260810 01:59:51.304492 16364 tablet_copy_client.cc:323] T 0afbd7afdd834537b15c727355724562 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.196:41943
I20260810 01:59:51.305230 4337 tablet_copy_service.cc:140] P ca4469fc2dbc48488bc7ad7f482f129e: Received BeginTabletCopySession request for tablet 0afbd7afdd834537b15c727355724562 from peer 3136daf7101445beadc1aa19bc01c227 ({username='slave'} at 127.21.64.200:36881)
I20260810 01:59:51.305454 4337 tablet_copy_service.cc:161] P ca4469fc2dbc48488bc7ad7f482f129e: Beginning new tablet copy session on tablet 0afbd7afdd834537b15c727355724562 from peer 3136daf7101445beadc1aa19bc01c227 at {username='slave'} at 127.21.64.200:36881: session id = 3136daf7101445beadc1aa19bc01c227-0afbd7afdd834537b15c727355724562
I20260810 01:59:51.308806 4337 tablet_copy_source_session.cc:215] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:51.311988 16364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0afbd7afdd834537b15c727355724562. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:51.328285 16364 tablet_copy_client.cc:806] T 0afbd7afdd834537b15c727355724562 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:51.328655 16364 tablet_copy_client.cc:670] T 0afbd7afdd834537b15c727355724562 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:51.330724 16364 tablet_copy_client.cc:538] T 0afbd7afdd834537b15c727355724562 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:51.333633 16364 tablet_bootstrap.cc:492] T 0afbd7afdd834537b15c727355724562 P 3136daf7101445beadc1aa19bc01c227: Bootstrap starting.
I20260810 01:59:51.335104 16263 tablet_bootstrap.cc:492] T 57f6f22d97c14ed98960e27ce2c8f3fb P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:51.335644 16263 tablet_bootstrap.cc:492] T 57f6f22d97c14ed98960e27ce2c8f3fb P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap complete.
I20260810 01:59:51.335954 16263 ts_tablet_manager.cc:1403] T 57f6f22d97c14ed98960e27ce2c8f3fb P 22ce0e487f0341fd9bf853393d6e7683: Time spent bootstrapping tablet: real 0.402s user 0.068s sys 0.004s
I20260810 01:59:51.336678 16263 raft_consensus.cc:359] T 57f6f22d97c14ed98960e27ce2c8f3fb P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:51.336874 16263 raft_consensus.cc:740] T 57f6f22d97c14ed98960e27ce2c8f3fb P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ce0e487f0341fd9bf853393d6e7683, State: Initialized, Role: FOLLOWER
I20260810 01:59:51.337153 16263 consensus_queue.cc:260] T 57f6f22d97c14ed98960e27ce2c8f3fb P 22ce0e487f0341fd9bf853393d6e7683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:51.338925 4132 raft_consensus.cc:1275] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302 [term 2 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 2 index: 7. (index mismatch)
I20260810 01:59:51.339743 15592 consensus_queue.cc:1048] T e70193bd4055469d870a76542eaef524 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 01:59:51.349727 16263 ts_tablet_manager.cc:1434] T 57f6f22d97c14ed98960e27ce2c8f3fb P 22ce0e487f0341fd9bf853393d6e7683: Time spent starting tablet: real 0.014s user 0.010s sys 0.000s
I20260810 01:59:51.352391 3787 tablet_copy_service.cc:342] P dc85be7d460a404f997177f57680850f: Request end of tablet copy session 22ce0e487f0341fd9bf853393d6e7683-57f6f22d97c14ed98960e27ce2c8f3fb received from {username='slave'} at 127.21.64.198:55265
I20260810 01:59:51.352527 3787 tablet_copy_service.cc:434] P dc85be7d460a404f997177f57680850f: ending tablet copy session 22ce0e487f0341fd9bf853393d6e7683-57f6f22d97c14ed98960e27ce2c8f3fb on tablet 57f6f22d97c14ed98960e27ce2c8f3fb with peer 22ce0e487f0341fd9bf853393d6e7683
I20260810 01:59:51.395788 6567 raft_consensus.cc:1275] T e70193bd4055469d870a76542eaef524 P 22ce0e487f0341fd9bf853393d6e7683 [term 2 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 2 index: 7. (index mismatch)
I20260810 01:59:51.396476 15592 consensus_queue.cc:1048] T e70193bd4055469d870a76542eaef524 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 01:59:51.407692 6908 raft_consensus.cc:1275] T e70193bd4055469d870a76542eaef524 P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 2 index: 7. (index mismatch)
I20260810 01:59:51.410004 15592 consensus_queue.cc:1048] T e70193bd4055469d870a76542eaef524 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 01:59:51.437024 6565 raft_consensus.cc:1217] T 57f6f22d97c14ed98960e27ce2c8f3fb P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260810 01:59:51.495976 16364 tablet_bootstrap.cc:492] T 0afbd7afdd834537b15c727355724562 P 3136daf7101445beadc1aa19bc01c227: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:51.496434 16364 tablet_bootstrap.cc:492] T 0afbd7afdd834537b15c727355724562 P 3136daf7101445beadc1aa19bc01c227: Bootstrap complete.
I20260810 01:59:51.496713 16364 ts_tablet_manager.cc:1403] T 0afbd7afdd834537b15c727355724562 P 3136daf7101445beadc1aa19bc01c227: Time spent bootstrapping tablet: real 0.163s user 0.058s sys 0.008s
I20260810 01:59:51.497637 16364 raft_consensus.cc:359] T 0afbd7afdd834537b15c727355724562 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:51.497860 16364 raft_consensus.cc:740] T 0afbd7afdd834537b15c727355724562 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3136daf7101445beadc1aa19bc01c227, State: Initialized, Role: FOLLOWER
I20260810 01:59:51.498122 16364 consensus_queue.cc:260] T 0afbd7afdd834537b15c727355724562 P 3136daf7101445beadc1aa19bc01c227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:51.498653 16364 ts_tablet_manager.cc:1434] T 0afbd7afdd834537b15c727355724562 P 3136daf7101445beadc1aa19bc01c227: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:59:51.509125 4337 tablet_copy_service.cc:342] P ca4469fc2dbc48488bc7ad7f482f129e: Request end of tablet copy session 3136daf7101445beadc1aa19bc01c227-0afbd7afdd834537b15c727355724562 received from {username='slave'} at 127.21.64.200:36881
I20260810 01:59:51.509270 4337 tablet_copy_service.cc:434] P ca4469fc2dbc48488bc7ad7f482f129e: ending tablet copy session 3136daf7101445beadc1aa19bc01c227-0afbd7afdd834537b15c727355724562 on tablet 0afbd7afdd834537b15c727355724562 with peer 3136daf7101445beadc1aa19bc01c227
I20260810 01:59:51.590474 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 01:59:51.608564 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:59:51.618358 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:51.631395 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:51.672966 3917 tablet_service.cc:1467] Tablet server has 10 leaders and 0 scanners
I20260810 01:59:51.716863 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:51.733358 6714 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:51.743381 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:51.771440 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:51.800525 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 01:59:51.815527 6908 raft_consensus.cc:1217] T 0afbd7afdd834537b15c727355724562 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260810 01:59:51.845294 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:59:51.857075 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:51.866148 3917 tablet_service.cc:1467] Tablet server has 10 leaders and 0 scanners
W20260810 01:59:51.869261 4224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.199:41689, user_credentials={real_user=slave}} blocked reactor thread for 51735.9us
I20260810 01:59:51.901172 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:51.929512 6714 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:51.934677 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:52.405823 3759 consensus_queue.cc:237] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:52.420724 6567 raft_consensus.cc:1275] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:52.421792 15964 consensus_queue.cc:1048] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:52.501698 3943 consensus_queue.cc:237] T e70193bd4055469d870a76542eaef524 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 2.7, Last appended by leader: 6, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
W20260810 01:59:52.548745 16668 log.cc:927] Time spent T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683: Append to log took a long time: real 0.118s user 0.000s sys 0.000s
I20260810 01:59:52.595204 6567 raft_consensus.cc:1275] T e70193bd4055469d870a76542eaef524 P 22ce0e487f0341fd9bf853393d6e7683 [term 2 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 2 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
I20260810 01:59:52.596168 14834 consensus_queue.cc:1048] T e70193bd4055469d870a76542eaef524 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 01:59:52.610962 6908 raft_consensus.cc:1275] T e70193bd4055469d870a76542eaef524 P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 2 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
I20260810 01:59:52.615477 14834 consensus_queue.cc:1048] T e70193bd4055469d870a76542eaef524 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 01:59:52.664014 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260810 01:59:52.697187 3857 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.198:45317, user_credentials={real_user=slave}} blocked reactor thread for 54041.7us
I20260810 01:59:52.714051 14834 raft_consensus.cc:2955] T e70193bd4055469d870a76542eaef524 P 82f93d1d11364ceeb485585b4ae78871 [term 2 LEADER]: Committing config change with OpId 2.8: config changed from index 6 to 8, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:52.735088 6565 raft_consensus.cc:2955] T e70193bd4055469d870a76542eaef524 P 22ce0e487f0341fd9bf853393d6e7683 [term 2 FOLLOWER]: Committing config change with OpId 2.8: config changed from index 6 to 8, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:52.745990 6908 raft_consensus.cc:2955] T e70193bd4055469d870a76542eaef524 P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Committing config change with OpId 2.8: config changed from index 6 to 8, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:52.759804 3562 catalog_manager.cc:5719] T e70193bd4055469d870a76542eaef524 P 22ce0e487f0341fd9bf853393d6e7683 reported cstate change: config changed from index 6 to 8, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New cstate: current_term: 2 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:52.762091 15964 raft_consensus.cc:2955] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:52.764190 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 01:59:52.769747 3563 catalog_manager.cc:5719] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f reported cstate change: config changed from index 5 to 6, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:52.772571 6565 raft_consensus.cc:2955] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:52.818612 3917 tablet_service.cc:1467] Tablet server has 10 leaders and 0 scanners
I20260810 01:59:52.818708 4105 tablet_service.cc:1558] Processing DeleteTablet for tablet e70193bd4055469d870a76542eaef524 with delete_type TABLET_DATA_TOMBSTONED (TS 17b49c694faf479ea2e5083470fc0302 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:34952
I20260810 01:59:52.823541 3759 consensus_queue.cc:237] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:52.824113 3917 tablet_service.cc:1558] Processing DeleteTablet for tablet 252899385eaa45b392974d2768e3cf01 with delete_type TABLET_DATA_TOMBSTONED (TS 82f93d1d11364ceeb485585b4ae78871 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:51288
I20260810 01:59:52.827736 6565 raft_consensus.cc:1275] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 01:59:52.830229 16726 tablet_replica.cc:333] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302: stopping tablet replica
I20260810 01:59:52.830171 16658 consensus_queue.cc:1048] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 01:59:52.830468 16726 raft_consensus.cc:2243] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260810 01:59:52.830694 16726 raft_consensus.cc:2272] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:52.831619 16726 ts_tablet_manager.cc:1916] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:59:52.835681 16658 raft_consensus.cc:2955] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:52.840992 16726 ts_tablet_manager.cc:1929] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.7
I20260810 01:59:52.841220 16726 log.cc:1199] T e70193bd4055469d870a76542eaef524 P 17b49c694faf479ea2e5083470fc0302: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/wal/wals/e70193bd4055469d870a76542eaef524
I20260810 01:59:52.842209 3552 catalog_manager.cc:5050] TS 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189): tablet e70193bd4055469d870a76542eaef524 (table rebalance_test_table_7 [id=b572363d270a4bfda571d46e96d0bfda]) successfully deleted
I20260810 01:59:52.842295 6565 raft_consensus.cc:2955] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:52.843189 16727 tablet_replica.cc:333] T 252899385eaa45b392974d2768e3cf01 P 82f93d1d11364ceeb485585b4ae78871: stopping tablet replica
I20260810 01:59:52.851783 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:59:52.860045 16727 raft_consensus.cc:2243] T 252899385eaa45b392974d2768e3cf01 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:59:52.860428 16727 raft_consensus.cc:2272] T 252899385eaa45b392974d2768e3cf01 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:52.861570 16727 ts_tablet_manager.cc:1916] T 252899385eaa45b392974d2768e3cf01 P 82f93d1d11364ceeb485585b4ae78871: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:59:52.867785 3551 catalog_manager.cc:5232] ChangeConfig:ADD_PEER:VOTER RPC for tablet 252899385eaa45b392974d2768e3cf01 with cas_config_opid_index 6: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260810 01:59:52.891321 3565 catalog_manager.cc:5719] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f reported cstate change: config changed from index 6 to 7, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 01:59:52.895941 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:52.902392 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:52.925393 16727 ts_tablet_manager.cc:1929] T 252899385eaa45b392974d2768e3cf01 P 82f93d1d11364ceeb485585b4ae78871: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20260810 01:59:52.925547 16727 log.cc:1199] T 252899385eaa45b392974d2768e3cf01 P 82f93d1d11364ceeb485585b4ae78871: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal/wals/252899385eaa45b392974d2768e3cf01
I20260810 01:59:52.926553 3553 catalog_manager.cc:5050] TS 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): tablet 252899385eaa45b392974d2768e3cf01 (table rebalance_test_table_8 [id=afa71147917d44a585bcbaa37497a2b1]) successfully deleted
I20260810 01:59:52.931493 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
W20260810 01:59:53.000337 3670 consensus_peers.cc:597] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f -> Peer 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995): Couldn't send request to peer 3136daf7101445beadc1aa19bc01c227. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 252899385eaa45b392974d2768e3cf01. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:53.006717 6714 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:53.289582 16818 ts_tablet_manager.cc:933] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227: Initiating tablet copy from peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
I20260810 01:59:53.292179 16818 tablet_copy_client.cc:323] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.193:36797
I20260810 01:59:53.293315 3787 tablet_copy_service.cc:140] P dc85be7d460a404f997177f57680850f: Received BeginTabletCopySession request for tablet 252899385eaa45b392974d2768e3cf01 from peer 3136daf7101445beadc1aa19bc01c227 ({username='slave'} at 127.21.64.200:47703)
I20260810 01:59:53.293540 3787 tablet_copy_service.cc:161] P dc85be7d460a404f997177f57680850f: Beginning new tablet copy session on tablet 252899385eaa45b392974d2768e3cf01 from peer 3136daf7101445beadc1aa19bc01c227 at {username='slave'} at 127.21.64.200:47703: session id = 3136daf7101445beadc1aa19bc01c227-252899385eaa45b392974d2768e3cf01
I20260810 01:59:53.299062 3787 tablet_copy_source_session.cc:215] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:53.302376 16818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 252899385eaa45b392974d2768e3cf01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:53.316030 16818 tablet_copy_client.cc:806] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:53.316272 16818 tablet_copy_client.cc:670] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:53.318703 16818 tablet_copy_client.cc:538] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:53.323145 16818 tablet_bootstrap.cc:492] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227: Bootstrap starting.
I20260810 01:59:53.332365 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 01:59:53.372931 3917 tablet_service.cc:1467] Tablet server has 10 leaders and 0 scanners
I20260810 01:59:53.384908 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:53.405321 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:59:53.425905 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:53.456295 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:53.516017 6714 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:53.532788 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:53.743288 16818 tablet_bootstrap.cc:492] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:53.743852 16818 tablet_bootstrap.cc:492] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227: Bootstrap complete.
I20260810 01:59:53.744613 16818 ts_tablet_manager.cc:1403] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227: Time spent bootstrapping tablet: real 0.422s user 0.072s sys 0.006s
I20260810 01:59:53.745653 16818 raft_consensus.cc:359] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:53.746275 16818 raft_consensus.cc:740] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3136daf7101445beadc1aa19bc01c227, State: Initialized, Role: FOLLOWER
I20260810 01:59:53.746783 16818 consensus_queue.cc:260] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 01:59:53.747704 16818 ts_tablet_manager.cc:1434] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 01:59:53.749691 3787 tablet_copy_service.cc:342] P dc85be7d460a404f997177f57680850f: Request end of tablet copy session 3136daf7101445beadc1aa19bc01c227-252899385eaa45b392974d2768e3cf01 received from {username='slave'} at 127.21.64.200:47703
I20260810 01:59:53.749826 3787 tablet_copy_service.cc:434] P dc85be7d460a404f997177f57680850f: ending tablet copy session 3136daf7101445beadc1aa19bc01c227-252899385eaa45b392974d2768e3cf01 on tablet 252899385eaa45b392974d2768e3cf01 with peer 3136daf7101445beadc1aa19bc01c227
I20260810 01:59:53.807659 6907 raft_consensus.cc:1217] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260810 01:59:53.989357 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 01:59:54.001988 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:59:54.052659 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:54.072160 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:54.088624 3917 tablet_service.cc:1467] Tablet server has 10 leaders and 0 scanners
I20260810 01:59:54.103111 3943 consensus_queue.cc:237] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:54.111267 6565 raft_consensus.cc:1275] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 01:59:54.112228 16703 consensus_queue.cc:1048] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 01:59:54.116830 6397 raft_consensus.cc:1275] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 01:59:54.117574 16703 consensus_queue.cc:1048] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 01:59:54.121354 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:54.137682 6714 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:54.182884 6395 raft_consensus.cc:2955] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:54.185906 6565 raft_consensus.cc:2955] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:54.186470 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:54.207513 3565 catalog_manager.cc:5719] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 4dd4cba155c941b4b7ad4d64c7431536 reported cstate change: config changed from index 6 to 7, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:54.178162 16703 raft_consensus.cc:2955] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 01:59:54.394491 4286 tablet_service.cc:1558] Processing DeleteTablet for tablet b6c5892f4de449fb8cb7f4cff7eb2e20 with delete_type TABLET_DATA_TOMBSTONED (TS ca4469fc2dbc48488bc7ad7f482f129e not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:40788
I20260810 01:59:54.408090 17137 tablet_replica.cc:333] T b6c5892f4de449fb8cb7f4cff7eb2e20 P ca4469fc2dbc48488bc7ad7f482f129e: stopping tablet replica
I20260810 01:59:54.410351 17137 raft_consensus.cc:2243] T b6c5892f4de449fb8cb7f4cff7eb2e20 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:59:54.412010 17137 raft_consensus.cc:2272] T b6c5892f4de449fb8cb7f4cff7eb2e20 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:54.414583 17137 ts_tablet_manager.cc:1916] T b6c5892f4de449fb8cb7f4cff7eb2e20 P ca4469fc2dbc48488bc7ad7f482f129e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:59:54.447042 17137 ts_tablet_manager.cc:1929] T b6c5892f4de449fb8cb7f4cff7eb2e20 P ca4469fc2dbc48488bc7ad7f482f129e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20260810 01:59:54.458866 17137 log.cc:1199] T b6c5892f4de449fb8cb7f4cff7eb2e20 P ca4469fc2dbc48488bc7ad7f482f129e: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal/wals/b6c5892f4de449fb8cb7f4cff7eb2e20
I20260810 01:59:54.460081 3553 catalog_manager.cc:5050] TS ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): tablet b6c5892f4de449fb8cb7f4cff7eb2e20 (table rebalance_test_table_4 [id=3e1f7b9b31614ed383207098de38230c]) successfully deleted
I20260810 01:59:54.738097 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 01:59:54.808404 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:54.813709 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:59:54.872527 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:54.888774 3917 tablet_service.cc:1467] Tablet server has 10 leaders and 0 scanners
I20260810 01:59:54.962126 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:54.963521 6714 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:54.991694 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:55.140851 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 01:59:55.152807 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:55.173458 4313 consensus_queue.cc:237] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:59:55.199025 3917 tablet_service.cc:1467] Tablet server has 10 leaders and 0 scanners
W20260810 01:59:55.211414 4222 consensus_peers.cc:597] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e -> Peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): Couldn't send request to peer 82f93d1d11364ceeb485585b4ae78871. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:55.212641 6739 raft_consensus.cc:1275] T 7207ea155ba44c0a9ba216acd22dc1b4 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:55.213027 3756 raft_consensus.cc:1275] T 7207ea155ba44c0a9ba216acd22dc1b4 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:55.213470 16704 consensus_queue.cc:1048] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:55.214576 16704 consensus_queue.cc:1048] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:55.225925 17262 raft_consensus.cc:2955] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 01:59:55.229481 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:59:55.230574 3756 raft_consensus.cc:2955] T 7207ea155ba44c0a9ba216acd22dc1b4 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 01:59:55.232359 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:55.239066 6739 raft_consensus.cc:2955] T 7207ea155ba44c0a9ba216acd22dc1b4 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 01:59:55.271490 3574 catalog_manager.cc:5719] T 7207ea155ba44c0a9ba216acd22dc1b4 P c5ed5317da9c464b93f979c405f0f6e4 reported cstate change: config changed from index 5 to 6, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) added. New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
W20260810 01:59:55.282218 3673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.199:41689, user_credentials={real_user=slave}} blocked reactor thread for 61416.3us
I20260810 01:59:55.283371 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:55.308955 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:55.334658 6714 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:55.538384 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 01:59:55.568737 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:59:55.595024 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:55.610396 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:55.631734 3917 tablet_service.cc:1467] Tablet server has 10 leaders and 0 scanners
I20260810 01:59:55.651057 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:55.657177 6714 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:55.702515 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:55.708621 17438 ts_tablet_manager.cc:933] T 7207ea155ba44c0a9ba216acd22dc1b4 P 82f93d1d11364ceeb485585b4ae78871: Initiating tablet copy from peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943)
I20260810 01:59:55.719273 17438 tablet_copy_client.cc:323] T 7207ea155ba44c0a9ba216acd22dc1b4 P 82f93d1d11364ceeb485585b4ae78871: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.196:41943
I20260810 01:59:55.720301 4337 tablet_copy_service.cc:140] P ca4469fc2dbc48488bc7ad7f482f129e: Received BeginTabletCopySession request for tablet 7207ea155ba44c0a9ba216acd22dc1b4 from peer 82f93d1d11364ceeb485585b4ae78871 ({username='slave'} at 127.21.64.194:37889)
I20260810 01:59:55.720503 4337 tablet_copy_service.cc:161] P ca4469fc2dbc48488bc7ad7f482f129e: Beginning new tablet copy session on tablet 7207ea155ba44c0a9ba216acd22dc1b4 from peer 82f93d1d11364ceeb485585b4ae78871 at {username='slave'} at 127.21.64.194:37889: session id = 82f93d1d11364ceeb485585b4ae78871-7207ea155ba44c0a9ba216acd22dc1b4
I20260810 01:59:55.724130 4337 tablet_copy_source_session.cc:215] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:55.726866 17438 ts_tablet_manager.cc:1916] T 7207ea155ba44c0a9ba216acd22dc1b4 P 82f93d1d11364ceeb485585b4ae78871: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260810 01:59:55.741911 17438 ts_tablet_manager.cc:1929] T 7207ea155ba44c0a9ba216acd22dc1b4 P 82f93d1d11364ceeb485585b4ae78871: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.4
I20260810 01:59:55.742476 17438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7207ea155ba44c0a9ba216acd22dc1b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:55.748345 17438 tablet_copy_client.cc:806] T 7207ea155ba44c0a9ba216acd22dc1b4 P 82f93d1d11364ceeb485585b4ae78871: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:55.748890 17438 tablet_copy_client.cc:670] T 7207ea155ba44c0a9ba216acd22dc1b4 P 82f93d1d11364ceeb485585b4ae78871: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:55.754956 17438 tablet_copy_client.cc:538] T 7207ea155ba44c0a9ba216acd22dc1b4 P 82f93d1d11364ceeb485585b4ae78871: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:55.763036 17438 tablet_bootstrap.cc:492] T 7207ea155ba44c0a9ba216acd22dc1b4 P 82f93d1d11364ceeb485585b4ae78871: Bootstrap starting.
I20260810 01:59:55.839692 3943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da507bc24d964ce1a5835edad5177726"
dest_uuid: "82f93d1d11364ceeb485585b4ae78871"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:41502
I20260810 01:59:55.840018 3943 raft_consensus.cc:606] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Received request to transfer leadership
I20260810 01:59:55.867959 3756 consensus_queue.cc:237] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
W20260810 01:59:55.886061 3672 consensus_peers.cc:597] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f -> Peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): Couldn't send request to peer ca4469fc2dbc48488bc7ad7f482f129e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 252899385eaa45b392974d2768e3cf01. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:55.887534 6907 raft_consensus.cc:1275] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260810 01:59:55.888985 6567 raft_consensus.cc:1275] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260810 01:59:55.888932 15964 consensus_queue.cc:1048] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 01:59:55.889705 17355 consensus_queue.cc:1048] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 01:59:55.909148 3943 consensus_queue.cc:237] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:59:55.915822 17355 raft_consensus.cc:2955] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
W20260810 01:59:55.919432 3857 consensus_peers.cc:597] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 -> Peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): Couldn't send request to peer ca4469fc2dbc48488bc7ad7f482f129e. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:55.920655 6739 raft_consensus.cc:1275] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260810 01:59:55.921026 6907 raft_consensus.cc:1275] T 4a4350cf2ece4769b8547620ac5bedcb P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260810 01:59:55.921743 17342 consensus_queue.cc:1048] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 01:59:55.921684 6908 raft_consensus.cc:2955] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
I20260810 01:59:55.930150 3562 catalog_manager.cc:5719] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227 reported cstate change: config changed from index 7 to 8, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) added. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
I20260810 01:59:55.931218 17342 consensus_queue.cc:1048] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 01:59:55.941594 17342 raft_consensus.cc:993] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871: : Instructing follower c5ed5317da9c464b93f979c405f0f6e4 to start an election
I20260810 01:59:55.941728 17342 raft_consensus.cc:1081] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Signalling peer c5ed5317da9c464b93f979c405f0f6e4 to start an election
I20260810 01:59:55.942706 6739 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da507bc24d964ce1a5835edad5177726"
dest_uuid: "c5ed5317da9c464b93f979c405f0f6e4"
from {username='slave'} at 127.21.64.194:38241
I20260810 01:59:55.943022 6739 raft_consensus.cc:493] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260810 01:59:55.943185 6739 raft_consensus.cc:3060] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Advancing to term 2
I20260810 01:59:55.951406 6739 raft_consensus.cc:515] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:55.958164 17438 tablet_bootstrap.cc:492] T 7207ea155ba44c0a9ba216acd22dc1b4 P 82f93d1d11364ceeb485585b4ae78871: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:55.960479 17438 tablet_bootstrap.cc:492] T 7207ea155ba44c0a9ba216acd22dc1b4 P 82f93d1d11364ceeb485585b4ae78871: Bootstrap complete.
I20260810 01:59:55.970387 17438 ts_tablet_manager.cc:1403] T 7207ea155ba44c0a9ba216acd22dc1b4 P 82f93d1d11364ceeb485585b4ae78871: Time spent bootstrapping tablet: real 0.208s user 0.076s sys 0.003s
I20260810 01:59:55.976773 3943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da507bc24d964ce1a5835edad5177726" candidate_uuid: "c5ed5317da9c464b93f979c405f0f6e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: true dest_uuid: "82f93d1d11364ceeb485585b4ae78871"
I20260810 01:59:55.977007 3943 raft_consensus.cc:3055] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Stepping down as leader of term 1
I20260810 01:59:55.977093 3943 raft_consensus.cc:740] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 82f93d1d11364ceeb485585b4ae78871, State: Running, Role: LEADER
I20260810 01:59:55.977515 3943 consensus_queue.cc:260] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 6, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:55.977939 3943 raft_consensus.cc:3060] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Advancing to term 2
I20260810 01:59:55.987262 17438 raft_consensus.cc:359] T 7207ea155ba44c0a9ba216acd22dc1b4 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:59:55.992455 17095 raft_consensus.cc:2955] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
I20260810 01:59:55.998314 6909 raft_consensus.cc:2955] T 4a4350cf2ece4769b8547620ac5bedcb P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
I20260810 01:59:56.000018 6739 leader_election.cc:290] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4 [CANDIDATE]: Term 2 election: Requested vote from peers dc85be7d460a404f997177f57680850f (127.21.64.193:36797), 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893), 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197:38787)
I20260810 01:59:56.002147 3943 raft_consensus.cc:2468] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ed5317da9c464b93f979c405f0f6e4 in term 2.
I20260810 01:59:55.991667 17438 raft_consensus.cc:740] T 7207ea155ba44c0a9ba216acd22dc1b4 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f93d1d11364ceeb485585b4ae78871, State: Initialized, Role: FOLLOWER
I20260810 01:59:56.007289 17438 consensus_queue.cc:260] T 7207ea155ba44c0a9ba216acd22dc1b4 P 82f93d1d11364ceeb485585b4ae78871 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 1.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 01:59:56.016003 17438 ts_tablet_manager.cc:1434] T 7207ea155ba44c0a9ba216acd22dc1b4 P 82f93d1d11364ceeb485585b4ae78871: Time spent starting tablet: real 0.045s user 0.002s sys 0.000s
I20260810 01:59:56.019317 6739 raft_consensus.cc:2955] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
I20260810 01:59:56.031090 3562 catalog_manager.cc:5719] T 4a4350cf2ece4769b8547620ac5bedcb P 3136daf7101445beadc1aa19bc01c227 reported cstate change: config changed from index 7 to 8, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) added. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
I20260810 01:59:56.037837 4337 tablet_copy_service.cc:342] P ca4469fc2dbc48488bc7ad7f482f129e: Request end of tablet copy session 82f93d1d11364ceeb485585b4ae78871-7207ea155ba44c0a9ba216acd22dc1b4 received from {username='slave'} at 127.21.64.194:37889
I20260810 01:59:56.038007 4337 tablet_copy_service.cc:434] P ca4469fc2dbc48488bc7ad7f482f129e: ending tablet copy session 82f93d1d11364ceeb485585b4ae78871-7207ea155ba44c0a9ba216acd22dc1b4 on tablet 7207ea155ba44c0a9ba216acd22dc1b4 with peer 82f93d1d11364ceeb485585b4ae78871
W20260810 01:59:56.044605 3672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.198:45317, user_credentials={real_user=slave}} blocked reactor thread for 112689us
I20260810 01:59:56.047207 6567 raft_consensus.cc:2955] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
I20260810 01:59:56.050560 3759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da507bc24d964ce1a5835edad5177726" candidate_uuid: "c5ed5317da9c464b93f979c405f0f6e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: true dest_uuid: "dc85be7d460a404f997177f57680850f"
I20260810 01:59:56.050750 3759 raft_consensus.cc:3060] T da507bc24d964ce1a5835edad5177726 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Advancing to term 2
I20260810 01:59:56.055744 3759 raft_consensus.cc:2468] T da507bc24d964ce1a5835edad5177726 P dc85be7d460a404f997177f57680850f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ed5317da9c464b93f979c405f0f6e4 in term 2.
I20260810 01:59:56.058776 6653 leader_election.cc:304] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 82f93d1d11364ceeb485585b4ae78871, c5ed5317da9c464b93f979c405f0f6e4, dc85be7d460a404f997177f57680850f; no voters:
I20260810 01:59:56.060243 17541 raft_consensus.cc:2804] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 01:59:56.060869 17541 raft_consensus.cc:697] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4 [term 2 LEADER]: Becoming Leader. State: Replica: c5ed5317da9c464b93f979c405f0f6e4, State: Running, Role: LEADER
I20260810 01:59:56.061578 17541 consensus_queue.cc:237] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 6, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:56.074772 6395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da507bc24d964ce1a5835edad5177726" candidate_uuid: "c5ed5317da9c464b93f979c405f0f6e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: true dest_uuid: "4dd4cba155c941b4b7ad4d64c7431536"
I20260810 01:59:56.074966 6395 raft_consensus.cc:3060] T da507bc24d964ce1a5835edad5177726 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Advancing to term 2
I20260810 01:59:56.075728 3943 raft_consensus.cc:1217] T 7207ea155ba44c0a9ba216acd22dc1b4 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.5->[1.6-1.6] Dedup: 1.6->[]
I20260810 01:59:56.077951 6395 raft_consensus.cc:2468] T da507bc24d964ce1a5835edad5177726 P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ed5317da9c464b93f979c405f0f6e4 in term 2.
I20260810 01:59:56.095876 3564 catalog_manager.cc:5719] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4 reported cstate change: term changed from 1 to 2, leader changed from 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) to c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199). New cstate: current_term: 2 leader_uuid: "c5ed5317da9c464b93f979c405f0f6e4" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:56.285058 3943 consensus_queue.cc:237] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:56.304208 6909 raft_consensus.cc:1275] T 8e8d13caf8054b1daf09b2b114843766 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
W20260810 01:59:56.306147 3855 consensus_peers.cc:597] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 -> Peer 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197:38787): Couldn't send request to peer 4dd4cba155c941b4b7ad4d64c7431536. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8e8d13caf8054b1daf09b2b114843766. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:56.306587 17524 consensus_queue.cc:1048] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:56.319936 4313 raft_consensus.cc:1275] T 8e8d13caf8054b1daf09b2b114843766 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:56.320911 17524 consensus_queue.cc:1048] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:56.342267 17524 raft_consensus.cc:2955] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:56.344396 4311 raft_consensus.cc:2955] T 8e8d13caf8054b1daf09b2b114843766 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:56.351769 3564 catalog_manager.cc:5719] T 8e8d13caf8054b1daf09b2b114843766 P ca4469fc2dbc48488bc7ad7f482f129e reported cstate change: config changed from index 5 to 6, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:56.375612 6907 raft_consensus.cc:2955] T 8e8d13caf8054b1daf09b2b114843766 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:56.391583 17629 ts_tablet_manager.cc:933] T 4a4350cf2ece4769b8547620ac5bedcb P ca4469fc2dbc48488bc7ad7f482f129e: Initiating tablet copy from peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 01:59:56.393421 17629 tablet_copy_client.cc:323] T 4a4350cf2ece4769b8547620ac5bedcb P ca4469fc2dbc48488bc7ad7f482f129e: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.194:43893
I20260810 01:59:56.394524 3973 tablet_copy_service.cc:140] P 82f93d1d11364ceeb485585b4ae78871: Received BeginTabletCopySession request for tablet 4a4350cf2ece4769b8547620ac5bedcb from peer ca4469fc2dbc48488bc7ad7f482f129e ({username='slave'} at 127.21.64.196:55581)
I20260810 01:59:56.394752 3973 tablet_copy_service.cc:161] P 82f93d1d11364ceeb485585b4ae78871: Beginning new tablet copy session on tablet 4a4350cf2ece4769b8547620ac5bedcb from peer ca4469fc2dbc48488bc7ad7f482f129e at {username='slave'} at 127.21.64.196:55581: session id = ca4469fc2dbc48488bc7ad7f482f129e-4a4350cf2ece4769b8547620ac5bedcb
I20260810 01:59:56.398954 3973 tablet_copy_source_session.cc:215] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:56.400760 17629 ts_tablet_manager.cc:1916] T 4a4350cf2ece4769b8547620ac5bedcb P ca4469fc2dbc48488bc7ad7f482f129e: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260810 01:59:56.407972 17629 ts_tablet_manager.cc:1929] T 4a4350cf2ece4769b8547620ac5bedcb P ca4469fc2dbc48488bc7ad7f482f129e: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.4
I20260810 01:59:56.411458 17629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a4350cf2ece4769b8547620ac5bedcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:56.420392 17629 tablet_copy_client.cc:806] T 4a4350cf2ece4769b8547620ac5bedcb P ca4469fc2dbc48488bc7ad7f482f129e: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:56.421828 17629 tablet_copy_client.cc:670] T 4a4350cf2ece4769b8547620ac5bedcb P ca4469fc2dbc48488bc7ad7f482f129e: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:56.425587 17629 tablet_copy_client.cc:538] T 4a4350cf2ece4769b8547620ac5bedcb P ca4469fc2dbc48488bc7ad7f482f129e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:56.437930 17629 tablet_bootstrap.cc:492] T 4a4350cf2ece4769b8547620ac5bedcb P ca4469fc2dbc48488bc7ad7f482f129e: Bootstrap starting.
I20260810 01:59:56.488747 6395 raft_consensus.cc:1275] T da507bc24d964ce1a5835edad5177726 P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 FOLLOWER]: Refusing update from remote peer c5ed5317da9c464b93f979c405f0f6e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 2 index: 7. (index mismatch)
I20260810 01:59:56.490000 17541 consensus_queue.cc:1048] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 01:59:56.521322 17674 ts_tablet_manager.cc:933] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e: Initiating tablet copy from peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
I20260810 01:59:56.525887 3943 raft_consensus.cc:1275] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [term 2 FOLLOWER]: Refusing update from remote peer c5ed5317da9c464b93f979c405f0f6e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 2 index: 7. (index mismatch)
I20260810 01:59:56.526763 17541 consensus_queue.cc:1048] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 01:59:56.528154 3943 consensus_queue.cc:237] T e70193bd4055469d870a76542eaef524 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 2.8, Last appended by leader: 6, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:59:56.539125 17674 tablet_copy_client.cc:323] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.193:36797
I20260810 01:59:56.542493 3787 tablet_copy_service.cc:140] P dc85be7d460a404f997177f57680850f: Received BeginTabletCopySession request for tablet 252899385eaa45b392974d2768e3cf01 from peer ca4469fc2dbc48488bc7ad7f482f129e ({username='slave'} at 127.21.64.196:44631)
I20260810 01:59:56.542694 3787 tablet_copy_service.cc:161] P dc85be7d460a404f997177f57680850f: Beginning new tablet copy session on tablet 252899385eaa45b392974d2768e3cf01 from peer ca4469fc2dbc48488bc7ad7f482f129e at {username='slave'} at 127.21.64.196:44631: session id = ca4469fc2dbc48488bc7ad7f482f129e-252899385eaa45b392974d2768e3cf01
W20260810 01:59:56.543167 3857 consensus_peers.cc:597] T e70193bd4055469d870a76542eaef524 P 82f93d1d11364ceeb485585b4ae78871 -> Peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): Couldn't send request to peer ca4469fc2dbc48488bc7ad7f482f129e. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:56.544633 6567 raft_consensus.cc:1275] T e70193bd4055469d870a76542eaef524 P 22ce0e487f0341fd9bf853393d6e7683 [term 2 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 2 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20260810 01:59:56.545591 17524 consensus_queue.cc:1048] T e70193bd4055469d870a76542eaef524 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 01:59:56.547097 6909 raft_consensus.cc:1275] T e70193bd4055469d870a76542eaef524 P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 2 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20260810 01:59:56.548764 17632 consensus_queue.cc:1048] T e70193bd4055469d870a76542eaef524 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 01:59:56.552582 3787 tablet_copy_source_session.cc:215] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:56.562075 17524 raft_consensus.cc:2955] T e70193bd4055469d870a76542eaef524 P 82f93d1d11364ceeb485585b4ae78871 [term 2 LEADER]: Committing config change with OpId 2.9: config changed from index 8 to 9, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
I20260810 01:59:56.569103 6909 raft_consensus.cc:2955] T e70193bd4055469d870a76542eaef524 P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Committing config change with OpId 2.9: config changed from index 8 to 9, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
I20260810 01:59:56.577201 6567 raft_consensus.cc:2955] T e70193bd4055469d870a76542eaef524 P 22ce0e487f0341fd9bf853393d6e7683 [term 2 FOLLOWER]: Committing config change with OpId 2.9: config changed from index 8 to 9, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
I20260810 01:59:56.584649 3568 catalog_manager.cc:5719] T e70193bd4055469d870a76542eaef524 P 82f93d1d11364ceeb485585b4ae78871 reported cstate change: config changed from index 8 to 9, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) added. New cstate: current_term: 2 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
I20260810 01:59:56.601774 17674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 252899385eaa45b392974d2768e3cf01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:56.624608 3759 raft_consensus.cc:1275] T da507bc24d964ce1a5835edad5177726 P dc85be7d460a404f997177f57680850f [term 2 FOLLOWER]: Refusing update from remote peer c5ed5317da9c464b93f979c405f0f6e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 2 index: 7. (index mismatch)
I20260810 01:59:56.625923 17541 consensus_queue.cc:1048] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 01:59:56.701547 17674 tablet_copy_client.cc:806] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:56.702333 17674 tablet_copy_client.cc:670] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:56.710079 17674 tablet_copy_client.cc:538] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:56.713862 17737 ts_tablet_manager.cc:933] T 8e8d13caf8054b1daf09b2b114843766 P 4dd4cba155c941b4b7ad4d64c7431536: Initiating tablet copy from peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 01:59:56.717818 17737 tablet_copy_client.cc:323] T 8e8d13caf8054b1daf09b2b114843766 P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.194:43893
I20260810 01:59:56.718891 3973 tablet_copy_service.cc:140] P 82f93d1d11364ceeb485585b4ae78871: Received BeginTabletCopySession request for tablet 8e8d13caf8054b1daf09b2b114843766 from peer 4dd4cba155c941b4b7ad4d64c7431536 ({username='slave'} at 127.21.64.197:54659)
I20260810 01:59:56.719097 3973 tablet_copy_service.cc:161] P 82f93d1d11364ceeb485585b4ae78871: Beginning new tablet copy session on tablet 8e8d13caf8054b1daf09b2b114843766 from peer 4dd4cba155c941b4b7ad4d64c7431536 at {username='slave'} at 127.21.64.197:54659: session id = 4dd4cba155c941b4b7ad4d64c7431536-8e8d13caf8054b1daf09b2b114843766
I20260810 01:59:56.724241 3973 tablet_copy_source_session.cc:215] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:56.732635 17737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e8d13caf8054b1daf09b2b114843766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:56.740819 17674 tablet_bootstrap.cc:492] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e: Bootstrap starting.
I20260810 01:59:56.805045 17737 tablet_copy_client.cc:806] T 8e8d13caf8054b1daf09b2b114843766 P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:56.809439 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:56.834282 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:59:56.837527 17737 tablet_copy_client.cc:670] T 8e8d13caf8054b1daf09b2b114843766 P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:56.858319 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 01:59:56.868095 17737 tablet_copy_client.cc:538] T 8e8d13caf8054b1daf09b2b114843766 P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:56.900094 17737 tablet_bootstrap.cc:492] T 8e8d13caf8054b1daf09b2b114843766 P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap starting.
I20260810 01:59:56.916563 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:56.907697 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:56.937178 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 01:59:56.941721 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:56.949618 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:56.967721 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:59:56.973217 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:59:57.011878 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:57.015820 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:59:57.056422 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:57.068624 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
W20260810 01:59:57.072454 4222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.198:45317, user_credentials={real_user=slave}} blocked reactor thread for 54593.5us
I20260810 01:59:57.133275 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:57.157130 17848 ts_tablet_manager.cc:933] T e70193bd4055469d870a76542eaef524 P ca4469fc2dbc48488bc7ad7f482f129e: Initiating tablet copy from peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 01:59:57.163439 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
W20260810 01:59:57.171802 3857 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.198:45317, user_credentials={real_user=slave}} blocked reactor thread for 47501.6us
W20260810 01:59:57.172267 3858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.199:41689, user_credentials={real_user=slave}} blocked reactor thread for 75756us
I20260810 01:59:57.288918 3945 consensus_queue.cc:237] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:57.298252 17848 tablet_copy_client.cc:323] T e70193bd4055469d870a76542eaef524 P ca4469fc2dbc48488bc7ad7f482f129e: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.194:43893
I20260810 01:59:57.299655 3973 tablet_copy_service.cc:140] P 82f93d1d11364ceeb485585b4ae78871: Received BeginTabletCopySession request for tablet e70193bd4055469d870a76542eaef524 from peer ca4469fc2dbc48488bc7ad7f482f129e ({username='slave'} at 127.21.64.196:55581)
I20260810 01:59:57.299993 3973 tablet_copy_service.cc:161] P 82f93d1d11364ceeb485585b4ae78871: Beginning new tablet copy session on tablet e70193bd4055469d870a76542eaef524 from peer ca4469fc2dbc48488bc7ad7f482f129e at {username='slave'} at 127.21.64.196:55581: session id = ca4469fc2dbc48488bc7ad7f482f129e-e70193bd4055469d870a76542eaef524
I20260810 01:59:57.304688 3973 tablet_copy_source_session.cc:215] T e70193bd4055469d870a76542eaef524 P 82f93d1d11364ceeb485585b4ae78871: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:57.306191 17848 ts_tablet_manager.cc:1916] T e70193bd4055469d870a76542eaef524 P ca4469fc2dbc48488bc7ad7f482f129e: Deleting tablet data with delete state TABLET_DATA_COPYING
W20260810 01:59:57.314446 3858 consensus_peers.cc:597] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 -> Peer c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199:41689): Couldn't send request to peer c5ed5317da9c464b93f979c405f0f6e4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b6c5892f4de449fb8cb7f4cff7eb2e20. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:57.315100 17674 tablet_bootstrap.cc:492] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:57.315769 17674 tablet_bootstrap.cc:492] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e: Bootstrap complete.
I20260810 01:59:57.315801 6567 raft_consensus.cc:1275] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260810 01:59:57.316190 17674 ts_tablet_manager.cc:1403] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e: Time spent bootstrapping tablet: real 0.575s user 0.064s sys 0.004s
I20260810 01:59:57.316795 17853 consensus_queue.cc:1048] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 01:59:57.318077 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 01:59:57.323931 6395 raft_consensus.cc:1275] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260810 01:59:57.325445 17853 consensus_queue.cc:1048] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 01:59:57.326784 17674 raft_consensus.cc:359] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:59:57.327108 17674 raft_consensus.cc:740] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca4469fc2dbc48488bc7ad7f482f129e, State: Initialized, Role: FOLLOWER
I20260810 01:59:57.327924 17674 consensus_queue.cc:260] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:59:57.328287 17629 tablet_bootstrap.cc:492] T 4a4350cf2ece4769b8547620ac5bedcb P ca4469fc2dbc48488bc7ad7f482f129e: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:57.334405 17629 tablet_bootstrap.cc:492] T 4a4350cf2ece4769b8547620ac5bedcb P ca4469fc2dbc48488bc7ad7f482f129e: Bootstrap complete.
I20260810 01:59:57.334812 17629 ts_tablet_manager.cc:1403] T 4a4350cf2ece4769b8547620ac5bedcb P ca4469fc2dbc48488bc7ad7f482f129e: Time spent bootstrapping tablet: real 0.897s user 0.061s sys 0.011s
I20260810 01:59:57.339532 17674 ts_tablet_manager.cc:1434] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e: Time spent starting tablet: real 0.023s user 0.002s sys 0.004s
I20260810 01:59:57.346563 3787 tablet_copy_service.cc:342] P dc85be7d460a404f997177f57680850f: Request end of tablet copy session ca4469fc2dbc48488bc7ad7f482f129e-252899385eaa45b392974d2768e3cf01 received from {username='slave'} at 127.21.64.196:44631
I20260810 01:59:57.346793 3787 tablet_copy_service.cc:434] P dc85be7d460a404f997177f57680850f: ending tablet copy session ca4469fc2dbc48488bc7ad7f482f129e-252899385eaa45b392974d2768e3cf01 on tablet 252899385eaa45b392974d2768e3cf01 with peer ca4469fc2dbc48488bc7ad7f482f129e
I20260810 01:59:57.347939 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:57.347939 17629 raft_consensus.cc:359] T 4a4350cf2ece4769b8547620ac5bedcb P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:59:57.348304 17629 raft_consensus.cc:740] T 4a4350cf2ece4769b8547620ac5bedcb P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca4469fc2dbc48488bc7ad7f482f129e, State: Initialized, Role: FOLLOWER
I20260810 01:59:57.353989 17629 consensus_queue.cc:260] T 4a4350cf2ece4769b8547620ac5bedcb P ca4469fc2dbc48488bc7ad7f482f129e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:59:57.363306 17629 ts_tablet_manager.cc:1434] T 4a4350cf2ece4769b8547620ac5bedcb P ca4469fc2dbc48488bc7ad7f482f129e: Time spent starting tablet: real 0.023s user 0.002s sys 0.000s
I20260810 01:59:57.372236 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:59:57.374461 3973 tablet_copy_service.cc:342] P 82f93d1d11364ceeb485585b4ae78871: Request end of tablet copy session ca4469fc2dbc48488bc7ad7f482f129e-4a4350cf2ece4769b8547620ac5bedcb received from {username='slave'} at 127.21.64.196:55581
I20260810 01:59:57.374759 3973 tablet_copy_service.cc:434] P 82f93d1d11364ceeb485585b4ae78871: ending tablet copy session ca4469fc2dbc48488bc7ad7f482f129e-4a4350cf2ece4769b8547620ac5bedcb on tablet 4a4350cf2ece4769b8547620ac5bedcb with peer ca4469fc2dbc48488bc7ad7f482f129e
I20260810 01:59:57.389812 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:57.417887 17843 raft_consensus.cc:2955] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:57.422953 6395 raft_consensus.cc:2955] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:57.424211 4313 raft_consensus.cc:1217] T 4a4350cf2ece4769b8547620ac5bedcb P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20260810 01:59:57.425019 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:57.432174 6565 raft_consensus.cc:2955] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:57.432770 3564 catalog_manager.cc:5719] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 reported cstate change: config changed from index 7 to 8, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:57.434196 17848 ts_tablet_manager.cc:1929] T e70193bd4055469d870a76542eaef524 P ca4469fc2dbc48488bc7ad7f482f129e: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.5
I20260810 01:59:57.434597 17848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e70193bd4055469d870a76542eaef524. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:57.542562 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:57.573609 17737 tablet_bootstrap.cc:492] T 8e8d13caf8054b1daf09b2b114843766 P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:57.583168 17737 tablet_bootstrap.cc:492] T 8e8d13caf8054b1daf09b2b114843766 P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap complete.
I20260810 01:59:57.583549 17737 ts_tablet_manager.cc:1403] T 8e8d13caf8054b1daf09b2b114843766 P 4dd4cba155c941b4b7ad4d64c7431536: Time spent bootstrapping tablet: real 0.684s user 0.056s sys 0.008s
I20260810 01:59:57.585759 17737 raft_consensus.cc:359] T 8e8d13caf8054b1daf09b2b114843766 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:57.585992 17737 raft_consensus.cc:740] T 8e8d13caf8054b1daf09b2b114843766 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dd4cba155c941b4b7ad4d64c7431536, State: Initialized, Role: FOLLOWER
I20260810 01:59:57.586099 4313 raft_consensus.cc:1217] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20260810 01:59:57.603253 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:57.619851 17848 tablet_copy_client.cc:806] T e70193bd4055469d870a76542eaef524 P ca4469fc2dbc48488bc7ad7f482f129e: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:57.620348 17848 tablet_copy_client.cc:670] T e70193bd4055469d870a76542eaef524 P ca4469fc2dbc48488bc7ad7f482f129e: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:57.646543 17737 consensus_queue.cc:260] T 8e8d13caf8054b1daf09b2b114843766 P 4dd4cba155c941b4b7ad4d64c7431536 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 1.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:57.647176 17737 ts_tablet_manager.cc:1434] T 8e8d13caf8054b1daf09b2b114843766 P 4dd4cba155c941b4b7ad4d64c7431536: Time spent starting tablet: real 0.064s user 0.017s sys 0.000s
I20260810 01:59:57.650013 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:59:57.685007 6397 raft_consensus.cc:1217] T 8e8d13caf8054b1daf09b2b114843766 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.5->[1.6-1.6] Dedup: 1.6->[]
I20260810 01:59:57.689802 3971 tablet_copy_service.cc:342] P 82f93d1d11364ceeb485585b4ae78871: Request end of tablet copy session 4dd4cba155c941b4b7ad4d64c7431536-8e8d13caf8054b1daf09b2b114843766 received from {username='slave'} at 127.21.64.197:54659
I20260810 01:59:57.690490 3971 tablet_copy_service.cc:434] P 82f93d1d11364ceeb485585b4ae78871: ending tablet copy session 4dd4cba155c941b4b7ad4d64c7431536-8e8d13caf8054b1daf09b2b114843766 on tablet 8e8d13caf8054b1daf09b2b114843766 with peer 4dd4cba155c941b4b7ad4d64c7431536
I20260810 01:59:57.692013 17848 tablet_copy_client.cc:538] T e70193bd4055469d870a76542eaef524 P ca4469fc2dbc48488bc7ad7f482f129e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:57.696751 17848 tablet_bootstrap.cc:492] T e70193bd4055469d870a76542eaef524 P ca4469fc2dbc48488bc7ad7f482f129e: Bootstrap starting.
I20260810 01:59:57.786612 17848 tablet_bootstrap.cc:492] T e70193bd4055469d870a76542eaef524 P ca4469fc2dbc48488bc7ad7f482f129e: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:57.787315 17848 tablet_bootstrap.cc:492] T e70193bd4055469d870a76542eaef524 P ca4469fc2dbc48488bc7ad7f482f129e: Bootstrap complete.
I20260810 01:59:57.788558 17848 ts_tablet_manager.cc:1403] T e70193bd4055469d870a76542eaef524 P ca4469fc2dbc48488bc7ad7f482f129e: Time spent bootstrapping tablet: real 0.092s user 0.057s sys 0.007s
I20260810 01:59:57.790709 17848 raft_consensus.cc:359] T e70193bd4055469d870a76542eaef524 P ca4469fc2dbc48488bc7ad7f482f129e [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:59:57.791010 17848 raft_consensus.cc:740] T e70193bd4055469d870a76542eaef524 P ca4469fc2dbc48488bc7ad7f482f129e [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca4469fc2dbc48488bc7ad7f482f129e, State: Initialized, Role: FOLLOWER
I20260810 01:59:57.806268 17848 consensus_queue.cc:260] T e70193bd4055469d870a76542eaef524 P ca4469fc2dbc48488bc7ad7f482f129e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 2.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:59:57.807247 17848 ts_tablet_manager.cc:1434] T e70193bd4055469d870a76542eaef524 P ca4469fc2dbc48488bc7ad7f482f129e: Time spent starting tablet: real 0.018s user 0.002s sys 0.000s
I20260810 01:59:57.810191 3973 tablet_copy_service.cc:342] P 82f93d1d11364ceeb485585b4ae78871: Request end of tablet copy session ca4469fc2dbc48488bc7ad7f482f129e-e70193bd4055469d870a76542eaef524 received from {username='slave'} at 127.21.64.196:55581
I20260810 01:59:57.810374 3973 tablet_copy_service.cc:434] P 82f93d1d11364ceeb485585b4ae78871: ending tablet copy session ca4469fc2dbc48488bc7ad7f482f129e-e70193bd4055469d870a76542eaef524 on tablet e70193bd4055469d870a76542eaef524 with peer ca4469fc2dbc48488bc7ad7f482f129e
I20260810 01:59:57.929283 17932 ts_tablet_manager.cc:933] T b6c5892f4de449fb8cb7f4cff7eb2e20 P c5ed5317da9c464b93f979c405f0f6e4: Initiating tablet copy from peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 01:59:57.988368 17932 tablet_copy_client.cc:323] T b6c5892f4de449fb8cb7f4cff7eb2e20 P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.194:43893
I20260810 01:59:57.989383 3973 tablet_copy_service.cc:140] P 82f93d1d11364ceeb485585b4ae78871: Received BeginTabletCopySession request for tablet b6c5892f4de449fb8cb7f4cff7eb2e20 from peer c5ed5317da9c464b93f979c405f0f6e4 ({username='slave'} at 127.21.64.199:41929)
I20260810 01:59:57.989564 3973 tablet_copy_service.cc:161] P 82f93d1d11364ceeb485585b4ae78871: Beginning new tablet copy session on tablet b6c5892f4de449fb8cb7f4cff7eb2e20 from peer c5ed5317da9c464b93f979c405f0f6e4 at {username='slave'} at 127.21.64.199:41929: session id = c5ed5317da9c464b93f979c405f0f6e4-b6c5892f4de449fb8cb7f4cff7eb2e20
I20260810 01:59:57.992803 3973 tablet_copy_source_session.cc:215] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:57.995806 17932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6c5892f4de449fb8cb7f4cff7eb2e20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:58.010769 17932 tablet_copy_client.cc:806] T b6c5892f4de449fb8cb7f4cff7eb2e20 P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:58.011066 17932 tablet_copy_client.cc:670] T b6c5892f4de449fb8cb7f4cff7eb2e20 P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:58.013280 17932 tablet_copy_client.cc:538] T b6c5892f4de449fb8cb7f4cff7eb2e20 P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:58.016652 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 01:59:58.018129 17932 tablet_bootstrap.cc:492] T b6c5892f4de449fb8cb7f4cff7eb2e20 P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap starting.
I20260810 01:59:58.097971 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:58.131474 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:59:58.139457 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:58.164372 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 01:59:58.176579 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 01:59:58.185853 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 01:59:58.250542 4313 raft_consensus.cc:1217] T e70193bd4055469d870a76542eaef524 P ca4469fc2dbc48488bc7ad7f482f129e [term 2 FOLLOWER]: Deduplicated request from leader. Original: 2.8->[2.9-2.9] Dedup: 2.9->[]
I20260810 01:59:58.266750 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 01:59:58.340379 17932 tablet_bootstrap.cc:492] T b6c5892f4de449fb8cb7f4cff7eb2e20 P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:58.345575 17932 tablet_bootstrap.cc:492] T b6c5892f4de449fb8cb7f4cff7eb2e20 P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap complete.
I20260810 01:59:58.345956 17932 ts_tablet_manager.cc:1403] T b6c5892f4de449fb8cb7f4cff7eb2e20 P c5ed5317da9c464b93f979c405f0f6e4: Time spent bootstrapping tablet: real 0.328s user 0.064s sys 0.042s
I20260810 01:59:58.347092 17932 raft_consensus.cc:359] T b6c5892f4de449fb8cb7f4cff7eb2e20 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:58.347481 17932 raft_consensus.cc:740] T b6c5892f4de449fb8cb7f4cff7eb2e20 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ed5317da9c464b93f979c405f0f6e4, State: Initialized, Role: FOLLOWER
I20260810 01:59:58.347908 17932 consensus_queue.cc:260] T b6c5892f4de449fb8cb7f4cff7eb2e20 P c5ed5317da9c464b93f979c405f0f6e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:58.351408 17932 ts_tablet_manager.cc:1434] T b6c5892f4de449fb8cb7f4cff7eb2e20 P c5ed5317da9c464b93f979c405f0f6e4: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260810 01:59:58.352591 3973 tablet_copy_service.cc:342] P 82f93d1d11364ceeb485585b4ae78871: Request end of tablet copy session c5ed5317da9c464b93f979c405f0f6e4-b6c5892f4de449fb8cb7f4cff7eb2e20 received from {username='slave'} at 127.21.64.199:41929
I20260810 01:59:58.352725 3973 tablet_copy_service.cc:434] P 82f93d1d11364ceeb485585b4ae78871: ending tablet copy session c5ed5317da9c464b93f979c405f0f6e4-b6c5892f4de449fb8cb7f4cff7eb2e20 on tablet b6c5892f4de449fb8cb7f4cff7eb2e20 with peer c5ed5317da9c464b93f979c405f0f6e4
I20260810 01:59:58.461498 6735 raft_consensus.cc:1217] T b6c5892f4de449fb8cb7f4cff7eb2e20 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20260810 01:59:58.475484 4132 consensus_queue.cc:237] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:59:58.515669 6397 raft_consensus.cc:1275] T 4fc45932b9634d6d98d8a0204d4b121a P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
W20260810 01:59:58.516465 4038 consensus_peers.cc:597] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 -> Peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): Couldn't send request to peer ca4469fc2dbc48488bc7ad7f482f129e. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:58.519588 15676 consensus_queue.cc:1048] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 01:59:58.552266 6567 raft_consensus.cc:1275] T 4fc45932b9634d6d98d8a0204d4b121a P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260810 01:59:58.553201 15676 consensus_queue.cc:1048] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 01:59:58.571141 4313 consensus_queue.cc:237] T 606ad043ee3344c39c9eef7cd1920d7e P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 01:59:58.576675 15676 raft_consensus.cc:2955] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
I20260810 01:59:58.579377 6567 raft_consensus.cc:2955] T 4fc45932b9634d6d98d8a0204d4b121a P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
I20260810 01:59:58.593823 4132 raft_consensus.cc:1275] T 606ad043ee3344c39c9eef7cd1920d7e P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:59:58.594573 17361 consensus_queue.cc:1048] T 606ad043ee3344c39c9eef7cd1920d7e P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:58.594599 6735 consensus_queue.cc:237] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 2.7, Last appended by leader: 6, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 01:59:58.596833 6909 raft_consensus.cc:1275] T 606ad043ee3344c39c9eef7cd1920d7e P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
W20260810 01:59:58.597961 4219 consensus_peers.cc:597] T 606ad043ee3344c39c9eef7cd1920d7e P ca4469fc2dbc48488bc7ad7f482f129e -> Peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797): Couldn't send request to peer dc85be7d460a404f997177f57680850f. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:58.598335 17840 consensus_queue.cc:1048] T 606ad043ee3344c39c9eef7cd1920d7e P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:59:58.604444 3564 catalog_manager.cc:5719] T 4fc45932b9634d6d98d8a0204d4b121a P 22ce0e487f0341fd9bf853393d6e7683 reported cstate change: config changed from index 7 to 8, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) added. New cstate: current_term: 1 leader_uuid: "17b49c694faf479ea2e5083470fc0302" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
I20260810 01:59:58.606213 6397 raft_consensus.cc:2955] T 4fc45932b9634d6d98d8a0204d4b121a P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
I20260810 01:59:58.610992 3759 raft_consensus.cc:1275] T da507bc24d964ce1a5835edad5177726 P dc85be7d460a404f997177f57680850f [term 2 FOLLOWER]: Refusing update from remote peer c5ed5317da9c464b93f979c405f0f6e4: Log matching property violated. Preceding OpId in replica: term: 2 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
I20260810 01:59:58.611649 6395 raft_consensus.cc:1275] T da507bc24d964ce1a5835edad5177726 P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 FOLLOWER]: Refusing update from remote peer c5ed5317da9c464b93f979c405f0f6e4: Log matching property violated. Preceding OpId in replica: term: 2 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
I20260810 01:59:58.611776 17700 consensus_queue.cc:1048] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 01:59:58.612418 17700 consensus_queue.cc:1048] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 01:59:58.640400 17700 raft_consensus.cc:2955] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4 [term 2 LEADER]: Committing config change with OpId 2.8: config changed from index 6 to 8, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:58.645547 6394 raft_consensus.cc:2955] T da507bc24d964ce1a5835edad5177726 P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 FOLLOWER]: Committing config change with OpId 2.8: config changed from index 6 to 8, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
W20260810 01:59:58.660586 18066 log.cc:927] Time spent T 606ad043ee3344c39c9eef7cd1920d7e P 3136daf7101445beadc1aa19bc01c227: Append to log took a long time: real 0.055s user 0.000s sys 0.000s
I20260810 01:59:58.662412 17840 raft_consensus.cc:2955] T 606ad043ee3344c39c9eef7cd1920d7e P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } }
I20260810 01:59:58.662827 3759 raft_consensus.cc:2955] T da507bc24d964ce1a5835edad5177726 P dc85be7d460a404f997177f57680850f [term 2 FOLLOWER]: Committing config change with OpId 2.8: config changed from index 6 to 8, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:58.667457 6909 raft_consensus.cc:2955] T 606ad043ee3344c39c9eef7cd1920d7e P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } }
I20260810 01:59:58.676254 3573 catalog_manager.cc:5719] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4 reported cstate change: config changed from index 6 to 8, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New cstate: current_term: 2 leader_uuid: "c5ed5317da9c464b93f979c405f0f6e4" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:58.677201 3572 catalog_manager.cc:5719] T 606ad043ee3344c39c9eef7cd1920d7e P 3136daf7101445beadc1aa19bc01c227 reported cstate change: config changed from index 5 to 6, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) added. New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } }
I20260810 01:59:58.689929 4132 raft_consensus.cc:2955] T 606ad043ee3344c39c9eef7cd1920d7e P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } }
I20260810 01:59:58.728946 3917 tablet_service.cc:1558] Processing DeleteTablet for tablet da507bc24d964ce1a5835edad5177726 with delete_type TABLET_DATA_TOMBSTONED (TS 82f93d1d11364ceeb485585b4ae78871 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:51288
I20260810 01:59:58.737700 18111 tablet_replica.cc:333] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871: stopping tablet replica
I20260810 01:59:58.739349 18111 raft_consensus.cc:2243] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260810 01:59:58.740639 18111 raft_consensus.cc:2272] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:58.746099 18111 ts_tablet_manager.cc:1916] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:59:58.757999 4313 consensus_queue.cc:237] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:59:58.767858 18111 ts_tablet_manager.cc:1929] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.7
I20260810 01:59:58.769434 18111 log.cc:1199] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal/wals/da507bc24d964ce1a5835edad5177726
I20260810 01:59:58.770707 3553 catalog_manager.cc:5050] TS 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): tablet da507bc24d964ce1a5835edad5177726 (table rebalance_test_table_3 [id=c515c90b2c71492f812b4df18501ee04]) successfully deleted
I20260810 01:59:58.808674 6735 raft_consensus.cc:1275] T 1d377b919f4748c88efb249dfc964f17 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260810 01:59:58.809531 17840 consensus_queue.cc:1048] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260810 01:59:58.834758 4220 consensus_peers.cc:597] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e -> Peer 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189): Couldn't send request to peer 17b49c694faf479ea2e5083470fc0302. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:58.837209 6909 raft_consensus.cc:1275] T 1d377b919f4748c88efb249dfc964f17 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260810 01:59:58.837988 17840 consensus_queue.cc:1048] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 01:59:58.866772 17361 raft_consensus.cc:2955] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } }
I20260810 01:59:58.870573 6907 raft_consensus.cc:2955] T 1d377b919f4748c88efb249dfc964f17 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } }
I20260810 01:59:58.875058 6734 raft_consensus.cc:2955] T 1d377b919f4748c88efb249dfc964f17 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } }
I20260810 01:59:58.878324 3574 catalog_manager.cc:5719] T 1d377b919f4748c88efb249dfc964f17 P 3136daf7101445beadc1aa19bc01c227 reported cstate change: config changed from index 7 to 8, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) added. New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } }
I20260810 01:59:58.995285 18179 ts_tablet_manager.cc:933] T 606ad043ee3344c39c9eef7cd1920d7e P dc85be7d460a404f997177f57680850f: Initiating tablet copy from peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943)
I20260810 01:59:59.025190 4313 consensus_queue.cc:237] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:59:59.037159 18179 tablet_copy_client.cc:323] T 606ad043ee3344c39c9eef7cd1920d7e P dc85be7d460a404f997177f57680850f: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.196:41943
I20260810 01:59:59.038481 4337 tablet_copy_service.cc:140] P ca4469fc2dbc48488bc7ad7f482f129e: Received BeginTabletCopySession request for tablet 606ad043ee3344c39c9eef7cd1920d7e from peer dc85be7d460a404f997177f57680850f ({username='slave'} at 127.21.64.193:56449)
I20260810 01:59:59.038640 4337 tablet_copy_service.cc:161] P ca4469fc2dbc48488bc7ad7f482f129e: Beginning new tablet copy session on tablet 606ad043ee3344c39c9eef7cd1920d7e from peer dc85be7d460a404f997177f57680850f at {username='slave'} at 127.21.64.193:56449: session id = dc85be7d460a404f997177f57680850f-606ad043ee3344c39c9eef7cd1920d7e
I20260810 01:59:59.041756 4337 tablet_copy_source_session.cc:215] T 606ad043ee3344c39c9eef7cd1920d7e P ca4469fc2dbc48488bc7ad7f482f129e: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:59.042863 3945 consensus_queue.cc:237] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:59.046921 18179 ts_tablet_manager.cc:1916] T 606ad043ee3344c39c9eef7cd1920d7e P dc85be7d460a404f997177f57680850f: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260810 01:59:59.057881 6909 raft_consensus.cc:1275] T a586b7d625bb4c27a6343ae7918c8cea P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
W20260810 01:59:59.058944 4220 consensus_peers.cc:597] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e -> Peer 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189): Couldn't send request to peer 17b49c694faf479ea2e5083470fc0302. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:59.059038 18140 consensus_queue.cc:1048] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 01:59:59.064710 6735 raft_consensus.cc:1275] T a586b7d625bb4c27a6343ae7918c8cea P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260810 01:59:59.064833 18179 ts_tablet_manager.cc:1929] T 606ad043ee3344c39c9eef7cd1920d7e P dc85be7d460a404f997177f57680850f: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.4
I20260810 01:59:59.065186 18179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 606ad043ee3344c39c9eef7cd1920d7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:59.065533 18140 consensus_queue.cc:1048] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 01:59:59.074291 6395 raft_consensus.cc:1275] T fe8e1f0908234e46881258cfe79835f8 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260810 01:59:59.075165 17843 consensus_queue.cc:1048] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 01:59:59.076361 6734 raft_consensus.cc:1275] T fe8e1f0908234e46881258cfe79835f8 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260810 01:59:59.077466 17853 consensus_queue.cc:1048] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 01:59:59.084090 17853 raft_consensus.cc:2955] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:59.089248 6734 raft_consensus.cc:2955] T fe8e1f0908234e46881258cfe79835f8 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:59.101723 6395 raft_consensus.cc:2955] T fe8e1f0908234e46881258cfe79835f8 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:59.111847 3574 catalog_manager.cc:5719] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 reported cstate change: config changed from index 8 to 9, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) evicted. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:59.114809 18140 raft_consensus.cc:2955] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } }
I20260810 01:59:59.118250 6907 raft_consensus.cc:2955] T a586b7d625bb4c27a6343ae7918c8cea P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } }
I20260810 01:59:59.131040 3562 catalog_manager.cc:5719] T a586b7d625bb4c27a6343ae7918c8cea P 3136daf7101445beadc1aa19bc01c227 reported cstate change: config changed from index 7 to 8, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) added. New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } }
I20260810 01:59:59.132050 18179 tablet_copy_client.cc:806] T 606ad043ee3344c39c9eef7cd1920d7e P dc85be7d460a404f997177f57680850f: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:59.132398 18179 tablet_copy_client.cc:670] T 606ad043ee3344c39c9eef7cd1920d7e P dc85be7d460a404f997177f57680850f: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:59.136492 6884 tablet_service.cc:1558] Processing DeleteTablet for tablet fe8e1f0908234e46881258cfe79835f8 with delete_type TABLET_DATA_TOMBSTONED (TS 3136daf7101445beadc1aa19bc01c227 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:41662
I20260810 01:59:59.138458 6734 raft_consensus.cc:2955] T a586b7d625bb4c27a6343ae7918c8cea P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } }
I20260810 01:59:59.155114 18179 tablet_copy_client.cc:538] T 606ad043ee3344c39c9eef7cd1920d7e P dc85be7d460a404f997177f57680850f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:59.155251 18220 ts_tablet_manager.cc:933] T 4fc45932b9634d6d98d8a0204d4b121a P ca4469fc2dbc48488bc7ad7f482f129e: Initiating tablet copy from peer 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189)
I20260810 01:59:59.156111 18228 tablet_replica.cc:333] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227: stopping tablet replica
I20260810 01:59:59.156497 18228 raft_consensus.cc:2243] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:59:59.157003 18228 raft_consensus.cc:2272] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:59:59.158120 18228 ts_tablet_manager.cc:1916] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 01:59:59.160099 18179 tablet_bootstrap.cc:492] T 606ad043ee3344c39c9eef7cd1920d7e P dc85be7d460a404f997177f57680850f: Bootstrap starting.
I20260810 01:59:59.175498 18220 tablet_copy_client.cc:323] T 4fc45932b9634d6d98d8a0204d4b121a P ca4469fc2dbc48488bc7ad7f482f129e: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.195:39189
I20260810 01:59:59.176447 4162 tablet_copy_service.cc:140] P 17b49c694faf479ea2e5083470fc0302: Received BeginTabletCopySession request for tablet 4fc45932b9634d6d98d8a0204d4b121a from peer ca4469fc2dbc48488bc7ad7f482f129e ({username='slave'} at 127.21.64.196:59127)
I20260810 01:59:59.176656 4162 tablet_copy_service.cc:161] P 17b49c694faf479ea2e5083470fc0302: Beginning new tablet copy session on tablet 4fc45932b9634d6d98d8a0204d4b121a from peer ca4469fc2dbc48488bc7ad7f482f129e at {username='slave'} at 127.21.64.196:59127: session id = ca4469fc2dbc48488bc7ad7f482f129e-4fc45932b9634d6d98d8a0204d4b121a
I20260810 01:59:59.180788 4162 tablet_copy_source_session.cc:215] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:59.182732 18220 ts_tablet_manager.cc:1916] T 4fc45932b9634d6d98d8a0204d4b121a P ca4469fc2dbc48488bc7ad7f482f129e: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260810 01:59:59.224618 18228 ts_tablet_manager.cc:1929] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20260810 01:59:59.224874 18228 log.cc:1199] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/wal/wals/fe8e1f0908234e46881258cfe79835f8
I20260810 01:59:59.225967 3551 catalog_manager.cc:5050] TS 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995): tablet fe8e1f0908234e46881258cfe79835f8 (table rebalance_test_table_4 [id=3e1f7b9b31614ed383207098de38230c]) successfully deleted
I20260810 01:59:59.226158 18220 ts_tablet_manager.cc:1929] T 4fc45932b9634d6d98d8a0204d4b121a P ca4469fc2dbc48488bc7ad7f482f129e: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.5
I20260810 01:59:59.226548 18220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fc45932b9634d6d98d8a0204d4b121a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:59.250015 3759 consensus_queue.cc:237] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
W20260810 01:59:59.255038 3673 consensus_peers.cc:597] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f -> Peer c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199:41689): Couldn't send request to peer c5ed5317da9c464b93f979c405f0f6e4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cf531b93380e43bfa103837bd6350834. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:59.255291 6395 raft_consensus.cc:1275] T cf531b93380e43bfa103837bd6350834 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260810 01:59:59.257977 17531 consensus_queue.cc:1048] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 01:59:59.273922 6567 raft_consensus.cc:1275] T cf531b93380e43bfa103837bd6350834 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260810 01:59:59.275190 17531 consensus_queue.cc:1048] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 01:59:59.280189 18220 tablet_copy_client.cc:806] T 4fc45932b9634d6d98d8a0204d4b121a P ca4469fc2dbc48488bc7ad7f482f129e: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:59.280493 18220 tablet_copy_client.cc:670] T 4fc45932b9634d6d98d8a0204d4b121a P ca4469fc2dbc48488bc7ad7f482f129e: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:59.283614 18220 tablet_copy_client.cc:538] T 4fc45932b9634d6d98d8a0204d4b121a P ca4469fc2dbc48488bc7ad7f482f129e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:59.288969 17531 raft_consensus.cc:2955] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:59.291276 18220 tablet_bootstrap.cc:492] T 4fc45932b9634d6d98d8a0204d4b121a P ca4469fc2dbc48488bc7ad7f482f129e: Bootstrap starting.
I20260810 01:59:59.296830 6395 raft_consensus.cc:2955] T cf531b93380e43bfa103837bd6350834 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:59.295683 6567 raft_consensus.cc:2955] T cf531b93380e43bfa103837bd6350834 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:59.305667 3573 catalog_manager.cc:5719] T cf531b93380e43bfa103837bd6350834 P 4dd4cba155c941b4b7ad4d64c7431536 reported cstate change: config changed from index 7 to 8, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 01:59:59.315619 18179 tablet_bootstrap.cc:492] T 606ad043ee3344c39c9eef7cd1920d7e P dc85be7d460a404f997177f57680850f: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:59.316258 18179 tablet_bootstrap.cc:492] T 606ad043ee3344c39c9eef7cd1920d7e P dc85be7d460a404f997177f57680850f: Bootstrap complete.
I20260810 01:59:59.316637 18179 ts_tablet_manager.cc:1403] T 606ad043ee3344c39c9eef7cd1920d7e P dc85be7d460a404f997177f57680850f: Time spent bootstrapping tablet: real 0.157s user 0.071s sys 0.017s
I20260810 01:59:59.366437 18179 raft_consensus.cc:359] T 606ad043ee3344c39c9eef7cd1920d7e P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 01:59:59.366747 18179 raft_consensus.cc:740] T 606ad043ee3344c39c9eef7cd1920d7e P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc85be7d460a404f997177f57680850f, State: Initialized, Role: FOLLOWER
I20260810 01:59:59.370831 6909 consensus_queue.cc:237] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 2.8, Last appended by leader: 5, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:59:59.383018 18305 ts_tablet_manager.cc:933] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302: Initiating tablet copy from peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943)
W20260810 01:59:59.384819 6825 consensus_peers.cc:597] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227 -> Peer 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189): Couldn't send request to peer 17b49c694faf479ea2e5083470fc0302. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:59.384932 6395 raft_consensus.cc:1275] T d05e147199e44b8ca712e18d22e7cce7 P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 FOLLOWER]: Refusing update from remote peer 3136daf7101445beadc1aa19bc01c227: Log matching property violated. Preceding OpId in replica: term: 2 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20260810 01:59:59.385237 18179 consensus_queue.cc:260] T 606ad043ee3344c39c9eef7cd1920d7e P dc85be7d460a404f997177f57680850f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 1.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 01:59:59.385911 12842 consensus_queue.cc:1048] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 01:59:59.386574 18179 ts_tablet_manager.cc:1434] T 606ad043ee3344c39c9eef7cd1920d7e P dc85be7d460a404f997177f57680850f: Time spent starting tablet: real 0.070s user 0.003s sys 0.002s
I20260810 01:59:59.387291 4337 tablet_copy_service.cc:342] P ca4469fc2dbc48488bc7ad7f482f129e: Request end of tablet copy session dc85be7d460a404f997177f57680850f-606ad043ee3344c39c9eef7cd1920d7e received from {username='slave'} at 127.21.64.193:56449
I20260810 01:59:59.387468 4337 tablet_copy_service.cc:434] P ca4469fc2dbc48488bc7ad7f482f129e: ending tablet copy session dc85be7d460a404f997177f57680850f-606ad043ee3344c39c9eef7cd1920d7e on tablet 606ad043ee3344c39c9eef7cd1920d7e with peer dc85be7d460a404f997177f57680850f
I20260810 01:59:59.400727 4313 consensus_queue.cc:237] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 01:59:59.418188 18305 tablet_copy_client.cc:323] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.196:41943
I20260810 01:59:59.419215 4337 tablet_copy_service.cc:140] P ca4469fc2dbc48488bc7ad7f482f129e: Received BeginTabletCopySession request for tablet 1d377b919f4748c88efb249dfc964f17 from peer 17b49c694faf479ea2e5083470fc0302 ({username='slave'} at 127.21.64.195:60281)
I20260810 01:59:59.419442 4337 tablet_copy_service.cc:161] P ca4469fc2dbc48488bc7ad7f482f129e: Beginning new tablet copy session on tablet 1d377b919f4748c88efb249dfc964f17 from peer 17b49c694faf479ea2e5083470fc0302 at {username='slave'} at 127.21.64.195:60281: session id = 17b49c694faf479ea2e5083470fc0302-1d377b919f4748c88efb249dfc964f17
I20260810 01:59:59.423460 4337 tablet_copy_source_session.cc:215] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:59.425290 18305 ts_tablet_manager.cc:1916] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260810 01:59:59.430635 6567 raft_consensus.cc:1275] T 0afbd7afdd834537b15c727355724562 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260810 01:59:59.431576 18140 consensus_queue.cc:1048] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 01:59:59.449035 18305 ts_tablet_manager.cc:1929] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.6
I20260810 01:59:59.454075 3759 raft_consensus.cc:1275] T d05e147199e44b8ca712e18d22e7cce7 P dc85be7d460a404f997177f57680850f [term 2 FOLLOWER]: Refusing update from remote peer 3136daf7101445beadc1aa19bc01c227: Log matching property violated. Preceding OpId in replica: term: 2 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20260810 01:59:59.454411 18305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d377b919f4748c88efb249dfc964f17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:59.454885 18318 consensus_queue.cc:1048] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 01:59:59.461563 6909 raft_consensus.cc:1275] T 0afbd7afdd834537b15c727355724562 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260810 01:59:59.465437 18305 tablet_copy_client.cc:806] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:59.465797 18305 tablet_copy_client.cc:670] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:59.472625 18140 consensus_queue.cc:1048] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 01:59:59.475430 18335 ts_tablet_manager.cc:933] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302: Initiating tablet copy from peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943)
I20260810 01:59:59.483381 18305 tablet_copy_client.cc:538] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:59.486636 17361 raft_consensus.cc:2955] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:59.492218 18305 tablet_bootstrap.cc:492] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302: Bootstrap starting.
I20260810 01:59:59.499199 6907 raft_consensus.cc:2955] T 0afbd7afdd834537b15c727355724562 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:59.513440 18318 raft_consensus.cc:2955] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227 [term 2 LEADER]: Committing config change with OpId 2.9: config changed from index 8 to 9, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } }
W20260810 01:59:59.514088 4219 consensus_peers.cc:597] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e -> Peer 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197:38787): Couldn't send request to peer 4dd4cba155c941b4b7ad4d64c7431536. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0afbd7afdd834537b15c727355724562. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:59:59.518317 3759 raft_consensus.cc:2955] T d05e147199e44b8ca712e18d22e7cce7 P dc85be7d460a404f997177f57680850f [term 2 FOLLOWER]: Committing config change with OpId 2.9: config changed from index 8 to 9, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } }
I20260810 01:59:59.520849 3574 catalog_manager.cc:5719] T 0afbd7afdd834537b15c727355724562 P 3136daf7101445beadc1aa19bc01c227 reported cstate change: config changed from index 7 to 8, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:59.520952 6395 raft_consensus.cc:2955] T d05e147199e44b8ca712e18d22e7cce7 P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 FOLLOWER]: Committing config change with OpId 2.9: config changed from index 8 to 9, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } }
I20260810 01:59:59.525830 6567 raft_consensus.cc:2955] T 0afbd7afdd834537b15c727355724562 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 01:59:59.526997 3573 catalog_manager.cc:5719] T d05e147199e44b8ca712e18d22e7cce7 P dc85be7d460a404f997177f57680850f reported cstate change: config changed from index 8 to 9, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) added. New cstate: current_term: 2 leader_uuid: "3136daf7101445beadc1aa19bc01c227" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } }
I20260810 01:59:59.531760 18335 tablet_copy_client.cc:323] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.196:41943
I20260810 01:59:59.532869 4337 tablet_copy_service.cc:140] P ca4469fc2dbc48488bc7ad7f482f129e: Received BeginTabletCopySession request for tablet a586b7d625bb4c27a6343ae7918c8cea from peer 17b49c694faf479ea2e5083470fc0302 ({username='slave'} at 127.21.64.195:60281)
I20260810 01:59:59.533052 4337 tablet_copy_service.cc:161] P ca4469fc2dbc48488bc7ad7f482f129e: Beginning new tablet copy session on tablet a586b7d625bb4c27a6343ae7918c8cea from peer 17b49c694faf479ea2e5083470fc0302 at {username='slave'} at 127.21.64.195:60281: session id = 17b49c694faf479ea2e5083470fc0302-a586b7d625bb4c27a6343ae7918c8cea
I20260810 01:59:59.536165 4337 tablet_copy_source_session.cc:215] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:59.536903 3759 raft_consensus.cc:1217] T 606ad043ee3344c39c9eef7cd1920d7e P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.5->[1.6-1.6] Dedup: 1.6->[]
I20260810 01:59:59.537389 18335 ts_tablet_manager.cc:1916] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260810 01:59:59.553865 18335 ts_tablet_manager.cc:1929] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.5
I20260810 01:59:59.555294 18335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a586b7d625bb4c27a6343ae7918c8cea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:59.559607 18335 tablet_copy_client.cc:806] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:59.559880 18335 tablet_copy_client.cc:670] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:59.562300 18335 tablet_copy_client.cc:538] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:59.566783 18335 tablet_bootstrap.cc:492] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302: Bootstrap starting.
I20260810 01:59:59.640641 18335 tablet_bootstrap.cc:492] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:59.641307 18335 tablet_bootstrap.cc:492] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302: Bootstrap complete.
I20260810 01:59:59.641676 18335 ts_tablet_manager.cc:1403] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302: Time spent bootstrapping tablet: real 0.075s user 0.053s sys 0.011s
I20260810 01:59:59.642776 18335 raft_consensus.cc:359] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:59:59.643038 18335 raft_consensus.cc:740] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17b49c694faf479ea2e5083470fc0302, State: Initialized, Role: FOLLOWER
I20260810 01:59:59.643424 18335 consensus_queue.cc:260] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:59:59.644183 18335 ts_tablet_manager.cc:1434] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 01:59:59.645087 4337 tablet_copy_service.cc:342] P ca4469fc2dbc48488bc7ad7f482f129e: Request end of tablet copy session 17b49c694faf479ea2e5083470fc0302-a586b7d625bb4c27a6343ae7918c8cea received from {username='slave'} at 127.21.64.195:60281
I20260810 01:59:59.645268 4337 tablet_copy_service.cc:434] P ca4469fc2dbc48488bc7ad7f482f129e: ending tablet copy session 17b49c694faf479ea2e5083470fc0302-a586b7d625bb4c27a6343ae7918c8cea on tablet a586b7d625bb4c27a6343ae7918c8cea with peer 17b49c694faf479ea2e5083470fc0302
I20260810 01:59:59.661278 18305 tablet_bootstrap.cc:492] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:59.661823 18305 tablet_bootstrap.cc:492] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302: Bootstrap complete.
I20260810 01:59:59.662154 18305 ts_tablet_manager.cc:1403] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302: Time spent bootstrapping tablet: real 0.170s user 0.066s sys 0.001s
I20260810 01:59:59.663015 18305 raft_consensus.cc:359] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:59:59.663249 18305 raft_consensus.cc:740] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17b49c694faf479ea2e5083470fc0302, State: Initialized, Role: FOLLOWER
I20260810 01:59:59.663563 18305 consensus_queue.cc:260] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 01:59:59.664181 18305 ts_tablet_manager.cc:1434] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 01:59:59.665092 4337 tablet_copy_service.cc:342] P ca4469fc2dbc48488bc7ad7f482f129e: Request end of tablet copy session 17b49c694faf479ea2e5083470fc0302-1d377b919f4748c88efb249dfc964f17 received from {username='slave'} at 127.21.64.195:60281
I20260810 01:59:59.665269 4337 tablet_copy_service.cc:434] P ca4469fc2dbc48488bc7ad7f482f129e: ending tablet copy session 17b49c694faf479ea2e5083470fc0302-1d377b919f4748c88efb249dfc964f17 on tablet 1d377b919f4748c88efb249dfc964f17 with peer 17b49c694faf479ea2e5083470fc0302
I20260810 01:59:59.720825 18220 tablet_bootstrap.cc:492] T 4fc45932b9634d6d98d8a0204d4b121a P ca4469fc2dbc48488bc7ad7f482f129e: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:59:59.721654 18220 tablet_bootstrap.cc:492] T 4fc45932b9634d6d98d8a0204d4b121a P ca4469fc2dbc48488bc7ad7f482f129e: Bootstrap complete.
I20260810 01:59:59.722062 18384 ts_tablet_manager.cc:933] T cf531b93380e43bfa103837bd6350834 P c5ed5317da9c464b93f979c405f0f6e4: Initiating tablet copy from peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
I20260810 01:59:59.722092 18220 ts_tablet_manager.cc:1403] T 4fc45932b9634d6d98d8a0204d4b121a P ca4469fc2dbc48488bc7ad7f482f129e: Time spent bootstrapping tablet: real 0.431s user 0.065s sys 0.008s
I20260810 01:59:59.723160 18220 raft_consensus.cc:359] T 4fc45932b9634d6d98d8a0204d4b121a P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:59:59.723438 18220 raft_consensus.cc:740] T 4fc45932b9634d6d98d8a0204d4b121a P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca4469fc2dbc48488bc7ad7f482f129e, State: Initialized, Role: FOLLOWER
I20260810 01:59:59.723819 18220 consensus_queue.cc:260] T 4fc45932b9634d6d98d8a0204d4b121a P ca4469fc2dbc48488bc7ad7f482f129e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 01:59:59.725273 18220 ts_tablet_manager.cc:1434] T 4fc45932b9634d6d98d8a0204d4b121a P ca4469fc2dbc48488bc7ad7f482f129e: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 01:59:59.726209 4162 tablet_copy_service.cc:342] P 17b49c694faf479ea2e5083470fc0302: Request end of tablet copy session ca4469fc2dbc48488bc7ad7f482f129e-4fc45932b9634d6d98d8a0204d4b121a received from {username='slave'} at 127.21.64.196:59127
I20260810 01:59:59.726383 4162 tablet_copy_service.cc:434] P 17b49c694faf479ea2e5083470fc0302: ending tablet copy session ca4469fc2dbc48488bc7ad7f482f129e-4fc45932b9634d6d98d8a0204d4b121a on tablet 4fc45932b9634d6d98d8a0204d4b121a with peer ca4469fc2dbc48488bc7ad7f482f129e
I20260810 01:59:59.767256 18384 tablet_copy_client.cc:323] T cf531b93380e43bfa103837bd6350834 P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.193:36797
I20260810 01:59:59.768258 3787 tablet_copy_service.cc:140] P dc85be7d460a404f997177f57680850f: Received BeginTabletCopySession request for tablet cf531b93380e43bfa103837bd6350834 from peer c5ed5317da9c464b93f979c405f0f6e4 ({username='slave'} at 127.21.64.199:59819)
I20260810 01:59:59.768467 3787 tablet_copy_service.cc:161] P dc85be7d460a404f997177f57680850f: Beginning new tablet copy session on tablet cf531b93380e43bfa103837bd6350834 from peer c5ed5317da9c464b93f979c405f0f6e4 at {username='slave'} at 127.21.64.199:59819: session id = c5ed5317da9c464b93f979c405f0f6e4-cf531b93380e43bfa103837bd6350834
I20260810 01:59:59.773523 3787 tablet_copy_source_session.cc:215] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:59.776901 18384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf531b93380e43bfa103837bd6350834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:59.806509 18384 tablet_copy_client.cc:806] T cf531b93380e43bfa103837bd6350834 P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:59.806787 18384 tablet_copy_client.cc:670] T cf531b93380e43bfa103837bd6350834 P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:59.812098 18384 tablet_copy_client.cc:538] T cf531b93380e43bfa103837bd6350834 P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:59.820962 18384 tablet_bootstrap.cc:492] T cf531b93380e43bfa103837bd6350834 P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap starting.
I20260810 01:59:59.884585 18413 ts_tablet_manager.cc:933] T 0afbd7afdd834537b15c727355724562 P 4dd4cba155c941b4b7ad4d64c7431536: Initiating tablet copy from peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943)
I20260810 01:59:59.886891 4132 raft_consensus.cc:1217] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20260810 01:59:59.900734 18413 tablet_copy_client.cc:323] T 0afbd7afdd834537b15c727355724562 P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.196:41943
I20260810 01:59:59.909446 4132 raft_consensus.cc:1217] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20260810 01:59:59.911685 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 01:59:59.959594 4337 tablet_copy_service.cc:140] P ca4469fc2dbc48488bc7ad7f482f129e: Received BeginTabletCopySession request for tablet 0afbd7afdd834537b15c727355724562 from peer 4dd4cba155c941b4b7ad4d64c7431536 ({username='slave'} at 127.21.64.197:55001)
I20260810 01:59:59.959827 4337 tablet_copy_service.cc:161] P ca4469fc2dbc48488bc7ad7f482f129e: Beginning new tablet copy session on tablet 0afbd7afdd834537b15c727355724562 from peer 4dd4cba155c941b4b7ad4d64c7431536 at {username='slave'} at 127.21.64.197:55001: session id = 4dd4cba155c941b4b7ad4d64c7431536-0afbd7afdd834537b15c727355724562
I20260810 01:59:59.963831 4337 tablet_copy_source_session.cc:215] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:59:59.965940 18413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0afbd7afdd834537b15c727355724562. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:59:59.979966 18413 tablet_copy_client.cc:806] T 0afbd7afdd834537b15c727355724562 P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Starting download of 0 data blocks...
I20260810 01:59:59.980221 18413 tablet_copy_client.cc:670] T 0afbd7afdd834537b15c727355724562 P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Starting download of 1 WAL segments...
I20260810 01:59:59.985275 18413 tablet_copy_client.cc:538] T 0afbd7afdd834537b15c727355724562 P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:59:59.994459 3945 consensus_queue.cc:237] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 02:00:00.000347 18305 ts_tablet_manager.cc:933] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302: Initiating tablet copy from peer 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995)
I20260810 02:00:00.004915 18413 tablet_bootstrap.cc:492] T 0afbd7afdd834537b15c727355724562 P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap starting.
I20260810 02:00:00.013945 18305 tablet_copy_client.cc:323] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.200:32995
I20260810 02:00:00.014971 6937 tablet_copy_service.cc:140] P 3136daf7101445beadc1aa19bc01c227: Received BeginTabletCopySession request for tablet d05e147199e44b8ca712e18d22e7cce7 from peer 17b49c694faf479ea2e5083470fc0302 ({username='slave'} at 127.21.64.195:50491)
I20260810 02:00:00.015197 6937 tablet_copy_service.cc:161] P 3136daf7101445beadc1aa19bc01c227: Beginning new tablet copy session on tablet d05e147199e44b8ca712e18d22e7cce7 from peer 17b49c694faf479ea2e5083470fc0302 at {username='slave'} at 127.21.64.195:50491: session id = 17b49c694faf479ea2e5083470fc0302-d05e147199e44b8ca712e18d22e7cce7
I20260810 02:00:00.021217 6734 raft_consensus.cc:1275] T 18a93b1a1ce1440b99bdd7a3bcf49064 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260810 02:00:00.021699 6907 raft_consensus.cc:1275] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260810 02:00:00.023092 17843 consensus_queue.cc:1048] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 02:00:00.023756 17843 consensus_queue.cc:1048] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 02:00:00.026703 4313 raft_consensus.cc:1217] T 4fc45932b9634d6d98d8a0204d4b121a P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20260810 02:00:00.029207 6937 tablet_copy_source_session.cc:215] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 02:00:00.040436 18305 ts_tablet_manager.cc:1916] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260810 02:00:00.069885 18305 ts_tablet_manager.cc:1929] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 2.6
W20260810 02:00:00.100517 3856 consensus_peers.cc:597] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871 -> Peer 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189): Couldn't send request to peer 17b49c694faf479ea2e5083470fc0302. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 02:00:00.103411 17843 raft_consensus.cc:2955] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } }
I20260810 02:00:00.104269 6735 raft_consensus.cc:2955] T 18a93b1a1ce1440b99bdd7a3bcf49064 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } }
I20260810 02:00:00.111838 3568 catalog_manager.cc:5719] T 18a93b1a1ce1440b99bdd7a3bcf49064 P c5ed5317da9c464b93f979c405f0f6e4 reported cstate change: config changed from index 7 to 8, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) added. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } }
I20260810 02:00:00.116533 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
W20260810 02:00:00.144227 18384 log.cc:927] Time spent T cf531b93380e43bfa103837bd6350834 P c5ed5317da9c464b93f979c405f0f6e4: Append to log took a long time: real 0.078s user 0.001s sys 0.000s
I20260810 02:00:00.148582 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:00.163897 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:00.183610 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:00.184798 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:00.195254 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:00.224852 18305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d05e147199e44b8ca712e18d22e7cce7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 02:00:00.238745 6907 raft_consensus.cc:2955] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } }
I20260810 02:00:00.268707 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:00.298933 18384 tablet_bootstrap.cc:492] T cf531b93380e43bfa103837bd6350834 P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 02:00:00.299384 18384 tablet_bootstrap.cc:492] T cf531b93380e43bfa103837bd6350834 P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap complete.
I20260810 02:00:00.299688 18384 ts_tablet_manager.cc:1403] T cf531b93380e43bfa103837bd6350834 P c5ed5317da9c464b93f979c405f0f6e4: Time spent bootstrapping tablet: real 0.479s user 0.063s sys 0.026s
I20260810 02:00:00.311201 18384 raft_consensus.cc:359] T cf531b93380e43bfa103837bd6350834 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 02:00:00.311496 18384 raft_consensus.cc:740] T cf531b93380e43bfa103837bd6350834 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ed5317da9c464b93f979c405f0f6e4, State: Initialized, Role: FOLLOWER
I20260810 02:00:00.311780 18384 consensus_queue.cc:260] T cf531b93380e43bfa103837bd6350834 P c5ed5317da9c464b93f979c405f0f6e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 02:00:00.312625 18384 ts_tablet_manager.cc:1434] T cf531b93380e43bfa103837bd6350834 P c5ed5317da9c464b93f979c405f0f6e4: Time spent starting tablet: real 0.013s user 0.003s sys 0.000s
I20260810 02:00:00.317937 3787 tablet_copy_service.cc:342] P dc85be7d460a404f997177f57680850f: Request end of tablet copy session c5ed5317da9c464b93f979c405f0f6e4-cf531b93380e43bfa103837bd6350834 received from {username='slave'} at 127.21.64.199:59819
I20260810 02:00:00.318111 3787 tablet_copy_service.cc:434] P dc85be7d460a404f997177f57680850f: ending tablet copy session c5ed5317da9c464b93f979c405f0f6e4-cf531b93380e43bfa103837bd6350834 on tablet cf531b93380e43bfa103837bd6350834 with peer c5ed5317da9c464b93f979c405f0f6e4
I20260810 02:00:00.329676 18305 tablet_copy_client.cc:806] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302: tablet copy: Starting download of 0 data blocks...
I20260810 02:00:00.330178 18305 tablet_copy_client.cc:670] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302: tablet copy: Starting download of 1 WAL segments...
I20260810 02:00:00.333259 18305 tablet_copy_client.cc:538] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 02:00:00.360025 18305 tablet_bootstrap.cc:492] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302: Bootstrap starting.
I20260810 02:00:00.429487 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:00.435580 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:00.437580 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:00.441241 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:00.529058 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:00.552079 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:00.577513 18567 ts_tablet_manager.cc:933] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302: Initiating tablet copy from peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 02:00:00.588105 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:00.588410 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:00.624181 18413 tablet_bootstrap.cc:492] T 0afbd7afdd834537b15c727355724562 P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 02:00:00.629839 18413 tablet_bootstrap.cc:492] T 0afbd7afdd834537b15c727355724562 P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap complete.
I20260810 02:00:00.630283 18413 ts_tablet_manager.cc:1403] T 0afbd7afdd834537b15c727355724562 P 4dd4cba155c941b4b7ad4d64c7431536: Time spent bootstrapping tablet: real 0.625s user 0.055s sys 0.020s
I20260810 02:00:00.638851 6735 raft_consensus.cc:1217] T cf531b93380e43bfa103837bd6350834 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20260810 02:00:00.639307 18413 raft_consensus.cc:359] T 0afbd7afdd834537b15c727355724562 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 02:00:00.639622 18413 raft_consensus.cc:740] T 0afbd7afdd834537b15c727355724562 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dd4cba155c941b4b7ad4d64c7431536, State: Initialized, Role: FOLLOWER
I20260810 02:00:00.640093 18413 consensus_queue.cc:260] T 0afbd7afdd834537b15c727355724562 P 4dd4cba155c941b4b7ad4d64c7431536 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 02:00:00.654268 18413 ts_tablet_manager.cc:1434] T 0afbd7afdd834537b15c727355724562 P 4dd4cba155c941b4b7ad4d64c7431536: Time spent starting tablet: real 0.018s user 0.002s sys 0.000s
I20260810 02:00:00.655177 4337 tablet_copy_service.cc:342] P ca4469fc2dbc48488bc7ad7f482f129e: Request end of tablet copy session 4dd4cba155c941b4b7ad4d64c7431536-0afbd7afdd834537b15c727355724562 received from {username='slave'} at 127.21.64.197:55001
I20260810 02:00:00.655325 4337 tablet_copy_service.cc:434] P ca4469fc2dbc48488bc7ad7f482f129e: ending tablet copy session 4dd4cba155c941b4b7ad4d64c7431536-0afbd7afdd834537b15c727355724562 on tablet 0afbd7afdd834537b15c727355724562 with peer 4dd4cba155c941b4b7ad4d64c7431536
I20260810 02:00:00.663517 18567 tablet_copy_client.cc:323] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.194:43893
I20260810 02:00:00.664346 3973 tablet_copy_service.cc:140] P 82f93d1d11364ceeb485585b4ae78871: Received BeginTabletCopySession request for tablet 18a93b1a1ce1440b99bdd7a3bcf49064 from peer 17b49c694faf479ea2e5083470fc0302 ({username='slave'} at 127.21.64.195:35335)
I20260810 02:00:00.664492 3973 tablet_copy_service.cc:161] P 82f93d1d11364ceeb485585b4ae78871: Beginning new tablet copy session on tablet 18a93b1a1ce1440b99bdd7a3bcf49064 from peer 17b49c694faf479ea2e5083470fc0302 at {username='slave'} at 127.21.64.195:35335: session id = 17b49c694faf479ea2e5083470fc0302-18a93b1a1ce1440b99bdd7a3bcf49064
I20260810 02:00:00.667891 3973 tablet_copy_source_session.cc:215] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 02:00:00.678792 18567 ts_tablet_manager.cc:1916] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260810 02:00:00.698032 18305 tablet_bootstrap.cc:492] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 02:00:00.698627 18305 tablet_bootstrap.cc:492] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302: Bootstrap complete.
I20260810 02:00:00.698961 18305 ts_tablet_manager.cc:1403] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302: Time spent bootstrapping tablet: real 0.339s user 0.061s sys 0.021s
I20260810 02:00:00.700356 18305 raft_consensus.cc:359] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 02:00:00.700860 18305 raft_consensus.cc:740] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17b49c694faf479ea2e5083470fc0302, State: Initialized, Role: FOLLOWER
I20260810 02:00:00.701393 18305 consensus_queue.cc:260] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 2.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 02:00:00.706676 18305 ts_tablet_manager.cc:1434] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302: Time spent starting tablet: real 0.008s user 0.000s sys 0.003s
I20260810 02:00:00.707403 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:00.717085 6937 tablet_copy_service.cc:342] P 3136daf7101445beadc1aa19bc01c227: Request end of tablet copy session 17b49c694faf479ea2e5083470fc0302-d05e147199e44b8ca712e18d22e7cce7 received from {username='slave'} at 127.21.64.195:50491
I20260810 02:00:00.717406 6937 tablet_copy_service.cc:434] P 3136daf7101445beadc1aa19bc01c227: ending tablet copy session 17b49c694faf479ea2e5083470fc0302-d05e147199e44b8ca712e18d22e7cce7 on tablet d05e147199e44b8ca712e18d22e7cce7 with peer 17b49c694faf479ea2e5083470fc0302
I20260810 02:00:00.764830 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:00.796623 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:00.816944 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:00.818529 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:00.831771 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:00.836385 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:00.869175 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:00.886607 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:00.892447 6397 raft_consensus.cc:1217] T 0afbd7afdd834537b15c727355724562 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20260810 02:00:00.917429 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:00.936340 4132 raft_consensus.cc:1217] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302 [term 2 FOLLOWER]: Deduplicated request from leader. Original: 2.8->[2.9-2.9] Dedup: 2.9->[]
I20260810 02:00:00.950026 18567 ts_tablet_manager.cc:1929] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.6
I20260810 02:00:00.950487 18567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18a93b1a1ce1440b99bdd7a3bcf49064. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 02:00:00.980963 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:00.987603 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:00.989753 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:01.032419 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:01.043442 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:01.053231 18567 tablet_copy_client.cc:806] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302: tablet copy: Starting download of 0 data blocks...
I20260810 02:00:01.056509 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:01.056910 18567 tablet_copy_client.cc:670] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302: tablet copy: Starting download of 1 WAL segments...
I20260810 02:00:01.152781 18567 tablet_copy_client.cc:538] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 02:00:01.189839 18567 tablet_bootstrap.cc:492] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302: Bootstrap starting.
I20260810 02:00:01.401546 18567 tablet_bootstrap.cc:492] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 02:00:01.402308 18567 tablet_bootstrap.cc:492] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302: Bootstrap complete.
I20260810 02:00:01.402805 18567 ts_tablet_manager.cc:1403] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302: Time spent bootstrapping tablet: real 0.213s user 0.049s sys 0.010s
I20260810 02:00:01.404524 18567 raft_consensus.cc:359] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 02:00:01.406562 18567 raft_consensus.cc:740] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17b49c694faf479ea2e5083470fc0302, State: Initialized, Role: FOLLOWER
I20260810 02:00:01.407173 18567 consensus_queue.cc:260] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 02:00:01.408389 18567 ts_tablet_manager.cc:1434] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260810 02:00:01.417191 3973 tablet_copy_service.cc:342] P 82f93d1d11364ceeb485585b4ae78871: Request end of tablet copy session 17b49c694faf479ea2e5083470fc0302-18a93b1a1ce1440b99bdd7a3bcf49064 received from {username='slave'} at 127.21.64.195:35335
I20260810 02:00:01.417383 3973 tablet_copy_service.cc:434] P 82f93d1d11364ceeb485585b4ae78871: ending tablet copy session 17b49c694faf479ea2e5083470fc0302-18a93b1a1ce1440b99bdd7a3bcf49064 on tablet 18a93b1a1ce1440b99bdd7a3bcf49064 with peer 17b49c694faf479ea2e5083470fc0302
I20260810 02:00:01.542665 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:01.544612 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:01.607156 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:01.644459 4132 raft_consensus.cc:1217] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20260810 02:00:01.694662 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:01.697945 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:01.730444 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:01.732610 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:01.747587 3945 consensus_queue.cc:237] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 02:00:01.789413 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:01.793429 6907 raft_consensus.cc:1275] T 8e8d13caf8054b1daf09b2b114843766 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 02:00:01.798759 18514 consensus_queue.cc:1048] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 02:00:01.842654 17843 raft_consensus.cc:2955] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:01.844179 6907 raft_consensus.cc:2955] T 8e8d13caf8054b1daf09b2b114843766 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:01.850664 3572 catalog_manager.cc:5719] T 8e8d13caf8054b1daf09b2b114843766 P 3136daf7101445beadc1aa19bc01c227 reported cstate change: config changed from index 6 to 7, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:01.885236 6397 raft_consensus.cc:1275] T 8e8d13caf8054b1daf09b2b114843766 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 02:00:01.903362 18514 consensus_queue.cc:1048] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 02:00:01.934592 6397 raft_consensus.cc:2955] T 8e8d13caf8054b1daf09b2b114843766 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:01.977835 4286 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e8d13caf8054b1daf09b2b114843766 with delete_type TABLET_DATA_TOMBSTONED (TS ca4469fc2dbc48488bc7ad7f482f129e not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:40788
I20260810 02:00:01.995041 18798 tablet_replica.cc:333] T 8e8d13caf8054b1daf09b2b114843766 P ca4469fc2dbc48488bc7ad7f482f129e: stopping tablet replica
I20260810 02:00:01.995416 18798 raft_consensus.cc:2243] T 8e8d13caf8054b1daf09b2b114843766 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:01.995741 18798 raft_consensus.cc:2272] T 8e8d13caf8054b1daf09b2b114843766 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:01.997398 18798 ts_tablet_manager.cc:1916] T 8e8d13caf8054b1daf09b2b114843766 P ca4469fc2dbc48488bc7ad7f482f129e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 02:00:02.012912 18798 ts_tablet_manager.cc:1929] T 8e8d13caf8054b1daf09b2b114843766 P ca4469fc2dbc48488bc7ad7f482f129e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20260810 02:00:02.013175 18798 log.cc:1199] T 8e8d13caf8054b1daf09b2b114843766 P ca4469fc2dbc48488bc7ad7f482f129e: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal/wals/8e8d13caf8054b1daf09b2b114843766
I20260810 02:00:02.021579 3553 catalog_manager.cc:5050] TS ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): tablet 8e8d13caf8054b1daf09b2b114843766 (table rebalance_test_table_9 [id=372310cb713644ada1071e8eb628b0c9]) successfully deleted
I20260810 02:00:02.046598 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:02.075896 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:02.094870 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:02.104313 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:02.125751 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:02.128989 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:02.130111 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:02.220961 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:02.325971 3945 consensus_queue.cc:237] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
W20260810 02:00:02.337960 3855 consensus_peers.cc:597] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 -> Peer 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995): Couldn't send request to peer 3136daf7101445beadc1aa19bc01c227. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 02:00:02.339123 6397 raft_consensus.cc:1275] T fe8e1f0908234e46881258cfe79835f8 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260810 02:00:02.339818 18514 consensus_queue.cc:1048] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260810 02:00:02.343924 6734 raft_consensus.cc:1275] T fe8e1f0908234e46881258cfe79835f8 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260810 02:00:02.344578 17843 consensus_queue.cc:1048] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260810 02:00:02.385057 17843 raft_consensus.cc:2955] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:02.392695 6734 raft_consensus.cc:2955] T fe8e1f0908234e46881258cfe79835f8 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:02.396549 6395 raft_consensus.cc:2955] T fe8e1f0908234e46881258cfe79835f8 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:02.405860 3562 catalog_manager.cc:5719] T fe8e1f0908234e46881258cfe79835f8 P c5ed5317da9c464b93f979c405f0f6e4 reported cstate change: config changed from index 9 to 10, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:02.645125 6734 consensus_queue.cc:237] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 2.8, Last appended by leader: 6, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 02:00:02.668630 6395 raft_consensus.cc:1275] T da507bc24d964ce1a5835edad5177726 P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 FOLLOWER]: Refusing update from remote peer c5ed5317da9c464b93f979c405f0f6e4: Log matching property violated. Preceding OpId in replica: term: 2 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
W20260810 02:00:02.670110 6655 consensus_peers.cc:597] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4 -> Peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): Couldn't send request to peer 82f93d1d11364ceeb485585b4ae78871. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 02:00:02.670490 18082 consensus_queue.cc:1048] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 02:00:02.697589 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:02.708436 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:02.733835 3759 raft_consensus.cc:1275] T da507bc24d964ce1a5835edad5177726 P dc85be7d460a404f997177f57680850f [term 2 FOLLOWER]: Refusing update from remote peer c5ed5317da9c464b93f979c405f0f6e4: Log matching property violated. Preceding OpId in replica: term: 2 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20260810 02:00:02.734714 18966 consensus_queue.cc:1048] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 02:00:02.741940 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:02.757422 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:02.786706 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:02.805194 18966 raft_consensus.cc:2955] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4 [term 2 LEADER]: Committing config change with OpId 2.9: config changed from index 8 to 9, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:02.809839 3756 raft_consensus.cc:2955] T da507bc24d964ce1a5835edad5177726 P dc85be7d460a404f997177f57680850f [term 2 FOLLOWER]: Committing config change with OpId 2.9: config changed from index 8 to 9, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:02.814070 6395 raft_consensus.cc:2955] T da507bc24d964ce1a5835edad5177726 P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 FOLLOWER]: Committing config change with OpId 2.9: config changed from index 8 to 9, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:02.818262 3572 catalog_manager.cc:5719] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4 reported cstate change: config changed from index 8 to 9, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) added. New cstate: current_term: 2 leader_uuid: "c5ed5317da9c464b93f979c405f0f6e4" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:02.837819 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:02.868101 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:02.910087 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:02.913802 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:02.929417 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:02.970149 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:03.037177 19007 ts_tablet_manager.cc:933] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227: Initiating tablet copy from peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 02:00:03.055061 19007 tablet_copy_client.cc:323] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.194:43893
I20260810 02:00:03.055959 3973 tablet_copy_service.cc:140] P 82f93d1d11364ceeb485585b4ae78871: Received BeginTabletCopySession request for tablet fe8e1f0908234e46881258cfe79835f8 from peer 3136daf7101445beadc1aa19bc01c227 ({username='slave'} at 127.21.64.200:39385)
I20260810 02:00:03.056140 3973 tablet_copy_service.cc:161] P 82f93d1d11364ceeb485585b4ae78871: Beginning new tablet copy session on tablet fe8e1f0908234e46881258cfe79835f8 from peer 3136daf7101445beadc1aa19bc01c227 at {username='slave'} at 127.21.64.200:39385: session id = 3136daf7101445beadc1aa19bc01c227-fe8e1f0908234e46881258cfe79835f8
I20260810 02:00:03.059871 3973 tablet_copy_source_session.cc:215] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 02:00:03.074666 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:03.075511 19007 ts_tablet_manager.cc:1916] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260810 02:00:03.100951 19024 ts_tablet_manager.cc:933] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871: Initiating tablet copy from peer c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199:41689)
I20260810 02:00:03.112561 19024 tablet_copy_client.cc:323] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.199:41689
I20260810 02:00:03.113615 6762 tablet_copy_service.cc:140] P c5ed5317da9c464b93f979c405f0f6e4: Received BeginTabletCopySession request for tablet da507bc24d964ce1a5835edad5177726 from peer 82f93d1d11364ceeb485585b4ae78871 ({username='slave'} at 127.21.64.194:38241)
I20260810 02:00:03.113822 6762 tablet_copy_service.cc:161] P c5ed5317da9c464b93f979c405f0f6e4: Beginning new tablet copy session on tablet da507bc24d964ce1a5835edad5177726 from peer 82f93d1d11364ceeb485585b4ae78871 at {username='slave'} at 127.21.64.194:38241: session id = 82f93d1d11364ceeb485585b4ae78871-da507bc24d964ce1a5835edad5177726
I20260810 02:00:03.115885 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:03.120335 6762 tablet_copy_source_session.cc:215] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 02:00:03.123551 19024 ts_tablet_manager.cc:1916] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260810 02:00:03.164680 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:03.174999 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:03.188923 19007 ts_tablet_manager.cc:1929] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.8
I20260810 02:00:03.229023 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:03.237659 19007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe8e1f0908234e46881258cfe79835f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 02:00:03.241076 19007 tablet_copy_client.cc:806] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Starting download of 0 data blocks...
I20260810 02:00:03.255492 19024 ts_tablet_manager.cc:1929] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 2.7
I20260810 02:00:03.255790 19024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da507bc24d964ce1a5835edad5177726. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 02:00:03.259195 19024 tablet_copy_client.cc:806] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871: tablet copy: Starting download of 0 data blocks...
I20260810 02:00:03.259423 19024 tablet_copy_client.cc:670] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871: tablet copy: Starting download of 1 WAL segments...
I20260810 02:00:03.241318 19007 tablet_copy_client.cc:670] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Starting download of 1 WAL segments...
I20260810 02:00:03.271821 19007 tablet_copy_client.cc:538] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 02:00:03.284408 19024 tablet_copy_client.cc:538] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 02:00:03.286564 19007 tablet_bootstrap.cc:492] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227: Bootstrap starting.
I20260810 02:00:03.309840 19024 tablet_bootstrap.cc:492] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871: Bootstrap starting.
I20260810 02:00:03.470990 19007 tablet_bootstrap.cc:492] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 02:00:03.481621 19007 tablet_bootstrap.cc:492] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227: Bootstrap complete.
I20260810 02:00:03.482136 19007 ts_tablet_manager.cc:1403] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227: Time spent bootstrapping tablet: real 0.196s user 0.060s sys 0.013s
I20260810 02:00:03.485867 19007 raft_consensus.cc:359] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 02:00:03.496198 19007 raft_consensus.cc:740] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3136daf7101445beadc1aa19bc01c227, State: Initialized, Role: FOLLOWER
I20260810 02:00:03.496659 19007 consensus_queue.cc:260] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 1.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 02:00:03.500136 19007 ts_tablet_manager.cc:1434] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227: Time spent starting tablet: real 0.018s user 0.003s sys 0.000s
I20260810 02:00:03.503258 3973 tablet_copy_service.cc:342] P 82f93d1d11364ceeb485585b4ae78871: Request end of tablet copy session 3136daf7101445beadc1aa19bc01c227-fe8e1f0908234e46881258cfe79835f8 received from {username='slave'} at 127.21.64.200:39385
I20260810 02:00:03.503432 3973 tablet_copy_service.cc:434] P 82f93d1d11364ceeb485585b4ae78871: ending tablet copy session 3136daf7101445beadc1aa19bc01c227-fe8e1f0908234e46881258cfe79835f8 on tablet fe8e1f0908234e46881258cfe79835f8 with peer 3136daf7101445beadc1aa19bc01c227
I20260810 02:00:03.523890 4311 consensus_queue.cc:237] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
W20260810 02:00:03.542744 4222 consensus_peers.cc:597] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e -> Peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): Couldn't send request to peer 82f93d1d11364ceeb485585b4ae78871. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 02:00:03.543718 6907 raft_consensus.cc:1275] T 8308d63e9002418b876c3d3ae0095d9f P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260810 02:00:03.544433 18633 consensus_queue.cc:1048] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 02:00:03.553115 6567 raft_consensus.cc:1275] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260810 02:00:03.553874 18633 consensus_queue.cc:1048] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 02:00:03.593122 18633 raft_consensus.cc:2955] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:03.598546 6909 raft_consensus.cc:2955] T 8308d63e9002418b876c3d3ae0095d9f P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:03.599140 6567 raft_consensus.cc:2955] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:03.606598 3564 catalog_manager.cc:5719] T 8308d63e9002418b876c3d3ae0095d9f P 3136daf7101445beadc1aa19bc01c227 reported cstate change: config changed from index 7 to 8, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) added. New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:03.635289 3756 consensus_queue.cc:237] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 02:00:03.640264 6397 raft_consensus.cc:1275] T 3a15b27dbdaf4092aea66c3670204fcc P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 02:00:03.640753 6567 raft_consensus.cc:1275] T 3a15b27dbdaf4092aea66c3670204fcc P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 02:00:03.641214 19010 consensus_queue.cc:1048] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 02:00:03.641850 19010 consensus_queue.cc:1048] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 02:00:03.673799 18675 raft_consensus.cc:2955] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:03.677145 19024 tablet_bootstrap.cc:492] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 02:00:03.678709 6395 raft_consensus.cc:2955] T 3a15b27dbdaf4092aea66c3670204fcc P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:03.687343 3569 catalog_manager.cc:5719] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f reported cstate change: config changed from index 6 to 7, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:03.687942 6567 raft_consensus.cc:2955] T 3a15b27dbdaf4092aea66c3670204fcc P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:03.697607 19024 tablet_bootstrap.cc:492] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871: Bootstrap complete.
I20260810 02:00:03.698072 19024 ts_tablet_manager.cc:1403] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871: Time spent bootstrapping tablet: real 0.388s user 0.066s sys 0.003s
I20260810 02:00:03.699249 19024 raft_consensus.cc:359] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 02:00:03.699695 19024 raft_consensus.cc:740] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f93d1d11364ceeb485585b4ae78871, State: Initialized, Role: FOLLOWER
I20260810 02:00:03.700783 19024 consensus_queue.cc:260] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 2.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 02:00:03.701786 19024 ts_tablet_manager.cc:1434] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260810 02:00:03.711664 3756 consensus_queue.cc:237] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 02:00:03.713217 4286 tablet_service.cc:1558] Processing DeleteTablet for tablet 3a15b27dbdaf4092aea66c3670204fcc with delete_type TABLET_DATA_TOMBSTONED (TS ca4469fc2dbc48488bc7ad7f482f129e not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:40788
I20260810 02:00:03.718039 6735 raft_consensus.cc:1275] T abf302f27a12414a8647dab82ab8101f P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 02:00:03.719379 19010 consensus_queue.cc:1048] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 02:00:03.722882 4132 raft_consensus.cc:1275] T abf302f27a12414a8647dab82ab8101f P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 02:00:03.723721 19010 consensus_queue.cc:1048] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 02:00:03.758598 19191 tablet_replica.cc:333] T 3a15b27dbdaf4092aea66c3670204fcc P ca4469fc2dbc48488bc7ad7f482f129e: stopping tablet replica
I20260810 02:00:03.759018 19191 raft_consensus.cc:2243] T 3a15b27dbdaf4092aea66c3670204fcc P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:03.759394 19191 raft_consensus.cc:2272] T 3a15b27dbdaf4092aea66c3670204fcc P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:03.760643 19191 ts_tablet_manager.cc:1916] T 3a15b27dbdaf4092aea66c3670204fcc P ca4469fc2dbc48488bc7ad7f482f129e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 02:00:03.765267 19010 raft_consensus.cc:2955] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 02:00:03.770728 4131 raft_consensus.cc:2955] T abf302f27a12414a8647dab82ab8101f P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 02:00:03.785980 6762 tablet_copy_service.cc:342] P c5ed5317da9c464b93f979c405f0f6e4: Request end of tablet copy session 82f93d1d11364ceeb485585b4ae78871-da507bc24d964ce1a5835edad5177726 received from {username='slave'} at 127.21.64.194:38241
I20260810 02:00:03.786223 6762 tablet_copy_service.cc:434] P c5ed5317da9c464b93f979c405f0f6e4: ending tablet copy session 82f93d1d11364ceeb485585b4ae78871-da507bc24d964ce1a5835edad5177726 on tablet da507bc24d964ce1a5835edad5177726 with peer 82f93d1d11364ceeb485585b4ae78871
I20260810 02:00:03.788203 6734 raft_consensus.cc:2955] T abf302f27a12414a8647dab82ab8101f P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 02:00:03.788401 3574 catalog_manager.cc:5719] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f reported cstate change: config changed from index 6 to 7, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) evicted. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 02:00:03.828246 6909 raft_consensus.cc:1217] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.9->[1.10-1.10] Dedup: 1.10->[]
I20260810 02:00:03.955298 6369 tablet_service.cc:1558] Processing DeleteTablet for tablet abf302f27a12414a8647dab82ab8101f with delete_type TABLET_DATA_TOMBSTONED (TS 4dd4cba155c941b4b7ad4d64c7431536 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:60156
I20260810 02:00:03.980566 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:03.989406 3945 raft_consensus.cc:1217] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [term 2 FOLLOWER]: Deduplicated request from leader. Original: 2.8->[2.9-2.9] Dedup: 2.9->[]
I20260810 02:00:03.990231 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:04.004549 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:04.015718 19191 ts_tablet_manager.cc:1929] T 3a15b27dbdaf4092aea66c3670204fcc P ca4469fc2dbc48488bc7ad7f482f129e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20260810 02:00:04.015884 19191 log.cc:1199] T 3a15b27dbdaf4092aea66c3670204fcc P ca4469fc2dbc48488bc7ad7f482f129e: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal/wals/3a15b27dbdaf4092aea66c3670204fcc
I20260810 02:00:04.022769 3553 catalog_manager.cc:5050] TS ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): tablet 3a15b27dbdaf4092aea66c3670204fcc (table rebalance_test_table_1 [id=945a223441a04ba2bf938b104bc91cf8]) successfully deleted
I20260810 02:00:04.025025 19258 tablet_replica.cc:333] T abf302f27a12414a8647dab82ab8101f P 4dd4cba155c941b4b7ad4d64c7431536: stopping tablet replica
I20260810 02:00:04.027971 19024 ts_tablet_manager.cc:933] T 8308d63e9002418b876c3d3ae0095d9f P 82f93d1d11364ceeb485585b4ae78871: Initiating tablet copy from peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943)
I20260810 02:00:04.044225 19024 tablet_copy_client.cc:323] T 8308d63e9002418b876c3d3ae0095d9f P 82f93d1d11364ceeb485585b4ae78871: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.196:41943
I20260810 02:00:04.046021 4337 tablet_copy_service.cc:140] P ca4469fc2dbc48488bc7ad7f482f129e: Received BeginTabletCopySession request for tablet 8308d63e9002418b876c3d3ae0095d9f from peer 82f93d1d11364ceeb485585b4ae78871 ({username='slave'} at 127.21.64.194:37889)
I20260810 02:00:04.046207 4337 tablet_copy_service.cc:161] P ca4469fc2dbc48488bc7ad7f482f129e: Beginning new tablet copy session on tablet 8308d63e9002418b876c3d3ae0095d9f from peer 82f93d1d11364ceeb485585b4ae78871 at {username='slave'} at 127.21.64.194:37889: session id = 82f93d1d11364ceeb485585b4ae78871-8308d63e9002418b876c3d3ae0095d9f
I20260810 02:00:04.049750 4337 tablet_copy_source_session.cc:215] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 02:00:04.053685 19024 ts_tablet_manager.cc:1916] T 8308d63e9002418b876c3d3ae0095d9f P 82f93d1d11364ceeb485585b4ae78871: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260810 02:00:04.055830 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:04.062451 19258 raft_consensus.cc:2243] T abf302f27a12414a8647dab82ab8101f P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:04.063051 19258 raft_consensus.cc:2272] T abf302f27a12414a8647dab82ab8101f P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:04.064702 19258 ts_tablet_manager.cc:1916] T abf302f27a12414a8647dab82ab8101f P 4dd4cba155c941b4b7ad4d64c7431536: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 02:00:04.075795 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:04.091702 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:04.140694 19024 ts_tablet_manager.cc:1929] T 8308d63e9002418b876c3d3ae0095d9f P 82f93d1d11364ceeb485585b4ae78871: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.5
I20260810 02:00:04.141676 19024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8308d63e9002418b876c3d3ae0095d9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 02:00:04.142755 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:04.158952 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:04.171124 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:04.202034 19024 tablet_copy_client.cc:806] T 8308d63e9002418b876c3d3ae0095d9f P 82f93d1d11364ceeb485585b4ae78871: tablet copy: Starting download of 0 data blocks...
I20260810 02:00:04.205410 19024 tablet_copy_client.cc:670] T 8308d63e9002418b876c3d3ae0095d9f P 82f93d1d11364ceeb485585b4ae78871: tablet copy: Starting download of 1 WAL segments...
I20260810 02:00:04.208889 19024 tablet_copy_client.cc:538] T 8308d63e9002418b876c3d3ae0095d9f P 82f93d1d11364ceeb485585b4ae78871: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 02:00:04.226217 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:04.242718 19258 ts_tablet_manager.cc:1929] T abf302f27a12414a8647dab82ab8101f P 4dd4cba155c941b4b7ad4d64c7431536: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20260810 02:00:04.243153 19258 log.cc:1199] T abf302f27a12414a8647dab82ab8101f P 4dd4cba155c941b4b7ad4d64c7431536: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/wal/wals/abf302f27a12414a8647dab82ab8101f
I20260810 02:00:04.244552 3551 catalog_manager.cc:5050] TS 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197:38787): tablet abf302f27a12414a8647dab82ab8101f (table rebalance_test_table_6 [id=5b2df46262b142169af9a32c47535432]) successfully deleted
I20260810 02:00:04.272430 19024 tablet_bootstrap.cc:492] T 8308d63e9002418b876c3d3ae0095d9f P 82f93d1d11364ceeb485585b4ae78871: Bootstrap starting.
I20260810 02:00:04.277037 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:04.298417 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:04.338001 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:04.343534 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:04.344270 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:04.363173 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:04.666527 19024 tablet_bootstrap.cc:492] T 8308d63e9002418b876c3d3ae0095d9f P 82f93d1d11364ceeb485585b4ae78871: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 02:00:04.667349 19024 tablet_bootstrap.cc:492] T 8308d63e9002418b876c3d3ae0095d9f P 82f93d1d11364ceeb485585b4ae78871: Bootstrap complete.
I20260810 02:00:04.667812 19024 ts_tablet_manager.cc:1403] T 8308d63e9002418b876c3d3ae0095d9f P 82f93d1d11364ceeb485585b4ae78871: Time spent bootstrapping tablet: real 0.451s user 0.073s sys 0.018s
W20260810 02:00:04.668565 3858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.199:41689, user_credentials={real_user=slave}} blocked reactor thread for 52673.3us
I20260810 02:00:04.669139 19024 raft_consensus.cc:359] T 8308d63e9002418b876c3d3ae0095d9f P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 02:00:04.669612 19024 raft_consensus.cc:740] T 8308d63e9002418b876c3d3ae0095d9f P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f93d1d11364ceeb485585b4ae78871, State: Initialized, Role: FOLLOWER
I20260810 02:00:04.670039 19024 consensus_queue.cc:260] T 8308d63e9002418b876c3d3ae0095d9f P 82f93d1d11364ceeb485585b4ae78871 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 02:00:04.670982 19024 ts_tablet_manager.cc:1434] T 8308d63e9002418b876c3d3ae0095d9f P 82f93d1d11364ceeb485585b4ae78871: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 02:00:04.672027 4337 tablet_copy_service.cc:342] P ca4469fc2dbc48488bc7ad7f482f129e: Request end of tablet copy session 82f93d1d11364ceeb485585b4ae78871-8308d63e9002418b876c3d3ae0095d9f received from {username='slave'} at 127.21.64.194:37889
I20260810 02:00:04.672253 4337 tablet_copy_service.cc:434] P ca4469fc2dbc48488bc7ad7f482f129e: ending tablet copy session 82f93d1d11364ceeb485585b4ae78871-8308d63e9002418b876c3d3ae0095d9f on tablet 8308d63e9002418b876c3d3ae0095d9f with peer 82f93d1d11364ceeb485585b4ae78871
I20260810 02:00:04.935799 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:04.971405 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:04.971808 3945 consensus_queue.cc:237] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 02:00:05.006855 6907 raft_consensus.cc:1275] T 2e72e04459b140cc9e20ad633b1ab5c4 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 02:00:05.007540 19370 consensus_queue.cc:1048] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 02:00:05.018569 19370 raft_consensus.cc:2955] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:05.023573 6907 raft_consensus.cc:2955] T 2e72e04459b140cc9e20ad633b1ab5c4 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:05.028697 3945 raft_consensus.cc:1217] T 8308d63e9002418b876c3d3ae0095d9f P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20260810 02:00:05.030591 3574 catalog_manager.cc:5719] T 2e72e04459b140cc9e20ad633b1ab5c4 P 3136daf7101445beadc1aa19bc01c227 reported cstate change: config changed from index 5 to 6, VOTER 17b49c694faf479ea2e5083470fc0302 (127.21.64.195) evicted. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:05.068415 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:05.069948 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:05.107528 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:05.147321 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:05.196547 3945 consensus_queue.cc:237] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 02:00:05.196700 4105 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e72e04459b140cc9e20ad633b1ab5c4 with delete_type TABLET_DATA_TOMBSTONED (TS 17b49c694faf479ea2e5083470fc0302 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:34952
W20260810 02:00:05.199318 3857 consensus_peers.cc:597] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871 -> Peer 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317): Couldn't send request to peer 22ce0e487f0341fd9bf853393d6e7683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2e72e04459b140cc9e20ad633b1ab5c4. This is attempt 1: this message will repeat every 5th retry.
I20260810 02:00:05.201188 6909 raft_consensus.cc:1275] T 2e72e04459b140cc9e20ad633b1ab5c4 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 02:00:05.201884 19370 consensus_queue.cc:1048] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 02:00:05.204773 19370 raft_consensus.cc:2955] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:05.209460 6909 raft_consensus.cc:2955] T 2e72e04459b140cc9e20ad633b1ab5c4 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:05.212391 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:05.212486 3553 catalog_manager.cc:5232] ChangeConfig:ADD_PEER:VOTER RPC for tablet 2e72e04459b140cc9e20ad633b1ab5c4 with cas_config_opid_index 6: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260810 02:00:05.214726 3572 catalog_manager.cc:5719] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871 reported cstate change: config changed from index 6 to 7, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:05.232259 4311 consensus_queue.cc:237] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
W20260810 02:00:05.233425 4036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.197:38787, user_credentials={real_user=slave}} blocked reactor thread for 46577.1us
I20260810 02:00:05.278507 19516 tablet_replica.cc:333] T 2e72e04459b140cc9e20ad633b1ab5c4 P 17b49c694faf479ea2e5083470fc0302: stopping tablet replica
I20260810 02:00:05.278824 19516 raft_consensus.cc:2243] T 2e72e04459b140cc9e20ad633b1ab5c4 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:05.279098 19516 raft_consensus.cc:2272] T 2e72e04459b140cc9e20ad633b1ab5c4 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:05.302865 19516 ts_tablet_manager.cc:1916] T 2e72e04459b140cc9e20ad633b1ab5c4 P 17b49c694faf479ea2e5083470fc0302: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 02:00:05.309010 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:05.320359 4132 raft_consensus.cc:1275] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260810 02:00:05.321024 18633 consensus_queue.cc:1048] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 02:00:05.330154 6735 raft_consensus.cc:1275] T 1d377b919f4748c88efb249dfc964f17 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260810 02:00:05.331028 18633 consensus_queue.cc:1048] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 02:00:05.358688 18633 raft_consensus.cc:2955] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } }
I20260810 02:00:05.362089 6734 raft_consensus.cc:2955] T 1d377b919f4748c88efb249dfc964f17 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } }
I20260810 02:00:05.370975 3563 catalog_manager.cc:5719] T 1d377b919f4748c88efb249dfc964f17 P ca4469fc2dbc48488bc7ad7f482f129e reported cstate change: config changed from index 8 to 9, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) evicted. New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } }
I20260810 02:00:05.387794 6884 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d377b919f4748c88efb249dfc964f17 with delete_type TABLET_DATA_TOMBSTONED (TS 3136daf7101445beadc1aa19bc01c227 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:41662
I20260810 02:00:05.389552 19516 ts_tablet_manager.cc:1929] T 2e72e04459b140cc9e20ad633b1ab5c4 P 17b49c694faf479ea2e5083470fc0302: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20260810 02:00:05.395455 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:05.397331 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:05.404182 19516 log.cc:1199] T 2e72e04459b140cc9e20ad633b1ab5c4 P 17b49c694faf479ea2e5083470fc0302: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-2/wal/wals/2e72e04459b140cc9e20ad633b1ab5c4
I20260810 02:00:05.406968 3552 catalog_manager.cc:5050] TS 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189): tablet 2e72e04459b140cc9e20ad633b1ab5c4 (table rebalance_test_table_1 [id=945a223441a04ba2bf938b104bc91cf8]) successfully deleted
I20260810 02:00:05.413870 19548 tablet_replica.cc:333] T 1d377b919f4748c88efb249dfc964f17 P 3136daf7101445beadc1aa19bc01c227: stopping tablet replica
I20260810 02:00:05.414197 19548 raft_consensus.cc:2243] T 1d377b919f4748c88efb249dfc964f17 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:05.415702 19548 raft_consensus.cc:2272] T 1d377b919f4748c88efb249dfc964f17 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:05.420344 19548 ts_tablet_manager.cc:1916] T 1d377b919f4748c88efb249dfc964f17 P 3136daf7101445beadc1aa19bc01c227: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 02:00:05.435340 4131 raft_consensus.cc:2955] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } }
I20260810 02:00:05.438061 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:05.442286 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:05.448325 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:05.486097 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:05.507259 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:05.520143 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:05.577801 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:05.602624 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:05.612294 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:05.619279 19548 ts_tablet_manager.cc:1929] T 1d377b919f4748c88efb249dfc964f17 P 3136daf7101445beadc1aa19bc01c227: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20260810 02:00:05.619542 19548 log.cc:1199] T 1d377b919f4748c88efb249dfc964f17 P 3136daf7101445beadc1aa19bc01c227: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/wal/wals/1d377b919f4748c88efb249dfc964f17
I20260810 02:00:05.620632 3551 catalog_manager.cc:5050] TS 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995): tablet 1d377b919f4748c88efb249dfc964f17 (table rebalance_test_table_5 [id=e211628d46b64734960dfd60d86708ce]) successfully deleted
I20260810 02:00:05.625767 19573 ts_tablet_manager.cc:933] T 2e72e04459b140cc9e20ad633b1ab5c4 P 22ce0e487f0341fd9bf853393d6e7683: Initiating tablet copy from peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 02:00:05.648007 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:05.666584 19573 tablet_copy_client.cc:323] T 2e72e04459b140cc9e20ad633b1ab5c4 P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.194:43893
I20260810 02:00:05.667428 3973 tablet_copy_service.cc:140] P 82f93d1d11364ceeb485585b4ae78871: Received BeginTabletCopySession request for tablet 2e72e04459b140cc9e20ad633b1ab5c4 from peer 22ce0e487f0341fd9bf853393d6e7683 ({username='slave'} at 127.21.64.198:54627)
I20260810 02:00:05.667608 3973 tablet_copy_service.cc:161] P 82f93d1d11364ceeb485585b4ae78871: Beginning new tablet copy session on tablet 2e72e04459b140cc9e20ad633b1ab5c4 from peer 22ce0e487f0341fd9bf853393d6e7683 at {username='slave'} at 127.21.64.198:54627: session id = 22ce0e487f0341fd9bf853393d6e7683-2e72e04459b140cc9e20ad633b1ab5c4
I20260810 02:00:05.671051 3973 tablet_copy_source_session.cc:215] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 02:00:05.687794 19573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e72e04459b140cc9e20ad633b1ab5c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 02:00:05.698029 4286 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:05.698220 4284 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:05.723448 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:05.726429 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:05.763821 19573 tablet_copy_client.cc:806] T 2e72e04459b140cc9e20ad633b1ab5c4 P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Starting download of 0 data blocks...
I20260810 02:00:05.764164 19573 tablet_copy_client.cc:670] T 2e72e04459b140cc9e20ad633b1ab5c4 P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Starting download of 1 WAL segments...
I20260810 02:00:05.780797 19573 tablet_copy_client.cc:538] T 2e72e04459b140cc9e20ad633b1ab5c4 P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 02:00:05.785060 19573 tablet_bootstrap.cc:492] T 2e72e04459b140cc9e20ad633b1ab5c4 P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap starting.
I20260810 02:00:06.039536 19573 tablet_bootstrap.cc:492] T 2e72e04459b140cc9e20ad633b1ab5c4 P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 02:00:06.040175 19573 tablet_bootstrap.cc:492] T 2e72e04459b140cc9e20ad633b1ab5c4 P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap complete.
I20260810 02:00:06.040508 19573 ts_tablet_manager.cc:1403] T 2e72e04459b140cc9e20ad633b1ab5c4 P 22ce0e487f0341fd9bf853393d6e7683: Time spent bootstrapping tablet: real 0.256s user 0.071s sys 0.017s
I20260810 02:00:06.041628 19573 raft_consensus.cc:359] T 2e72e04459b140cc9e20ad633b1ab5c4 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 02:00:06.041896 19573 raft_consensus.cc:740] T 2e72e04459b140cc9e20ad633b1ab5c4 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ce0e487f0341fd9bf853393d6e7683, State: Initialized, Role: FOLLOWER
I20260810 02:00:06.064515 19573 consensus_queue.cc:260] T 2e72e04459b140cc9e20ad633b1ab5c4 P 22ce0e487f0341fd9bf853393d6e7683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 02:00:06.072166 19573 ts_tablet_manager.cc:1434] T 2e72e04459b140cc9e20ad633b1ab5c4 P 22ce0e487f0341fd9bf853393d6e7683: Time spent starting tablet: real 0.031s user 0.029s sys 0.004s
I20260810 02:00:06.074339 3973 tablet_copy_service.cc:342] P 82f93d1d11364ceeb485585b4ae78871: Request end of tablet copy session 22ce0e487f0341fd9bf853393d6e7683-2e72e04459b140cc9e20ad633b1ab5c4 received from {username='slave'} at 127.21.64.198:54627
I20260810 02:00:06.074481 3973 tablet_copy_service.cc:434] P 82f93d1d11364ceeb485585b4ae78871: ending tablet copy session 22ce0e487f0341fd9bf853393d6e7683-2e72e04459b140cc9e20ad633b1ab5c4 on tablet 2e72e04459b140cc9e20ad633b1ab5c4 with peer 22ce0e487f0341fd9bf853393d6e7683
I20260810 02:00:06.101967 3945 consensus_queue.cc:237] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 02:00:06.105283 6567 raft_consensus.cc:1275] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260810 02:00:06.105357 6734 raft_consensus.cc:1275] T b6c5892f4de449fb8cb7f4cff7eb2e20 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260810 02:00:06.106194 19370 consensus_queue.cc:1048] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 02:00:06.106523 18514 consensus_queue.cc:1048] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 02:00:06.115438 18514 raft_consensus.cc:2955] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 02:00:06.120622 6567 raft_consensus.cc:2955] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 02:00:06.128351 3572 catalog_manager.cc:5719] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 22ce0e487f0341fd9bf853393d6e7683 reported cstate change: config changed from index 8 to 9, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) evicted. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 02:00:06.147078 6734 raft_consensus.cc:2955] T b6c5892f4de449fb8cb7f4cff7eb2e20 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
W20260810 02:00:06.176570 3857 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.198:45317, user_credentials={real_user=slave}} blocked reactor thread for 50647.4us
I20260810 02:00:06.177691 6567 raft_consensus.cc:1217] T 2e72e04459b140cc9e20ad633b1ab5c4 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260810 02:00:06.212244 6369 tablet_service.cc:1558] Processing DeleteTablet for tablet b6c5892f4de449fb8cb7f4cff7eb2e20 with delete_type TABLET_DATA_TOMBSTONED (TS 4dd4cba155c941b4b7ad4d64c7431536 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:60156
I20260810 02:00:06.217293 19711 tablet_replica.cc:333] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 4dd4cba155c941b4b7ad4d64c7431536: stopping tablet replica
I20260810 02:00:06.218487 19711 raft_consensus.cc:2243] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:06.219067 19711 raft_consensus.cc:2272] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:06.221266 19711 ts_tablet_manager.cc:1916] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 4dd4cba155c941b4b7ad4d64c7431536: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 02:00:06.239090 19711 ts_tablet_manager.cc:1929] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 4dd4cba155c941b4b7ad4d64c7431536: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20260810 02:00:06.241137 19711 log.cc:1199] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 4dd4cba155c941b4b7ad4d64c7431536: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/wal/wals/b6c5892f4de449fb8cb7f4cff7eb2e20
I20260810 02:00:06.242208 3551 catalog_manager.cc:5050] TS 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197:38787): tablet b6c5892f4de449fb8cb7f4cff7eb2e20 (table rebalance_test_table_4 [id=3e1f7b9b31614ed383207098de38230c]) successfully deleted
I20260810 02:00:06.392956 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:06.451469 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:06.496567 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:06.512226 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:06.538120 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:06.542063 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:06.566768 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:06.593642 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:06.625149 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:06.702775 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:06.720410 4284 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:06.736131 4284 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:06.739696 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:06.758291 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:06.776618 3945 consensus_queue.cc:237] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 02:00:06.790346 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:06.796319 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:06.804174 6734 raft_consensus.cc:1275] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260810 02:00:06.804767 19679 consensus_queue.cc:1048] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 02:00:06.812517 6909 raft_consensus.cc:1275] T 4a4350cf2ece4769b8547620ac5bedcb P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260810 02:00:06.813357 19679 consensus_queue.cc:1048] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 02:00:06.835414 19679 raft_consensus.cc:2955] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 02:00:06.839331 6909 raft_consensus.cc:2955] T 4a4350cf2ece4769b8547620ac5bedcb P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 02:00:06.839710 6735 raft_consensus.cc:2955] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 02:00:06.847065 3564 catalog_manager.cc:5719] T 4a4350cf2ece4769b8547620ac5bedcb P 3136daf7101445beadc1aa19bc01c227 reported cstate change: config changed from index 8 to 9, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 02:00:06.923146 4284 tablet_service.cc:1558] Processing DeleteTablet for tablet 4a4350cf2ece4769b8547620ac5bedcb with delete_type TABLET_DATA_TOMBSTONED (TS ca4469fc2dbc48488bc7ad7f482f129e not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:40788
I20260810 02:00:06.952311 19859 tablet_replica.cc:333] T 4a4350cf2ece4769b8547620ac5bedcb P ca4469fc2dbc48488bc7ad7f482f129e: stopping tablet replica
I20260810 02:00:06.953579 19859 raft_consensus.cc:2243] T 4a4350cf2ece4769b8547620ac5bedcb P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:06.953853 19859 raft_consensus.cc:2272] T 4a4350cf2ece4769b8547620ac5bedcb P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:06.955245 19859 ts_tablet_manager.cc:1916] T 4a4350cf2ece4769b8547620ac5bedcb P ca4469fc2dbc48488bc7ad7f482f129e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 02:00:06.972651 19859 ts_tablet_manager.cc:1929] T 4a4350cf2ece4769b8547620ac5bedcb P ca4469fc2dbc48488bc7ad7f482f129e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20260810 02:00:06.972955 19859 log.cc:1199] T 4a4350cf2ece4769b8547620ac5bedcb P ca4469fc2dbc48488bc7ad7f482f129e: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal/wals/4a4350cf2ece4769b8547620ac5bedcb
I20260810 02:00:06.974035 3553 catalog_manager.cc:5050] TS ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): tablet 4a4350cf2ece4769b8547620ac5bedcb (table rebalance_test_table_8 [id=afa71147917d44a585bcbaa37497a2b1]) successfully deleted
I20260810 02:00:07.297679 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:07.299468 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:07.316282 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:07.331331 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:07.331612 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:07.331816 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:07.347666 3945 consensus_queue.cc:237] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 02:00:07.435868 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:07.469527 4284 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:07.539819 6909 raft_consensus.cc:1275] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260810 02:00:07.540608 19679 consensus_queue.cc:1048] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260810 02:00:07.549480 6394 raft_consensus.cc:1275] T fe8e1f0908234e46881258cfe79835f8 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260810 02:00:07.550343 19679 consensus_queue.cc:1048] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260810 02:00:07.576997 19679 raft_consensus.cc:2955] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:07.583853 6395 raft_consensus.cc:2955] T fe8e1f0908234e46881258cfe79835f8 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:07.591893 3572 catalog_manager.cc:5719] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 reported cstate change: config changed from index 10 to 11, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) evicted. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:07.621009 6907 raft_consensus.cc:2955] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:07.714071 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:07.729816 6714 tablet_service.cc:1558] Processing DeleteTablet for tablet fe8e1f0908234e46881258cfe79835f8 with delete_type TABLET_DATA_TOMBSTONED (TS c5ed5317da9c464b93f979c405f0f6e4 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:58550
I20260810 02:00:07.738222 20008 tablet_replica.cc:333] T fe8e1f0908234e46881258cfe79835f8 P c5ed5317da9c464b93f979c405f0f6e4: stopping tablet replica
I20260810 02:00:07.738840 20008 raft_consensus.cc:2243] T fe8e1f0908234e46881258cfe79835f8 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:07.739310 20008 raft_consensus.cc:2272] T fe8e1f0908234e46881258cfe79835f8 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:07.772321 20008 ts_tablet_manager.cc:1916] T fe8e1f0908234e46881258cfe79835f8 P c5ed5317da9c464b93f979c405f0f6e4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 02:00:07.785877 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:07.808264 6734 consensus_queue.cc:237] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 2.9, Last appended by leader: 6, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 02:00:07.821533 20008 ts_tablet_manager.cc:1929] T fe8e1f0908234e46881258cfe79835f8 P c5ed5317da9c464b93f979c405f0f6e4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.10
I20260810 02:00:07.821842 20008 log.cc:1199] T fe8e1f0908234e46881258cfe79835f8 P c5ed5317da9c464b93f979c405f0f6e4: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/wal/wals/fe8e1f0908234e46881258cfe79835f8
I20260810 02:00:07.823184 3554 catalog_manager.cc:5050] TS c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199:41689): tablet fe8e1f0908234e46881258cfe79835f8 (table rebalance_test_table_4 [id=3e1f7b9b31614ed383207098de38230c]) successfully deleted
I20260810 02:00:07.824633 6395 raft_consensus.cc:1275] T da507bc24d964ce1a5835edad5177726 P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 FOLLOWER]: Refusing update from remote peer c5ed5317da9c464b93f979c405f0f6e4: Log matching property violated. Preceding OpId in replica: term: 2 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20260810 02:00:07.825687 3756 raft_consensus.cc:1275] T da507bc24d964ce1a5835edad5177726 P dc85be7d460a404f997177f57680850f [term 2 FOLLOWER]: Refusing update from remote peer c5ed5317da9c464b93f979c405f0f6e4: Log matching property violated. Preceding OpId in replica: term: 2 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20260810 02:00:07.826850 18966 consensus_queue.cc:1048] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260810 02:00:07.827433 18966 consensus_queue.cc:1048] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260810 02:00:07.874893 20038 raft_consensus.cc:2955] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4 [term 2 LEADER]: Committing config change with OpId 2.10: config changed from index 9 to 10, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 02:00:07.875454 6394 raft_consensus.cc:2955] T da507bc24d964ce1a5835edad5177726 P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 FOLLOWER]: Committing config change with OpId 2.10: config changed from index 9 to 10, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 02:00:07.884732 3574 catalog_manager.cc:5719] T da507bc24d964ce1a5835edad5177726 P 4dd4cba155c941b4b7ad4d64c7431536 reported cstate change: config changed from index 9 to 10, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New cstate: current_term: 2 leader_uuid: "c5ed5317da9c464b93f979c405f0f6e4" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 02:00:07.892834 3917 tablet_service.cc:1558] Processing DeleteTablet for tablet da507bc24d964ce1a5835edad5177726 with delete_type TABLET_DATA_TOMBSTONED (TS 82f93d1d11364ceeb485585b4ae78871 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:51288
I20260810 02:00:07.898792 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:07.959316 20048 tablet_replica.cc:333] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871: stopping tablet replica
I20260810 02:00:07.961299 20048 raft_consensus.cc:2243] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:07.962539 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:07.972505 20048 raft_consensus.cc:2272] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:07.973582 20048 ts_tablet_manager.cc:1916] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 02:00:07.993705 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:07.967862 3756 raft_consensus.cc:2955] T da507bc24d964ce1a5835edad5177726 P dc85be7d460a404f997177f57680850f [term 2 FOLLOWER]: Committing config change with OpId 2.10: config changed from index 9 to 10, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 02:00:08.039062 20048 ts_tablet_manager.cc:1929] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.9
I20260810 02:00:08.039309 20048 log.cc:1199] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal/wals/da507bc24d964ce1a5835edad5177726
I20260810 02:00:08.040412 3553 catalog_manager.cc:5050] TS 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): tablet da507bc24d964ce1a5835edad5177726 (table rebalance_test_table_3 [id=c515c90b2c71492f812b4df18501ee04]) successfully deleted
I20260810 02:00:08.051501 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:08.097404 4284 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:08.127828 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:08.141966 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:08.162740 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:08.207365 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:08.238186 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:08.307011 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:08.382510 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:08.416431 4284 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:08.443679 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:08.560469 3945 consensus_queue.cc:237] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 02:00:08.588434 6734 raft_consensus.cc:1275] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260810 02:00:08.590214 19679 consensus_queue.cc:1048] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260810 02:00:08.589250 3672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.196:41943, user_credentials={real_user=slave}} blocked reactor thread for 59678.5us
I20260810 02:00:08.606575 19679 raft_consensus.cc:2955] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 02:00:08.612672 6734 raft_consensus.cc:2955] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 02:00:08.620321 3564 catalog_manager.cc:5719] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4 reported cstate change: config changed from index 9 to 10, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) evicted. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 02:00:08.679275 6884 tablet_service.cc:1558] Processing DeleteTablet for tablet 4a4350cf2ece4769b8547620ac5bedcb with delete_type TABLET_DATA_TOMBSTONED (TS 3136daf7101445beadc1aa19bc01c227 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:41662
I20260810 02:00:08.679580 3943 consensus_queue.cc:237] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 02:00:08.683091 6734 raft_consensus.cc:1275] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
W20260810 02:00:08.686106 3857 consensus_peers.cc:597] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 -> Peer 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317): Couldn't send request to peer 22ce0e487f0341fd9bf853393d6e7683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4a4350cf2ece4769b8547620ac5bedcb. This is attempt 1: this message will repeat every 5th retry.
I20260810 02:00:08.686641 19679 consensus_queue.cc:1048] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260810 02:00:08.696405 19679 raft_consensus.cc:2955] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:08.699457 20183 tablet_replica.cc:333] T 4a4350cf2ece4769b8547620ac5bedcb P 3136daf7101445beadc1aa19bc01c227: stopping tablet replica
I20260810 02:00:08.699162 6734 raft_consensus.cc:2955] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:08.699724 20183 raft_consensus.cc:2243] T 4a4350cf2ece4769b8547620ac5bedcb P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:08.699983 20183 raft_consensus.cc:2272] T 4a4350cf2ece4769b8547620ac5bedcb P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:08.702953 20183 ts_tablet_manager.cc:1916] T 4a4350cf2ece4769b8547620ac5bedcb P 3136daf7101445beadc1aa19bc01c227: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260810 02:00:08.709769 3855 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.197:38787, user_credentials={real_user=slave}} blocked reactor thread for 45871.6us
I20260810 02:00:08.713191 20183 ts_tablet_manager.cc:1929] T 4a4350cf2ece4769b8547620ac5bedcb P 3136daf7101445beadc1aa19bc01c227: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.9
I20260810 02:00:08.713402 20183 log.cc:1199] T 4a4350cf2ece4769b8547620ac5bedcb P 3136daf7101445beadc1aa19bc01c227: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/wal/wals/4a4350cf2ece4769b8547620ac5bedcb
I20260810 02:00:08.714641 3551 catalog_manager.cc:5050] TS 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995): tablet 4a4350cf2ece4769b8547620ac5bedcb (table rebalance_test_table_8 [id=afa71147917d44a585bcbaa37497a2b1]) successfully deleted
I20260810 02:00:08.720649 3553 catalog_manager.cc:5232] ChangeConfig:ADD_PEER:VOTER RPC for tablet 4a4350cf2ece4769b8547620ac5bedcb with cas_config_opid_index 10: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260810 02:00:08.722710 3564 catalog_manager.cc:5719] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4 reported cstate change: config changed from index 10 to 11, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:08.905241 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:08.912794 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:08.948344 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:09.024094 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:09.098044 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:09.155665 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:09.249850 20293 ts_tablet_manager.cc:933] T 4a4350cf2ece4769b8547620ac5bedcb P 22ce0e487f0341fd9bf853393d6e7683: Initiating tablet copy from peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 02:00:09.260658 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:09.267390 20293 tablet_copy_client.cc:323] T 4a4350cf2ece4769b8547620ac5bedcb P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.194:43893
I20260810 02:00:09.268347 3973 tablet_copy_service.cc:140] P 82f93d1d11364ceeb485585b4ae78871: Received BeginTabletCopySession request for tablet 4a4350cf2ece4769b8547620ac5bedcb from peer 22ce0e487f0341fd9bf853393d6e7683 ({username='slave'} at 127.21.64.198:54627)
I20260810 02:00:09.268545 3973 tablet_copy_service.cc:161] P 82f93d1d11364ceeb485585b4ae78871: Beginning new tablet copy session on tablet 4a4350cf2ece4769b8547620ac5bedcb from peer 22ce0e487f0341fd9bf853393d6e7683 at {username='slave'} at 127.21.64.198:54627: session id = 22ce0e487f0341fd9bf853393d6e7683-4a4350cf2ece4769b8547620ac5bedcb
I20260810 02:00:09.269204 4284 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:09.273553 3973 tablet_copy_source_session.cc:215] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 02:00:09.275238 20293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a4350cf2ece4769b8547620ac5bedcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 02:00:09.288077 20293 tablet_copy_client.cc:806] T 4a4350cf2ece4769b8547620ac5bedcb P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Starting download of 0 data blocks...
I20260810 02:00:09.288417 20293 tablet_copy_client.cc:670] T 4a4350cf2ece4769b8547620ac5bedcb P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Starting download of 1 WAL segments...
I20260810 02:00:09.289165 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:09.290234 20293 tablet_copy_client.cc:538] T 4a4350cf2ece4769b8547620ac5bedcb P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 02:00:09.296015 20293 tablet_bootstrap.cc:492] T 4a4350cf2ece4769b8547620ac5bedcb P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap starting.
I20260810 02:00:09.304852 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:09.342993 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:09.351557 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:09.353470 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:09.369689 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:09.383013 4284 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:09.410538 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:09.495524 4313 consensus_queue.cc:237] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 02:00:09.533070 3943 raft_consensus.cc:1275] T 8308d63e9002418b876c3d3ae0095d9f P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260810 02:00:09.533735 6565 raft_consensus.cc:1275] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260810 02:00:09.534860 20275 consensus_queue.cc:1048] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 02:00:09.535394 20275 consensus_queue.cc:1048] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 02:00:09.540727 20276 raft_consensus.cc:2955] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:09.545257 6567 raft_consensus.cc:2955] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:09.551039 3943 raft_consensus.cc:2955] T 8308d63e9002418b876c3d3ae0095d9f P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:09.558851 3572 catalog_manager.cc:5719] T 8308d63e9002418b876c3d3ae0095d9f P 82f93d1d11364ceeb485585b4ae78871 reported cstate change: config changed from index 8 to 9, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) evicted. New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:09.615110 6884 tablet_service.cc:1558] Processing DeleteTablet for tablet 8308d63e9002418b876c3d3ae0095d9f with delete_type TABLET_DATA_TOMBSTONED (TS 3136daf7101445beadc1aa19bc01c227 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:41662
I20260810 02:00:09.634356 20360 tablet_replica.cc:333] T 8308d63e9002418b876c3d3ae0095d9f P 3136daf7101445beadc1aa19bc01c227: stopping tablet replica
I20260810 02:00:09.634620 20360 raft_consensus.cc:2243] T 8308d63e9002418b876c3d3ae0095d9f P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:09.634900 20360 raft_consensus.cc:2272] T 8308d63e9002418b876c3d3ae0095d9f P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:09.636406 20360 ts_tablet_manager.cc:1916] T 8308d63e9002418b876c3d3ae0095d9f P 3136daf7101445beadc1aa19bc01c227: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 02:00:09.644755 20360 ts_tablet_manager.cc:1929] T 8308d63e9002418b876c3d3ae0095d9f P 3136daf7101445beadc1aa19bc01c227: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20260810 02:00:09.644958 20360 log.cc:1199] T 8308d63e9002418b876c3d3ae0095d9f P 3136daf7101445beadc1aa19bc01c227: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/wal/wals/8308d63e9002418b876c3d3ae0095d9f
I20260810 02:00:09.645797 3551 catalog_manager.cc:5050] TS 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995): tablet 8308d63e9002418b876c3d3ae0095d9f (table rebalance_test_table_6 [id=5b2df46262b142169af9a32c47535432]) successfully deleted
I20260810 02:00:09.843374 20293 tablet_bootstrap.cc:492] T 4a4350cf2ece4769b8547620ac5bedcb P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 02:00:09.844026 20293 tablet_bootstrap.cc:492] T 4a4350cf2ece4769b8547620ac5bedcb P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap complete.
I20260810 02:00:09.844440 20293 ts_tablet_manager.cc:1403] T 4a4350cf2ece4769b8547620ac5bedcb P 22ce0e487f0341fd9bf853393d6e7683: Time spent bootstrapping tablet: real 0.549s user 0.071s sys 0.003s
I20260810 02:00:09.845504 20293 raft_consensus.cc:359] T 4a4350cf2ece4769b8547620ac5bedcb P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 02:00:09.845897 20293 raft_consensus.cc:740] T 4a4350cf2ece4769b8547620ac5bedcb P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ce0e487f0341fd9bf853393d6e7683, State: Initialized, Role: FOLLOWER
I20260810 02:00:09.846312 20293 consensus_queue.cc:260] T 4a4350cf2ece4769b8547620ac5bedcb P 22ce0e487f0341fd9bf853393d6e7683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 1.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 02:00:09.847471 20293 ts_tablet_manager.cc:1434] T 4a4350cf2ece4769b8547620ac5bedcb P 22ce0e487f0341fd9bf853393d6e7683: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 02:00:09.848646 3973 tablet_copy_service.cc:342] P 82f93d1d11364ceeb485585b4ae78871: Request end of tablet copy session 22ce0e487f0341fd9bf853393d6e7683-4a4350cf2ece4769b8547620ac5bedcb received from {username='slave'} at 127.21.64.198:54627
I20260810 02:00:09.848815 3973 tablet_copy_service.cc:434] P 82f93d1d11364ceeb485585b4ae78871: ending tablet copy session 22ce0e487f0341fd9bf853393d6e7683-4a4350cf2ece4769b8547620ac5bedcb on tablet 4a4350cf2ece4769b8547620ac5bedcb with peer 22ce0e487f0341fd9bf853393d6e7683
I20260810 02:00:09.930022 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:09.951694 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:09.971095 6369 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:09.972527 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:09.972880 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:10.018710 4284 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:10.027451 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:10.043203 4313 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0afbd7afdd834537b15c727355724562"
dest_uuid: "ca4469fc2dbc48488bc7ad7f482f129e"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:32772
I20260810 02:00:10.043457 4313 raft_consensus.cc:606] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Received request to transfer leadership
I20260810 02:00:10.082820 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:10.163084 3756 consensus_queue.cc:237] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 02:00:10.180830 20275 raft_consensus.cc:993] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e: : Instructing follower 4dd4cba155c941b4b7ad4d64c7431536 to start an election
I20260810 02:00:10.180992 20275 raft_consensus.cc:1081] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Signalling peer 4dd4cba155c941b4b7ad4d64c7431536 to start an election
I20260810 02:00:10.182102 6395 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0afbd7afdd834537b15c727355724562"
dest_uuid: "4dd4cba155c941b4b7ad4d64c7431536"
from {username='slave'} at 127.21.64.196:59623
I20260810 02:00:10.182422 6395 raft_consensus.cc:493] T 0afbd7afdd834537b15c727355724562 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260810 02:00:10.182574 6395 raft_consensus.cc:3060] T 0afbd7afdd834537b15c727355724562 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Advancing to term 2
I20260810 02:00:10.183413 6907 raft_consensus.cc:1275] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260810 02:00:10.184362 6567 raft_consensus.cc:1275] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260810 02:00:10.185066 20331 consensus_queue.cc:1048] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 02:00:10.186844 6395 raft_consensus.cc:515] T 0afbd7afdd834537b15c727355724562 P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 02:00:10.187161 20331 consensus_queue.cc:1048] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 02:00:10.193154 20468 raft_consensus.cc:2955] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:10.193897 6567 raft_consensus.cc:2955] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:10.202327 6907 raft_consensus.cc:2955] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:10.206151 6395 leader_election.cc:290] T 0afbd7afdd834537b15c727355724562 P 4dd4cba155c941b4b7ad4d64c7431536 [CANDIDATE]: Term 2 election: Requested vote from peers ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943), 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317), 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995)
I20260810 02:00:10.209302 3574 catalog_manager.cc:5719] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683 reported cstate change: config changed from index 8 to 9, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:10.230937 6907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afbd7afdd834537b15c727355724562" candidate_uuid: "4dd4cba155c941b4b7ad4d64c7431536" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: true dest_uuid: "3136daf7101445beadc1aa19bc01c227"
I20260810 02:00:10.231316 6907 raft_consensus.cc:3060] T 0afbd7afdd834537b15c727355724562 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Advancing to term 2
I20260810 02:00:10.234781 4313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afbd7afdd834537b15c727355724562" candidate_uuid: "4dd4cba155c941b4b7ad4d64c7431536" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: true dest_uuid: "ca4469fc2dbc48488bc7ad7f482f129e"
I20260810 02:00:10.235009 4313 raft_consensus.cc:3055] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Stepping down as leader of term 1
I20260810 02:00:10.235116 4313 raft_consensus.cc:740] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca4469fc2dbc48488bc7ad7f482f129e, State: Running, Role: LEADER
I20260810 02:00:10.235404 4313 consensus_queue.cc:260] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 02:00:10.235848 4313 raft_consensus.cc:3060] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Advancing to term 2
I20260810 02:00:10.236101 6907 raft_consensus.cc:2468] T 0afbd7afdd834537b15c727355724562 P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dd4cba155c941b4b7ad4d64c7431536 in term 2.
I20260810 02:00:10.239111 4313 raft_consensus.cc:2468] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dd4cba155c941b4b7ad4d64c7431536 in term 2.
I20260810 02:00:10.239646 6311 leader_election.cc:304] T 0afbd7afdd834537b15c727355724562 P 4dd4cba155c941b4b7ad4d64c7431536 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3136daf7101445beadc1aa19bc01c227, 4dd4cba155c941b4b7ad4d64c7431536, ca4469fc2dbc48488bc7ad7f482f129e; no voters:
I20260810 02:00:10.246886 20482 raft_consensus.cc:2804] T 0afbd7afdd834537b15c727355724562 P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 02:00:10.247692 6567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afbd7afdd834537b15c727355724562" candidate_uuid: "4dd4cba155c941b4b7ad4d64c7431536" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: true dest_uuid: "22ce0e487f0341fd9bf853393d6e7683"
I20260810 02:00:10.247951 6567 raft_consensus.cc:3060] T 0afbd7afdd834537b15c727355724562 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Advancing to term 2
I20260810 02:00:10.251255 6567 raft_consensus.cc:2468] T 0afbd7afdd834537b15c727355724562 P 22ce0e487f0341fd9bf853393d6e7683 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dd4cba155c941b4b7ad4d64c7431536 in term 2.
I20260810 02:00:10.254287 20482 raft_consensus.cc:697] T 0afbd7afdd834537b15c727355724562 P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 LEADER]: Becoming Leader. State: Replica: 4dd4cba155c941b4b7ad4d64c7431536, State: Running, Role: LEADER
I20260810 02:00:10.254791 20482 consensus_queue.cc:237] T 0afbd7afdd834537b15c727355724562 P 4dd4cba155c941b4b7ad4d64c7431536 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 02:00:10.257822 4284 tablet_service.cc:1558] Processing DeleteTablet for tablet 252899385eaa45b392974d2768e3cf01 with delete_type TABLET_DATA_TOMBSTONED (TS ca4469fc2dbc48488bc7ad7f482f129e not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:40788
I20260810 02:00:10.276284 3574 catalog_manager.cc:5719] T 0afbd7afdd834537b15c727355724562 P 4dd4cba155c941b4b7ad4d64c7431536 reported cstate change: term changed from 1 to 2, leader changed from ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) to 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197). New cstate: current_term: 2 leader_uuid: "4dd4cba155c941b4b7ad4d64c7431536" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:10.280961 20488 tablet_replica.cc:333] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e: stopping tablet replica
I20260810 02:00:10.283653 20488 raft_consensus.cc:2243] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:10.285818 20488 raft_consensus.cc:2272] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:10.286675 20488 ts_tablet_manager.cc:1916] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 02:00:10.296967 20488 ts_tablet_manager.cc:1929] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20260810 02:00:10.297154 20488 log.cc:1199] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal/wals/252899385eaa45b392974d2768e3cf01
I20260810 02:00:10.298141 3553 catalog_manager.cc:5050] TS ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): tablet 252899385eaa45b392974d2768e3cf01 (table rebalance_test_table_8 [id=afa71147917d44a585bcbaa37497a2b1]) successfully deleted
I20260810 02:00:10.417825 6567 raft_consensus.cc:1217] T 4a4350cf2ece4769b8547620ac5bedcb P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.10->[1.11-1.11] Dedup: 1.11->[]
I20260810 02:00:10.478446 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:10.496735 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:10.536672 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:10.553280 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:10.584736 6369 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:10.611581 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:10.663187 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:10.676206 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:10.680621 6567 raft_consensus.cc:1275] T 0afbd7afdd834537b15c727355724562 P 22ce0e487f0341fd9bf853393d6e7683 [term 2 FOLLOWER]: Refusing update from remote peer 4dd4cba155c941b4b7ad4d64c7431536: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20260810 02:00:10.682087 20482 consensus_queue.cc:1048] T 0afbd7afdd834537b15c727355724562 P 4dd4cba155c941b4b7ad4d64c7431536 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 02:00:10.814371 4313 raft_consensus.cc:1275] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [term 2 FOLLOWER]: Refusing update from remote peer 4dd4cba155c941b4b7ad4d64c7431536: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20260810 02:00:10.815171 20482 consensus_queue.cc:1048] T 0afbd7afdd834537b15c727355724562 P 4dd4cba155c941b4b7ad4d64c7431536 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 02:00:10.821173 6907 raft_consensus.cc:1275] T 0afbd7afdd834537b15c727355724562 P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Refusing update from remote peer 4dd4cba155c941b4b7ad4d64c7431536: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20260810 02:00:10.822181 20482 consensus_queue.cc:1048] T 0afbd7afdd834537b15c727355724562 P 4dd4cba155c941b4b7ad4d64c7431536 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 02:00:10.937234 3943 consensus_queue.cc:237] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 02:00:10.939800 6395 raft_consensus.cc:1275] T fe8e1f0908234e46881258cfe79835f8 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20260810 02:00:10.943656 20177 consensus_queue.cc:1048] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260810 02:00:10.992460 20648 raft_consensus.cc:2955] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.12: config changed from index 11 to 12, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:10.998669 6395 raft_consensus.cc:2955] T fe8e1f0908234e46881258cfe79835f8 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:11.026983 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:11.051260 3573 catalog_manager.cc:5719] T fe8e1f0908234e46881258cfe79835f8 P 4dd4cba155c941b4b7ad4d64c7431536 reported cstate change: config changed from index 11 to 12, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) evicted. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:11.100674 6369 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:11.102166 6884 tablet_service.cc:1558] Processing DeleteTablet for tablet fe8e1f0908234e46881258cfe79835f8 with delete_type TABLET_DATA_TOMBSTONED (TS 3136daf7101445beadc1aa19bc01c227 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:41662
I20260810 02:00:11.107393 3943 consensus_queue.cc:237] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
W20260810 02:00:11.110442 3858 consensus_peers.cc:597] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 -> Peer c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199:41689): Couldn't send request to peer c5ed5317da9c464b93f979c405f0f6e4. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 02:00:11.114153 6395 raft_consensus.cc:1275] T fe8e1f0908234e46881258cfe79835f8 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20260810 02:00:11.114815 20177 consensus_queue.cc:1048] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260810 02:00:11.117398 20177 raft_consensus.cc:2955] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 02:00:11.122386 3553 catalog_manager.cc:5232] ChangeConfig:ADD_PEER:VOTER RPC for tablet fe8e1f0908234e46881258cfe79835f8 with cas_config_opid_index 12: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260810 02:00:11.122907 6395 raft_consensus.cc:2955] T fe8e1f0908234e46881258cfe79835f8 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 02:00:11.124537 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:11.130242 3564 catalog_manager.cc:5719] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 reported cstate change: config changed from index 12 to 13, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 02:00:11.139124 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:11.138554 20692 tablet_replica.cc:333] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227: stopping tablet replica
I20260810 02:00:11.140189 20692 raft_consensus.cc:2243] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:11.140578 20692 raft_consensus.cc:2272] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:11.141762 20692 ts_tablet_manager.cc:1916] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 02:00:11.155877 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:11.187409 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:11.224997 20692 ts_tablet_manager.cc:1929] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.11
I20260810 02:00:11.228184 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:11.249522 20692 log.cc:1199] T fe8e1f0908234e46881258cfe79835f8 P 3136daf7101445beadc1aa19bc01c227: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/wal/wals/fe8e1f0908234e46881258cfe79835f8
I20260810 02:00:11.251924 3551 catalog_manager.cc:5050] TS 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995): tablet fe8e1f0908234e46881258cfe79835f8 (table rebalance_test_table_4 [id=3e1f7b9b31614ed383207098de38230c]) successfully deleted
I20260810 02:00:11.273577 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:11.371323 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:11.400743 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:11.422267 6369 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:11.443655 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:11.455946 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:11.462791 3756 consensus_queue.cc:237] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 02:00:11.465458 6565 raft_consensus.cc:1275] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260810 02:00:11.467016 20468 consensus_queue.cc:1048] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260810 02:00:11.483104 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:11.489802 20468 raft_consensus.cc:2955] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:11.494262 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:11.494791 6567 raft_consensus.cc:2955] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:11.531545 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:11.566771 6369 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:11.568542 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:11.580036 3564 catalog_manager.cc:5719] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683 reported cstate change: config changed from index 9 to 10, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) evicted. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:11.581363 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:11.587790 6884 tablet_service.cc:1558] Processing DeleteTablet for tablet 252899385eaa45b392974d2768e3cf01 with delete_type TABLET_DATA_TOMBSTONED (TS 3136daf7101445beadc1aa19bc01c227 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:41662
I20260810 02:00:11.588166 20692 tablet_replica.cc:333] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227: stopping tablet replica
I20260810 02:00:11.588419 20692 raft_consensus.cc:2243] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:11.588703 20692 raft_consensus.cc:2272] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:11.589680 20692 ts_tablet_manager.cc:1916] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 02:00:11.593670 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:11.633828 20692 ts_tablet_manager.cc:1929] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.9
I20260810 02:00:11.643421 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:11.651739 20692 log.cc:1199] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/wal/wals/252899385eaa45b392974d2768e3cf01
I20260810 02:00:11.654803 3551 catalog_manager.cc:5050] TS 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995): tablet 252899385eaa45b392974d2768e3cf01 (table rebalance_test_table_8 [id=afa71147917d44a585bcbaa37497a2b1]) successfully deleted
I20260810 02:00:11.659771 20784 ts_tablet_manager.cc:933] T fe8e1f0908234e46881258cfe79835f8 P c5ed5317da9c464b93f979c405f0f6e4: Initiating tablet copy from peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 02:00:11.672358 3756 consensus_queue.cc:237] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 02:00:11.674980 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:11.680763 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:11.714643 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:11.715204 20784 tablet_copy_client.cc:323] T fe8e1f0908234e46881258cfe79835f8 P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.194:43893
I20260810 02:00:11.715996 3973 tablet_copy_service.cc:140] P 82f93d1d11364ceeb485585b4ae78871: Received BeginTabletCopySession request for tablet fe8e1f0908234e46881258cfe79835f8 from peer c5ed5317da9c464b93f979c405f0f6e4 ({username='slave'} at 127.21.64.199:41929)
I20260810 02:00:11.716141 3973 tablet_copy_service.cc:161] P 82f93d1d11364ceeb485585b4ae78871: Beginning new tablet copy session on tablet fe8e1f0908234e46881258cfe79835f8 from peer c5ed5317da9c464b93f979c405f0f6e4 at {username='slave'} at 127.21.64.199:41929: session id = c5ed5317da9c464b93f979c405f0f6e4-fe8e1f0908234e46881258cfe79835f8
I20260810 02:00:11.719630 3973 tablet_copy_source_session.cc:215] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 02:00:11.720810 20784 ts_tablet_manager.cc:1916] T fe8e1f0908234e46881258cfe79835f8 P c5ed5317da9c464b93f979c405f0f6e4: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260810 02:00:11.761756 20784 ts_tablet_manager.cc:1929] T fe8e1f0908234e46881258cfe79835f8 P c5ed5317da9c464b93f979c405f0f6e4: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.10
I20260810 02:00:11.765125 20784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe8e1f0908234e46881258cfe79835f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 02:00:11.796460 20784 tablet_copy_client.cc:806] T fe8e1f0908234e46881258cfe79835f8 P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Starting download of 0 data blocks...
I20260810 02:00:11.797210 20784 tablet_copy_client.cc:670] T fe8e1f0908234e46881258cfe79835f8 P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Starting download of 1 WAL segments...
I20260810 02:00:11.803578 20784 tablet_copy_client.cc:538] T fe8e1f0908234e46881258cfe79835f8 P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 02:00:11.829066 20784 tablet_bootstrap.cc:492] T fe8e1f0908234e46881258cfe79835f8 P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap starting.
I20260810 02:00:11.843255 6565 raft_consensus.cc:1275] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260810 02:00:11.844254 20770 consensus_queue.cc:1048] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260810 02:00:11.847221 3672 consensus_peers.cc:597] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f -> Peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): Couldn't send request to peer ca4469fc2dbc48488bc7ad7f482f129e. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 02:00:11.848630 20468 raft_consensus.cc:2955] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
I20260810 02:00:11.853936 3551 catalog_manager.cc:5232] ChangeConfig:ADD_PEER:VOTER RPC for tablet 252899385eaa45b392974d2768e3cf01 with cas_config_opid_index 10: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260810 02:00:11.854539 6565 raft_consensus.cc:2955] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
I20260810 02:00:11.860226 3564 catalog_manager.cc:5719] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f reported cstate change: config changed from index 10 to 11, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) added. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
I20260810 02:00:12.089718 20784 tablet_bootstrap.cc:492] T fe8e1f0908234e46881258cfe79835f8 P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=0 applied=13 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 02:00:12.090457 20784 tablet_bootstrap.cc:492] T fe8e1f0908234e46881258cfe79835f8 P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap complete.
I20260810 02:00:12.091372 20784 ts_tablet_manager.cc:1403] T fe8e1f0908234e46881258cfe79835f8 P c5ed5317da9c464b93f979c405f0f6e4: Time spent bootstrapping tablet: real 0.262s user 0.056s sys 0.006s
I20260810 02:00:12.099198 20784 raft_consensus.cc:359] T fe8e1f0908234e46881258cfe79835f8 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 02:00:12.100703 20784 raft_consensus.cc:740] T fe8e1f0908234e46881258cfe79835f8 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ed5317da9c464b93f979c405f0f6e4, State: Initialized, Role: FOLLOWER
I20260810 02:00:12.101399 20784 consensus_queue.cc:260] T fe8e1f0908234e46881258cfe79835f8 P c5ed5317da9c464b93f979c405f0f6e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 1.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 02:00:12.104135 20784 ts_tablet_manager.cc:1434] T fe8e1f0908234e46881258cfe79835f8 P c5ed5317da9c464b93f979c405f0f6e4: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260810 02:00:12.105093 3973 tablet_copy_service.cc:342] P 82f93d1d11364ceeb485585b4ae78871: Request end of tablet copy session c5ed5317da9c464b93f979c405f0f6e4-fe8e1f0908234e46881258cfe79835f8 received from {username='slave'} at 127.21.64.199:41929
I20260810 02:00:12.105238 3973 tablet_copy_service.cc:434] P 82f93d1d11364ceeb485585b4ae78871: ending tablet copy session c5ed5317da9c464b93f979c405f0f6e4-fe8e1f0908234e46881258cfe79835f8 on tablet fe8e1f0908234e46881258cfe79835f8 with peer c5ed5317da9c464b93f979c405f0f6e4
I20260810 02:00:12.242254 20862 ts_tablet_manager.cc:933] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e: Initiating tablet copy from peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
I20260810 02:00:12.254252 20862 tablet_copy_client.cc:323] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.193:36797
I20260810 02:00:12.255330 3787 tablet_copy_service.cc:140] P dc85be7d460a404f997177f57680850f: Received BeginTabletCopySession request for tablet 252899385eaa45b392974d2768e3cf01 from peer ca4469fc2dbc48488bc7ad7f482f129e ({username='slave'} at 127.21.64.196:44631)
I20260810 02:00:12.255529 3787 tablet_copy_service.cc:161] P dc85be7d460a404f997177f57680850f: Beginning new tablet copy session on tablet 252899385eaa45b392974d2768e3cf01 from peer ca4469fc2dbc48488bc7ad7f482f129e at {username='slave'} at 127.21.64.196:44631: session id = ca4469fc2dbc48488bc7ad7f482f129e-252899385eaa45b392974d2768e3cf01
I20260810 02:00:12.260568 3787 tablet_copy_source_session.cc:215] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 02:00:12.262946 20862 ts_tablet_manager.cc:1916] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260810 02:00:12.273895 20862 ts_tablet_manager.cc:1929] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.8
I20260810 02:00:12.274173 20862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 252899385eaa45b392974d2768e3cf01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 02:00:12.283763 20862 tablet_copy_client.cc:806] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e: tablet copy: Starting download of 0 data blocks...
I20260810 02:00:12.284221 20862 tablet_copy_client.cc:670] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e: tablet copy: Starting download of 1 WAL segments...
I20260810 02:00:12.288733 20862 tablet_copy_client.cc:538] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 02:00:12.301132 20862 tablet_bootstrap.cc:492] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e: Bootstrap starting.
I20260810 02:00:12.396369 3756 consensus_queue.cc:237] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 02:00:12.402601 6565 raft_consensus.cc:1275] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20260810 02:00:12.405030 20468 consensus_queue.cc:1048] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260810 02:00:12.462491 20920 raft_consensus.cc:2955] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.12: config changed from index 11 to 12, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:12.466298 6565 raft_consensus.cc:2955] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:12.475080 3574 catalog_manager.cc:5719] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683 reported cstate change: config changed from index 11 to 12, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:12.536666 4284 tablet_service.cc:1558] Processing DeleteTablet for tablet 252899385eaa45b392974d2768e3cf01 with delete_type TABLET_DATA_TOMBSTONED (TS ca4469fc2dbc48488bc7ad7f482f129e not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:40788
I20260810 02:00:12.537885 3756 consensus_queue.cc:237] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 02:00:12.542045 6735 raft_consensus.cc:1217] T fe8e1f0908234e46881258cfe79835f8 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.12->[1.13-1.13] Dedup: 1.13->[]
I20260810 02:00:12.545943 20862 tablet_bootstrap.cc:492] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 02:00:12.545991 3759 consensus_queue.cc:237] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 02:00:12.547461 20862 tablet_bootstrap.cc:492] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e: Bootstrap complete.
I20260810 02:00:12.547948 20862 ts_tablet_manager.cc:1403] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e: Time spent bootstrapping tablet: real 0.247s user 0.074s sys 0.004s
I20260810 02:00:12.548900 20862 raft_consensus.cc:359] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
W20260810 02:00:12.549233 3553 catalog_manager.cc:5030] TS ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): delete failed for tablet 252899385eaa45b392974d2768e3cf01 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 252899385eaa45b392974d2768e3cf01 already in progress: copying tablet
I20260810 02:00:12.549353 6565 raft_consensus.cc:1275] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20260810 02:00:12.549438 20862 raft_consensus.cc:740] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca4469fc2dbc48488bc7ad7f482f129e, State: Initialized, Role: FOLLOWER
I20260810 02:00:12.550761 20862 consensus_queue.cc:260] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 1.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 02:00:12.551581 20862 ts_tablet_manager.cc:1434] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 02:00:12.556059 3787 tablet_copy_service.cc:342] P dc85be7d460a404f997177f57680850f: Request end of tablet copy session ca4469fc2dbc48488bc7ad7f482f129e-252899385eaa45b392974d2768e3cf01 received from {username='slave'} at 127.21.64.196:44631
I20260810 02:00:12.556208 3787 tablet_copy_service.cc:434] P dc85be7d460a404f997177f57680850f: ending tablet copy session ca4469fc2dbc48488bc7ad7f482f129e-252899385eaa45b392974d2768e3cf01 on tablet 252899385eaa45b392974d2768e3cf01 with peer ca4469fc2dbc48488bc7ad7f482f129e
W20260810 02:00:12.559571 3672 consensus_peers.cc:597] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f -> Peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): Couldn't send request to peer ca4469fc2dbc48488bc7ad7f482f129e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260810 02:00:12.559933 20468 consensus_queue.cc:1048] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260810 02:00:12.563649 4286 tablet_service.cc:1558] Processing DeleteTablet for tablet 252899385eaa45b392974d2768e3cf01 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 11 (current committed config index is 12)) from {username='slave'} at 127.0.0.1:40788
I20260810 02:00:12.564208 20948 tablet_replica.cc:333] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e: stopping tablet replica
I20260810 02:00:12.564495 20948 raft_consensus.cc:2243] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:12.564711 20948 raft_consensus.cc:2272] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:12.565219 20468 raft_consensus.cc:2955] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
I20260810 02:00:12.566512 20948 ts_tablet_manager.cc:1916] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 02:00:12.570410 6565 raft_consensus.cc:2955] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
I20260810 02:00:12.576072 3551 catalog_manager.cc:5232] ChangeConfig:ADD_PEER:VOTER RPC for tablet 252899385eaa45b392974d2768e3cf01 with cas_config_opid_index 12: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260810 02:00:12.581667 3563 catalog_manager.cc:5719] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f reported cstate change: config changed from index 12 to 13, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) added. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
I20260810 02:00:12.582266 20948 ts_tablet_manager.cc:1929] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.11
I20260810 02:00:12.582520 20948 log.cc:1199] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal/wals/252899385eaa45b392974d2768e3cf01
I20260810 02:00:12.584956 3553 catalog_manager.cc:5050] TS ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): tablet 252899385eaa45b392974d2768e3cf01 (table rebalance_test_table_8 [id=afa71147917d44a585bcbaa37497a2b1]) successfully deleted
I20260810 02:00:12.598467 6735 raft_consensus.cc:1275] T cf531b93380e43bfa103837bd6350834 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260810 02:00:12.599092 20932 consensus_queue.cc:1048] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 02:00:12.602140 6567 raft_consensus.cc:1275] T cf531b93380e43bfa103837bd6350834 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260810 02:00:12.603133 20468 consensus_queue.cc:1048] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 02:00:12.637463 20932 raft_consensus.cc:2955] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 02:00:12.642853 6565 raft_consensus.cc:2955] T cf531b93380e43bfa103837bd6350834 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 02:00:12.651938 3563 catalog_manager.cc:5719] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f reported cstate change: config changed from index 8 to 9, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) evicted. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 02:00:12.657408 6369 tablet_service.cc:1558] Processing DeleteTablet for tablet cf531b93380e43bfa103837bd6350834 with delete_type TABLET_DATA_TOMBSTONED (TS 4dd4cba155c941b4b7ad4d64c7431536 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:60156
I20260810 02:00:12.660424 6734 raft_consensus.cc:2955] T cf531b93380e43bfa103837bd6350834 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 02:00:12.683880 20990 tablet_replica.cc:333] T cf531b93380e43bfa103837bd6350834 P 4dd4cba155c941b4b7ad4d64c7431536: stopping tablet replica
I20260810 02:00:12.684788 20990 raft_consensus.cc:2243] T cf531b93380e43bfa103837bd6350834 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:12.685160 20990 raft_consensus.cc:2272] T cf531b93380e43bfa103837bd6350834 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:12.686105 20990 ts_tablet_manager.cc:1916] T cf531b93380e43bfa103837bd6350834 P 4dd4cba155c941b4b7ad4d64c7431536: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 02:00:12.694584 20990 ts_tablet_manager.cc:1929] T cf531b93380e43bfa103837bd6350834 P 4dd4cba155c941b4b7ad4d64c7431536: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20260810 02:00:12.694761 20990 log.cc:1199] T cf531b93380e43bfa103837bd6350834 P 4dd4cba155c941b4b7ad4d64c7431536: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/wal/wals/cf531b93380e43bfa103837bd6350834
I20260810 02:00:12.695745 3551 catalog_manager.cc:5050] TS 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197:38787): tablet cf531b93380e43bfa103837bd6350834 (table rebalance_test_table_3 [id=c515c90b2c71492f812b4df18501ee04]) successfully deleted
I20260810 02:00:12.709673 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:12.755038 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:12.759467 6395 consensus_queue.cc:237] T 0afbd7afdd834537b15c727355724562 P 4dd4cba155c941b4b7ad4d64c7431536 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 2.9, Last appended by leader: 8, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 02:00:12.770953 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:12.781759 6907 raft_consensus.cc:1275] T 0afbd7afdd834537b15c727355724562 P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Refusing update from remote peer 4dd4cba155c941b4b7ad4d64c7431536: Log matching property violated. Preceding OpId in replica: term: 2 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20260810 02:00:12.782735 20619 consensus_queue.cc:1048] T 0afbd7afdd834537b15c727355724562 P 4dd4cba155c941b4b7ad4d64c7431536 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260810 02:00:12.792052 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:12.794343 6563 raft_consensus.cc:1275] T 0afbd7afdd834537b15c727355724562 P 22ce0e487f0341fd9bf853393d6e7683 [term 2 FOLLOWER]: Refusing update from remote peer 4dd4cba155c941b4b7ad4d64c7431536: Log matching property violated. Preceding OpId in replica: term: 2 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20260810 02:00:12.795128 20619 consensus_queue.cc:1048] T 0afbd7afdd834537b15c727355724562 P 4dd4cba155c941b4b7ad4d64c7431536 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260810 02:00:12.855125 6563 raft_consensus.cc:2955] T 0afbd7afdd834537b15c727355724562 P 22ce0e487f0341fd9bf853393d6e7683 [term 2 FOLLOWER]: Committing config change with OpId 2.10: config changed from index 8 to 10, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:12.858493 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:12.867952 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:12.871069 3565 catalog_manager.cc:5719] T 0afbd7afdd834537b15c727355724562 P 22ce0e487f0341fd9bf853393d6e7683 reported cstate change: config changed from index 8 to 10, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New cstate: current_term: 2 leader_uuid: "4dd4cba155c941b4b7ad4d64c7431536" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:12.873225 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:12.876259 4284 tablet_service.cc:1558] Processing DeleteTablet for tablet 0afbd7afdd834537b15c727355724562 with delete_type TABLET_DATA_TOMBSTONED (TS ca4469fc2dbc48488bc7ad7f482f129e not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:40788
I20260810 02:00:12.876645 20948 tablet_replica.cc:333] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e: stopping tablet replica
I20260810 02:00:12.876925 20948 raft_consensus.cc:2243] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:12.877127 20948 raft_consensus.cc:2272] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:12.878093 20948 ts_tablet_manager.cc:1916] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260810 02:00:12.883869 6308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.200:32995, user_credentials={real_user=slave}} blocked reactor thread for 49156.6us
I20260810 02:00:12.853590 21033 raft_consensus.cc:2955] T 0afbd7afdd834537b15c727355724562 P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 LEADER]: Committing config change with OpId 2.10: config changed from index 8 to 10, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:12.891144 6907 raft_consensus.cc:2955] T 0afbd7afdd834537b15c727355724562 P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Committing config change with OpId 2.10: config changed from index 8 to 10, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:12.943262 6369 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:12.956909 20948 ts_tablet_manager.cc:1929] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.9
I20260810 02:00:12.961460 20948 log.cc:1199] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal/wals/0afbd7afdd834537b15c727355724562
I20260810 02:00:12.962617 3553 catalog_manager.cc:5050] TS ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): tablet 0afbd7afdd834537b15c727355724562 (table rebalance_test_table_0 [id=8fd8ee0beeb54ad9bee1c94775d09e8f]) successfully deleted
I20260810 02:00:13.464004 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:13.508725 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:13.557216 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:13.564500 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:13.598467 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:13.607782 6369 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:13.637750 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:13.675655 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:13.692855 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:13.694074 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:13.733570 21229 ts_tablet_manager.cc:933] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e: Initiating tablet copy from peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
I20260810 02:00:13.757634 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:13.762426 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:13.790781 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:13.814415 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:13.835634 21229 tablet_copy_client.cc:323] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.193:36797
I20260810 02:00:13.836645 3787 tablet_copy_service.cc:140] P dc85be7d460a404f997177f57680850f: Received BeginTabletCopySession request for tablet 252899385eaa45b392974d2768e3cf01 from peer ca4469fc2dbc48488bc7ad7f482f129e ({username='slave'} at 127.21.64.196:44631)
I20260810 02:00:13.836890 3787 tablet_copy_service.cc:161] P dc85be7d460a404f997177f57680850f: Beginning new tablet copy session on tablet 252899385eaa45b392974d2768e3cf01 from peer ca4469fc2dbc48488bc7ad7f482f129e at {username='slave'} at 127.21.64.196:44631: session id = ca4469fc2dbc48488bc7ad7f482f129e-252899385eaa45b392974d2768e3cf01
I20260810 02:00:13.841869 3787 tablet_copy_source_session.cc:215] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 02:00:13.843321 21229 ts_tablet_manager.cc:1916] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260810 02:00:13.846601 6369 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:13.889021 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:13.896471 21229 ts_tablet_manager.cc:1929] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.11
I20260810 02:00:13.919448 21229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 252899385eaa45b392974d2768e3cf01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 02:00:13.923455 21229 tablet_copy_client.cc:806] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e: tablet copy: Starting download of 0 data blocks...
I20260810 02:00:13.960115 21229 tablet_copy_client.cc:670] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e: tablet copy: Starting download of 1 WAL segments...
I20260810 02:00:13.964131 21229 tablet_copy_client.cc:538] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 02:00:13.975090 21229 tablet_bootstrap.cc:492] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e: Bootstrap starting.
I20260810 02:00:14.078557 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:14.081893 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:14.141263 6369 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:14.162225 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:14.178031 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:14.206440 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:14.231685 21229 tablet_bootstrap.cc:492] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=0 applied=13 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 02:00:14.232290 21229 tablet_bootstrap.cc:492] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e: Bootstrap complete.
I20260810 02:00:14.232626 21229 ts_tablet_manager.cc:1403] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e: Time spent bootstrapping tablet: real 0.258s user 0.073s sys 0.001s
I20260810 02:00:14.233604 21229 raft_consensus.cc:359] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 02:00:14.243746 21229 raft_consensus.cc:740] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca4469fc2dbc48488bc7ad7f482f129e, State: Initialized, Role: FOLLOWER
I20260810 02:00:14.244186 21229 consensus_queue.cc:260] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 1.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 02:00:14.245173 21229 ts_tablet_manager.cc:1434] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e: Time spent starting tablet: real 0.012s user 0.005s sys 0.000s
I20260810 02:00:14.246309 3787 tablet_copy_service.cc:342] P dc85be7d460a404f997177f57680850f: Request end of tablet copy session ca4469fc2dbc48488bc7ad7f482f129e-252899385eaa45b392974d2768e3cf01 received from {username='slave'} at 127.21.64.196:44631
I20260810 02:00:14.246464 3787 tablet_copy_service.cc:434] P dc85be7d460a404f997177f57680850f: ending tablet copy session ca4469fc2dbc48488bc7ad7f482f129e-252899385eaa45b392974d2768e3cf01 on tablet 252899385eaa45b392974d2768e3cf01 with peer ca4469fc2dbc48488bc7ad7f482f129e
I20260810 02:00:14.264544 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:14.270942 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:14.446744 4311 consensus_queue.cc:237] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 02:00:14.462491 6734 raft_consensus.cc:1275] T 7207ea155ba44c0a9ba216acd22dc1b4 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 02:00:14.463254 21123 consensus_queue.cc:1048] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 02:00:14.463291 3943 raft_consensus.cc:1275] T 7207ea155ba44c0a9ba216acd22dc1b4 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 02:00:14.465611 21123 consensus_queue.cc:1048] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 02:00:14.484517 20465 raft_consensus.cc:2955] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:14.490226 3943 raft_consensus.cc:2955] T 7207ea155ba44c0a9ba216acd22dc1b4 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:14.511338 3573 catalog_manager.cc:5719] T 7207ea155ba44c0a9ba216acd22dc1b4 P 82f93d1d11364ceeb485585b4ae78871 reported cstate change: config changed from index 6 to 7, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
W20260810 02:00:14.550149 4224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.199:41689, user_credentials={real_user=slave}} blocked reactor thread for 60709.8us
I20260810 02:00:14.552318 6734 raft_consensus.cc:2955] T 7207ea155ba44c0a9ba216acd22dc1b4 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:14.568935 3735 tablet_service.cc:1558] Processing DeleteTablet for tablet 7207ea155ba44c0a9ba216acd22dc1b4 with delete_type TABLET_DATA_TOMBSTONED (TS dc85be7d460a404f997177f57680850f not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:33870
I20260810 02:00:14.576319 4311 raft_consensus.cc:1217] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.12->[1.13-1.13] Dedup: 1.13->[]
I20260810 02:00:14.580399 21385 tablet_replica.cc:333] T 7207ea155ba44c0a9ba216acd22dc1b4 P dc85be7d460a404f997177f57680850f: stopping tablet replica
I20260810 02:00:14.635596 3943 consensus_queue.cc:237] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 02:00:14.651912 21385 raft_consensus.cc:2243] T 7207ea155ba44c0a9ba216acd22dc1b4 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:14.652258 21385 raft_consensus.cc:2272] T 7207ea155ba44c0a9ba216acd22dc1b4 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:14.653203 21385 ts_tablet_manager.cc:1916] T 7207ea155ba44c0a9ba216acd22dc1b4 P dc85be7d460a404f997177f57680850f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 02:00:14.673573 21385 ts_tablet_manager.cc:1929] T 7207ea155ba44c0a9ba216acd22dc1b4 P dc85be7d460a404f997177f57680850f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20260810 02:00:14.674763 21385 log.cc:1199] T 7207ea155ba44c0a9ba216acd22dc1b4 P dc85be7d460a404f997177f57680850f: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/wal/wals/7207ea155ba44c0a9ba216acd22dc1b4
I20260810 02:00:14.682538 3551 catalog_manager.cc:5050] TS dc85be7d460a404f997177f57680850f (127.21.64.193:36797): tablet 7207ea155ba44c0a9ba216acd22dc1b4 (table rebalance_test_table_2 [id=5e8751d351ba4b7da7861e02b0c3c634]) successfully deleted
W20260810 02:00:14.692981 6653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.193:36797, user_credentials={real_user=slave}} blocked reactor thread for 59192.4us
I20260810 02:00:14.701560 4131 raft_consensus.cc:1275] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260810 02:00:14.702533 21270 consensus_queue.cc:1048] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 02:00:14.705936 6907 raft_consensus.cc:1275] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260810 02:00:14.706506 21270 raft_consensus.cc:2955] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } }
I20260810 02:00:14.709437 21397 consensus_queue.cc:1048] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 02:00:14.711063 4131 raft_consensus.cc:2955] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } }
I20260810 02:00:14.722767 3565 catalog_manager.cc:5719] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302 reported cstate change: config changed from index 8 to 9, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) evicted. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } }
I20260810 02:00:14.725086 6907 raft_consensus.cc:2955] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } }
I20260810 02:00:14.740717 6714 tablet_service.cc:1558] Processing DeleteTablet for tablet 18a93b1a1ce1440b99bdd7a3bcf49064 with delete_type TABLET_DATA_TOMBSTONED (TS c5ed5317da9c464b93f979c405f0f6e4 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:58550
I20260810 02:00:14.748694 21431 tablet_replica.cc:333] T 18a93b1a1ce1440b99bdd7a3bcf49064 P c5ed5317da9c464b93f979c405f0f6e4: stopping tablet replica
I20260810 02:00:14.749567 21431 raft_consensus.cc:2243] T 18a93b1a1ce1440b99bdd7a3bcf49064 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:14.750566 21431 raft_consensus.cc:2272] T 18a93b1a1ce1440b99bdd7a3bcf49064 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:14.751513 21431 ts_tablet_manager.cc:1916] T 18a93b1a1ce1440b99bdd7a3bcf49064 P c5ed5317da9c464b93f979c405f0f6e4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 02:00:14.762959 21431 ts_tablet_manager.cc:1929] T 18a93b1a1ce1440b99bdd7a3bcf49064 P c5ed5317da9c464b93f979c405f0f6e4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20260810 02:00:14.763260 21431 log.cc:1199] T 18a93b1a1ce1440b99bdd7a3bcf49064 P c5ed5317da9c464b93f979c405f0f6e4: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/wal/wals/18a93b1a1ce1440b99bdd7a3bcf49064
I20260810 02:00:14.764446 3554 catalog_manager.cc:5050] TS c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199:41689): tablet 18a93b1a1ce1440b99bdd7a3bcf49064 (table rebalance_test_table_5 [id=e211628d46b64734960dfd60d86708ce]) successfully deleted
I20260810 02:00:14.793977 4311 consensus_queue.cc:237] T 606ad043ee3344c39c9eef7cd1920d7e P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 02:00:14.811731 3756 raft_consensus.cc:1275] T 606ad043ee3344c39c9eef7cd1920d7e P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 02:00:14.812783 21123 consensus_queue.cc:1048] T 606ad043ee3344c39c9eef7cd1920d7e P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 02:00:14.820591 4131 raft_consensus.cc:1275] T 606ad043ee3344c39c9eef7cd1920d7e P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 02:00:14.821656 21123 consensus_queue.cc:1048] T 606ad043ee3344c39c9eef7cd1920d7e P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 02:00:14.848901 21123 raft_consensus.cc:2955] T 606ad043ee3344c39c9eef7cd1920d7e P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } }
I20260810 02:00:14.850785 4131 raft_consensus.cc:2955] T 606ad043ee3344c39c9eef7cd1920d7e P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } }
I20260810 02:00:14.858100 3564 catalog_manager.cc:5719] T 606ad043ee3344c39c9eef7cd1920d7e P 17b49c694faf479ea2e5083470fc0302 reported cstate change: config changed from index 6 to 7, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) evicted. New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } }
I20260810 02:00:14.865044 6884 tablet_service.cc:1558] Processing DeleteTablet for tablet 606ad043ee3344c39c9eef7cd1920d7e with delete_type TABLET_DATA_TOMBSTONED (TS 3136daf7101445beadc1aa19bc01c227 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:41662
I20260810 02:00:14.870002 3756 raft_consensus.cc:2955] T 606ad043ee3344c39c9eef7cd1920d7e P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } }
I20260810 02:00:14.884747 21473 tablet_replica.cc:333] T 606ad043ee3344c39c9eef7cd1920d7e P 3136daf7101445beadc1aa19bc01c227: stopping tablet replica
I20260810 02:00:14.885268 21473 raft_consensus.cc:2243] T 606ad043ee3344c39c9eef7cd1920d7e P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:14.885694 21473 raft_consensus.cc:2272] T 606ad043ee3344c39c9eef7cd1920d7e P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:14.889580 21473 ts_tablet_manager.cc:1916] T 606ad043ee3344c39c9eef7cd1920d7e P 3136daf7101445beadc1aa19bc01c227: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 02:00:14.918329 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:14.920168 21473 ts_tablet_manager.cc:1929] T 606ad043ee3344c39c9eef7cd1920d7e P 3136daf7101445beadc1aa19bc01c227: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20260810 02:00:14.922958 21473 log.cc:1199] T 606ad043ee3344c39c9eef7cd1920d7e P 3136daf7101445beadc1aa19bc01c227: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/wal/wals/606ad043ee3344c39c9eef7cd1920d7e
I20260810 02:00:14.924772 3551 catalog_manager.cc:5050] TS 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995): tablet 606ad043ee3344c39c9eef7cd1920d7e (table rebalance_test_table_4 [id=3e1f7b9b31614ed383207098de38230c]) successfully deleted
I20260810 02:00:14.954975 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:14.972463 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:15.079012 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
W20260810 02:00:15.101034 3670 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.197:38787, user_credentials={real_user=slave}} blocked reactor thread for 133698us
W20260810 02:00:15.103454 3673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.199:41689, user_credentials={real_user=slave}} blocked reactor thread for 135275us
I20260810 02:00:15.128893 6369 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:15.165840 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:15.178488 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:15.196643 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:15.235066 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:15.282630 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:15.289359 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:15.390913 6369 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:15.421433 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:15.448091 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:15.511524 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:15.574524 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:15.874209 3756 consensus_queue.cc:237] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 1.13, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
W20260810 02:00:15.890183 3670 consensus_peers.cc:597] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f -> Peer 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995): Couldn't send request to peer 3136daf7101445beadc1aa19bc01c227. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 02:00:15.892709 6563 raft_consensus.cc:1275] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 13. Preceding OpId from leader: term: 1 index: 14. (index mismatch)
I20260810 02:00:15.893545 4311 raft_consensus.cc:1275] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 13. Preceding OpId from leader: term: 1 index: 14. (index mismatch)
I20260810 02:00:15.894423 21491 consensus_queue.cc:1048] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260810 02:00:15.909868 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:15.977257 21491 consensus_queue.cc:1048] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260810 02:00:15.998903 21491 raft_consensus.cc:2955] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.14: config changed from index 13 to 14, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:16.010973 6563 raft_consensus.cc:2955] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.14: config changed from index 13 to 14, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:16.013801 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:16.015949 3564 catalog_manager.cc:5719] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f reported cstate change: config changed from index 13 to 14, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:16.016883 4311 raft_consensus.cc:2955] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Committing config change with OpId 1.14: config changed from index 13 to 14, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:16.080839 6369 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:16.093415 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:16.095288 6395 consensus_queue.cc:237] T 0afbd7afdd834537b15c727355724562 P 4dd4cba155c941b4b7ad4d64c7431536 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 2.10, Last appended by leader: 8, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 02:00:16.138235 6563 raft_consensus.cc:1275] T 0afbd7afdd834537b15c727355724562 P 22ce0e487f0341fd9bf853393d6e7683 [term 2 FOLLOWER]: Refusing update from remote peer 4dd4cba155c941b4b7ad4d64c7431536: Log matching property violated. Preceding OpId in replica: term: 2 index: 10. Preceding OpId from leader: term: 2 index: 11. (index mismatch)
I20260810 02:00:16.138978 21033 consensus_queue.cc:1048] T 0afbd7afdd834537b15c727355724562 P 4dd4cba155c941b4b7ad4d64c7431536 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260810 02:00:16.155694 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:16.166760 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:16.189312 21734 raft_consensus.cc:2955] T 0afbd7afdd834537b15c727355724562 P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 LEADER]: Committing config change with OpId 2.11: config changed from index 10 to 11, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:16.191789 6563 raft_consensus.cc:2955] T 0afbd7afdd834537b15c727355724562 P 22ce0e487f0341fd9bf853393d6e7683 [term 2 FOLLOWER]: Committing config change with OpId 2.11: config changed from index 10 to 11, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:16.202486 3564 catalog_manager.cc:5719] T 0afbd7afdd834537b15c727355724562 P 22ce0e487f0341fd9bf853393d6e7683 reported cstate change: config changed from index 10 to 11, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) evicted. New cstate: current_term: 2 leader_uuid: "4dd4cba155c941b4b7ad4d64c7431536" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:16.207237 6884 tablet_service.cc:1558] Processing DeleteTablet for tablet 0afbd7afdd834537b15c727355724562 with delete_type TABLET_DATA_TOMBSTONED (TS 3136daf7101445beadc1aa19bc01c227 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:41662
I20260810 02:00:16.212826 21743 tablet_replica.cc:333] T 0afbd7afdd834537b15c727355724562 P 3136daf7101445beadc1aa19bc01c227: stopping tablet replica
I20260810 02:00:16.213114 21743 raft_consensus.cc:2243] T 0afbd7afdd834537b15c727355724562 P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:16.213416 21743 raft_consensus.cc:2272] T 0afbd7afdd834537b15c727355724562 P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:16.220307 21743 ts_tablet_manager.cc:1916] T 0afbd7afdd834537b15c727355724562 P 3136daf7101445beadc1aa19bc01c227: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 02:00:16.229259 21743 ts_tablet_manager.cc:1929] T 0afbd7afdd834537b15c727355724562 P 3136daf7101445beadc1aa19bc01c227: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.10
I20260810 02:00:16.229615 21743 log.cc:1199] T 0afbd7afdd834537b15c727355724562 P 3136daf7101445beadc1aa19bc01c227: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/wal/wals/0afbd7afdd834537b15c727355724562
I20260810 02:00:16.230585 3551 catalog_manager.cc:5050] TS 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995): tablet 0afbd7afdd834537b15c727355724562 (table rebalance_test_table_0 [id=8fd8ee0beeb54ad9bee1c94775d09e8f]) successfully deleted
I20260810 02:00:16.289803 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:16.294688 6395 consensus_queue.cc:237] T 0afbd7afdd834537b15c727355724562 P 4dd4cba155c941b4b7ad4d64c7431536 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 2.11, Last appended by leader: 8, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 02:00:16.301287 6565 raft_consensus.cc:1275] T 0afbd7afdd834537b15c727355724562 P 22ce0e487f0341fd9bf853393d6e7683 [term 2 FOLLOWER]: Refusing update from remote peer 4dd4cba155c941b4b7ad4d64c7431536: Log matching property violated. Preceding OpId in replica: term: 2 index: 11. Preceding OpId from leader: term: 2 index: 12. (index mismatch)
I20260810 02:00:16.303603 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
W20260810 02:00:16.304993 6311 consensus_peers.cc:597] T 0afbd7afdd834537b15c727355724562 P 4dd4cba155c941b4b7ad4d64c7431536 -> Peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): Couldn't send request to peer ca4469fc2dbc48488bc7ad7f482f129e. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 02:00:16.305157 21753 consensus_queue.cc:1048] T 0afbd7afdd834537b15c727355724562 P 4dd4cba155c941b4b7ad4d64c7431536 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260810 02:00:16.318872 21734 raft_consensus.cc:2955] T 0afbd7afdd834537b15c727355724562 P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 LEADER]: Committing config change with OpId 2.12: config changed from index 11 to 12, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
I20260810 02:00:16.321774 6563 raft_consensus.cc:2955] T 0afbd7afdd834537b15c727355724562 P 22ce0e487f0341fd9bf853393d6e7683 [term 2 FOLLOWER]: Committing config change with OpId 2.12: config changed from index 11 to 12, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
I20260810 02:00:16.329319 3551 catalog_manager.cc:5232] ChangeConfig:ADD_PEER:VOTER RPC for tablet 0afbd7afdd834537b15c727355724562 with cas_config_opid_index 11: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260810 02:00:16.329512 3564 catalog_manager.cc:5719] T 0afbd7afdd834537b15c727355724562 P 4dd4cba155c941b4b7ad4d64c7431536 reported cstate change: config changed from index 11 to 12, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) added. New cstate: current_term: 2 leader_uuid: "4dd4cba155c941b4b7ad4d64c7431536" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
I20260810 02:00:16.334390 21754 ts_tablet_manager.cc:933] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227: Initiating tablet copy from peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
I20260810 02:00:16.343007 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:16.350540 3756 consensus_queue.cc:237] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
W20260810 02:00:16.365027 3672 consensus_peers.cc:597] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f -> Peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): Couldn't send request to peer 82f93d1d11364ceeb485585b4ae78871. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cf531b93380e43bfa103837bd6350834. This is attempt 1: this message will repeat every 5th retry.
I20260810 02:00:16.366611 6734 raft_consensus.cc:1275] T cf531b93380e43bfa103837bd6350834 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260810 02:00:16.367445 21491 consensus_queue.cc:1048] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260810 02:00:16.376071 6563 raft_consensus.cc:1275] T cf531b93380e43bfa103837bd6350834 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260810 02:00:16.376986 21491 consensus_queue.cc:1048] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260810 02:00:16.413545 21491 raft_consensus.cc:2955] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:16.418097 6735 raft_consensus.cc:2955] T cf531b93380e43bfa103837bd6350834 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:16.431878 21754 tablet_copy_client.cc:323] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.193:36797
I20260810 02:00:16.433393 3787 tablet_copy_service.cc:140] P dc85be7d460a404f997177f57680850f: Received BeginTabletCopySession request for tablet 252899385eaa45b392974d2768e3cf01 from peer 3136daf7101445beadc1aa19bc01c227 ({username='slave'} at 127.21.64.200:47703)
I20260810 02:00:16.433568 3787 tablet_copy_service.cc:161] P dc85be7d460a404f997177f57680850f: Beginning new tablet copy session on tablet 252899385eaa45b392974d2768e3cf01 from peer 3136daf7101445beadc1aa19bc01c227 at {username='slave'} at 127.21.64.200:47703: session id = 3136daf7101445beadc1aa19bc01c227-252899385eaa45b392974d2768e3cf01
I20260810 02:00:16.436655 3787 tablet_copy_source_session.cc:215] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 02:00:16.438051 21754 ts_tablet_manager.cc:1916] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260810 02:00:16.438428 3564 catalog_manager.cc:5719] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f reported cstate change: config changed from index 9 to 10, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) added. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:16.445549 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:16.446142 6563 raft_consensus.cc:2955] T cf531b93380e43bfa103837bd6350834 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:16.463971 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:16.485920 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:16.486510 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:16.490712 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:16.505805 6369 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:16.523139 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:16.535966 21754 ts_tablet_manager.cc:1929] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.9
I20260810 02:00:16.536405 21754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 252899385eaa45b392974d2768e3cf01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 02:00:16.538592 6369 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:16.539186 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:16.574962 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:16.576390 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:16.596158 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:16.608786 21754 tablet_copy_client.cc:806] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Starting download of 0 data blocks...
I20260810 02:00:16.609169 21754 tablet_copy_client.cc:670] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Starting download of 1 WAL segments...
I20260810 02:00:16.613374 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:16.621652 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:16.649430 21754 tablet_copy_client.cc:538] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 02:00:16.671326 21754 tablet_bootstrap.cc:492] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227: Bootstrap starting.
I20260810 02:00:16.682461 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:16.763193 21816 ts_tablet_manager.cc:933] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e: Initiating tablet copy from peer 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197:38787)
I20260810 02:00:16.821446 21816 tablet_copy_client.cc:323] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.197:38787
I20260810 02:00:16.822752 6422 tablet_copy_service.cc:140] P 4dd4cba155c941b4b7ad4d64c7431536: Received BeginTabletCopySession request for tablet 0afbd7afdd834537b15c727355724562 from peer ca4469fc2dbc48488bc7ad7f482f129e ({username='slave'} at 127.21.64.196:59623)
I20260810 02:00:16.823074 6422 tablet_copy_service.cc:161] P 4dd4cba155c941b4b7ad4d64c7431536: Beginning new tablet copy session on tablet 0afbd7afdd834537b15c727355724562 from peer ca4469fc2dbc48488bc7ad7f482f129e at {username='slave'} at 127.21.64.196:59623: session id = ca4469fc2dbc48488bc7ad7f482f129e-0afbd7afdd834537b15c727355724562
I20260810 02:00:16.831566 6422 tablet_copy_source_session.cc:215] T 0afbd7afdd834537b15c727355724562 P 4dd4cba155c941b4b7ad4d64c7431536: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 02:00:16.833946 21816 ts_tablet_manager.cc:1916] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260810 02:00:16.879350 21816 ts_tablet_manager.cc:1929] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 2.9
I20260810 02:00:16.892549 21844 ts_tablet_manager.cc:933] T cf531b93380e43bfa103837bd6350834 P 82f93d1d11364ceeb485585b4ae78871: Initiating tablet copy from peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
I20260810 02:00:16.901468 21816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0afbd7afdd834537b15c727355724562. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 02:00:16.909766 21844 tablet_copy_client.cc:323] T cf531b93380e43bfa103837bd6350834 P 82f93d1d11364ceeb485585b4ae78871: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.193:36797
I20260810 02:00:16.910883 3787 tablet_copy_service.cc:140] P dc85be7d460a404f997177f57680850f: Received BeginTabletCopySession request for tablet cf531b93380e43bfa103837bd6350834 from peer 82f93d1d11364ceeb485585b4ae78871 ({username='slave'} at 127.21.64.194:46195)
I20260810 02:00:16.911063 3787 tablet_copy_service.cc:161] P dc85be7d460a404f997177f57680850f: Beginning new tablet copy session on tablet cf531b93380e43bfa103837bd6350834 from peer 82f93d1d11364ceeb485585b4ae78871 at {username='slave'} at 127.21.64.194:46195: session id = 82f93d1d11364ceeb485585b4ae78871-cf531b93380e43bfa103837bd6350834
I20260810 02:00:16.916057 3787 tablet_copy_source_session.cc:215] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 02:00:16.919792 21754 tablet_bootstrap.cc:492] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 02:00:16.920220 21754 tablet_bootstrap.cc:492] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227: Bootstrap complete.
I20260810 02:00:16.920480 21754 ts_tablet_manager.cc:1403] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227: Time spent bootstrapping tablet: real 0.249s user 0.051s sys 0.001s
I20260810 02:00:16.921262 21754 raft_consensus.cc:359] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 02:00:16.921511 21754 raft_consensus.cc:740] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3136daf7101445beadc1aa19bc01c227, State: Initialized, Role: FOLLOWER
I20260810 02:00:16.921737 21754 consensus_queue.cc:260] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 1.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 02:00:16.922906 21844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf531b93380e43bfa103837bd6350834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 02:00:16.924697 21754 ts_tablet_manager.cc:1434] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20260810 02:00:16.930646 3787 tablet_copy_service.cc:342] P dc85be7d460a404f997177f57680850f: Request end of tablet copy session 3136daf7101445beadc1aa19bc01c227-252899385eaa45b392974d2768e3cf01 received from {username='slave'} at 127.21.64.200:47703
I20260810 02:00:16.930794 3787 tablet_copy_service.cc:434] P dc85be7d460a404f997177f57680850f: ending tablet copy session 3136daf7101445beadc1aa19bc01c227-252899385eaa45b392974d2768e3cf01 on tablet 252899385eaa45b392974d2768e3cf01 with peer 3136daf7101445beadc1aa19bc01c227
I20260810 02:00:16.930917 21844 tablet_copy_client.cc:806] T cf531b93380e43bfa103837bd6350834 P 82f93d1d11364ceeb485585b4ae78871: tablet copy: Starting download of 0 data blocks...
I20260810 02:00:16.931159 21844 tablet_copy_client.cc:670] T cf531b93380e43bfa103837bd6350834 P 82f93d1d11364ceeb485585b4ae78871: tablet copy: Starting download of 1 WAL segments...
I20260810 02:00:16.934458 21844 tablet_copy_client.cc:538] T cf531b93380e43bfa103837bd6350834 P 82f93d1d11364ceeb485585b4ae78871: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 02:00:16.921326 21816 tablet_copy_client.cc:806] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e: tablet copy: Starting download of 0 data blocks...
I20260810 02:00:16.940464 21816 tablet_copy_client.cc:670] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e: tablet copy: Starting download of 1 WAL segments...
I20260810 02:00:16.944185 21816 tablet_copy_client.cc:538] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 02:00:16.948055 21816 tablet_bootstrap.cc:492] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e: Bootstrap starting.
I20260810 02:00:16.965842 21844 tablet_bootstrap.cc:492] T cf531b93380e43bfa103837bd6350834 P 82f93d1d11364ceeb485585b4ae78871: Bootstrap starting.
I20260810 02:00:17.065516 6907 consensus_queue.cc:237] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 2.9, Last appended by leader: 5, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 02:00:17.096876 4131 raft_consensus.cc:1275] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302 [term 2 FOLLOWER]: Refusing update from remote peer 3136daf7101445beadc1aa19bc01c227: Log matching property violated. Preceding OpId in replica: term: 2 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20260810 02:00:17.097911 20501 consensus_queue.cc:1048] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260810 02:00:17.104168 3756 raft_consensus.cc:1275] T d05e147199e44b8ca712e18d22e7cce7 P dc85be7d460a404f997177f57680850f [term 2 FOLLOWER]: Refusing update from remote peer 3136daf7101445beadc1aa19bc01c227: Log matching property violated. Preceding OpId in replica: term: 2 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20260810 02:00:17.105053 20501 consensus_queue.cc:1048] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260810 02:00:17.114909 21889 raft_consensus.cc:2955] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227 [term 2 LEADER]: Committing config change with OpId 2.10: config changed from index 9 to 10, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } }
I20260810 02:00:17.117626 4131 raft_consensus.cc:2955] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302 [term 2 FOLLOWER]: Committing config change with OpId 2.10: config changed from index 9 to 10, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } }
I20260810 02:00:17.129537 3564 catalog_manager.cc:5719] T d05e147199e44b8ca712e18d22e7cce7 P 17b49c694faf479ea2e5083470fc0302 reported cstate change: config changed from index 9 to 10, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) evicted. New cstate: current_term: 2 leader_uuid: "3136daf7101445beadc1aa19bc01c227" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } }
I20260810 02:00:17.134869 3756 raft_consensus.cc:2955] T d05e147199e44b8ca712e18d22e7cce7 P dc85be7d460a404f997177f57680850f [term 2 FOLLOWER]: Committing config change with OpId 2.10: config changed from index 9 to 10, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } }
I20260810 02:00:17.159075 21816 tablet_bootstrap.cc:492] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 02:00:17.159890 21816 tablet_bootstrap.cc:492] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e: Bootstrap complete.
I20260810 02:00:17.160271 21816 ts_tablet_manager.cc:1403] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e: Time spent bootstrapping tablet: real 0.212s user 0.060s sys 0.004s
I20260810 02:00:17.161116 21816 raft_consensus.cc:359] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 02:00:17.161497 21816 raft_consensus.cc:740] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca4469fc2dbc48488bc7ad7f482f129e, State: Initialized, Role: FOLLOWER
I20260810 02:00:17.161851 21816 consensus_queue.cc:260] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 2.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 02:00:17.171677 21816 ts_tablet_manager.cc:1434] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e: Time spent starting tablet: real 0.011s user 0.001s sys 0.000s
I20260810 02:00:17.173007 6422 tablet_copy_service.cc:342] P 4dd4cba155c941b4b7ad4d64c7431536: Request end of tablet copy session ca4469fc2dbc48488bc7ad7f482f129e-0afbd7afdd834537b15c727355724562 received from {username='slave'} at 127.21.64.196:59623
I20260810 02:00:17.173198 6422 tablet_copy_service.cc:434] P 4dd4cba155c941b4b7ad4d64c7431536: ending tablet copy session ca4469fc2dbc48488bc7ad7f482f129e-0afbd7afdd834537b15c727355724562 on tablet 0afbd7afdd834537b15c727355724562 with peer ca4469fc2dbc48488bc7ad7f482f129e
I20260810 02:00:17.177946 6369 tablet_service.cc:1558] Processing DeleteTablet for tablet d05e147199e44b8ca712e18d22e7cce7 with delete_type TABLET_DATA_TOMBSTONED (TS 4dd4cba155c941b4b7ad4d64c7431536 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:60156
I20260810 02:00:17.186204 21917 tablet_replica.cc:333] T d05e147199e44b8ca712e18d22e7cce7 P 4dd4cba155c941b4b7ad4d64c7431536: stopping tablet replica
I20260810 02:00:17.190233 21917 raft_consensus.cc:2243] T d05e147199e44b8ca712e18d22e7cce7 P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:17.191476 21917 raft_consensus.cc:2272] T d05e147199e44b8ca712e18d22e7cce7 P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:17.196600 21917 ts_tablet_manager.cc:1916] T d05e147199e44b8ca712e18d22e7cce7 P 4dd4cba155c941b4b7ad4d64c7431536: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 02:00:17.203531 21844 tablet_bootstrap.cc:492] T cf531b93380e43bfa103837bd6350834 P 82f93d1d11364ceeb485585b4ae78871: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 02:00:17.204067 21844 tablet_bootstrap.cc:492] T cf531b93380e43bfa103837bd6350834 P 82f93d1d11364ceeb485585b4ae78871: Bootstrap complete.
I20260810 02:00:17.204378 21844 ts_tablet_manager.cc:1403] T cf531b93380e43bfa103837bd6350834 P 82f93d1d11364ceeb485585b4ae78871: Time spent bootstrapping tablet: real 0.239s user 0.068s sys 0.007s
I20260810 02:00:17.205144 21844 raft_consensus.cc:359] T cf531b93380e43bfa103837bd6350834 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 02:00:17.205444 21844 raft_consensus.cc:740] T cf531b93380e43bfa103837bd6350834 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f93d1d11364ceeb485585b4ae78871, State: Initialized, Role: FOLLOWER
I20260810 02:00:17.205725 21844 consensus_queue.cc:260] T cf531b93380e43bfa103837bd6350834 P 82f93d1d11364ceeb485585b4ae78871 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 1.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 02:00:17.206336 21844 ts_tablet_manager.cc:1434] T cf531b93380e43bfa103837bd6350834 P 82f93d1d11364ceeb485585b4ae78871: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 02:00:17.208742 3787 tablet_copy_service.cc:342] P dc85be7d460a404f997177f57680850f: Request end of tablet copy session 82f93d1d11364ceeb485585b4ae78871-cf531b93380e43bfa103837bd6350834 received from {username='slave'} at 127.21.64.194:46195
I20260810 02:00:17.208878 3787 tablet_copy_service.cc:434] P dc85be7d460a404f997177f57680850f: ending tablet copy session 82f93d1d11364ceeb485585b4ae78871-cf531b93380e43bfa103837bd6350834 on tablet cf531b93380e43bfa103837bd6350834 with peer 82f93d1d11364ceeb485585b4ae78871
I20260810 02:00:17.233186 21917 ts_tablet_manager.cc:1929] T d05e147199e44b8ca712e18d22e7cce7 P 4dd4cba155c941b4b7ad4d64c7431536: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.9
I20260810 02:00:17.235714 21917 log.cc:1199] T d05e147199e44b8ca712e18d22e7cce7 P 4dd4cba155c941b4b7ad4d64c7431536: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/wal/wals/d05e147199e44b8ca712e18d22e7cce7
I20260810 02:00:17.237243 4311 raft_consensus.cc:1217] T 0afbd7afdd834537b15c727355724562 P ca4469fc2dbc48488bc7ad7f482f129e [term 2 FOLLOWER]: Deduplicated request from leader. Original: 2.11->[2.12-2.12] Dedup: 2.12->[]
I20260810 02:00:17.242662 3551 catalog_manager.cc:5050] TS 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197:38787): tablet d05e147199e44b8ca712e18d22e7cce7 (table rebalance_test_table_7 [id=b572363d270a4bfda571d46e96d0bfda]) successfully deleted
I20260810 02:00:17.290634 6907 raft_consensus.cc:1217] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.13->[1.14-1.14] Dedup: 1.14->[]
I20260810 02:00:17.468204 3943 raft_consensus.cc:1217] T cf531b93380e43bfa103837bd6350834 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.9->[1.10-1.10] Dedup: 1.10->[]
I20260810 02:00:17.475211 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:17.563308 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:17.601827 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:17.637939 6369 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:17.661238 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:17.703976 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:17.730175 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:17.745965 3943 consensus_queue.cc:237] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 02:00:17.764185 6563 raft_consensus.cc:1275] T 2e72e04459b140cc9e20ad633b1ab5c4 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
W20260810 02:00:17.764204 3855 consensus_peers.cc:597] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871 -> Peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797): Couldn't send request to peer dc85be7d460a404f997177f57680850f. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 02:00:17.765072 21270 consensus_queue.cc:1048] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 02:00:17.767961 6907 raft_consensus.cc:1275] T 2e72e04459b140cc9e20ad633b1ab5c4 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260810 02:00:17.768666 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:17.768788 22059 consensus_queue.cc:1048] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 02:00:17.783070 6369 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:17.801960 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:17.828426 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:17.847100 22059 raft_consensus.cc:2955] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } }
I20260810 02:00:17.849522 6565 raft_consensus.cc:2955] T 2e72e04459b140cc9e20ad633b1ab5c4 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } }
I20260810 02:00:17.854171 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:17.870389 3565 catalog_manager.cc:5719] T 2e72e04459b140cc9e20ad633b1ab5c4 P 22ce0e487f0341fd9bf853393d6e7683 reported cstate change: config changed from index 7 to 8, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) added. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } }
I20260810 02:00:17.882086 6907 raft_consensus.cc:2955] T 2e72e04459b140cc9e20ad633b1ab5c4 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } }
I20260810 02:00:17.906075 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:17.988482 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:18.030206 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:18.044051 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:18.286118 22122 ts_tablet_manager.cc:933] T 2e72e04459b140cc9e20ad633b1ab5c4 P dc85be7d460a404f997177f57680850f: Initiating tablet copy from peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 02:00:18.306313 22122 tablet_copy_client.cc:323] T 2e72e04459b140cc9e20ad633b1ab5c4 P dc85be7d460a404f997177f57680850f: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.194:43893
I20260810 02:00:18.308044 3973 tablet_copy_service.cc:140] P 82f93d1d11364ceeb485585b4ae78871: Received BeginTabletCopySession request for tablet 2e72e04459b140cc9e20ad633b1ab5c4 from peer dc85be7d460a404f997177f57680850f ({username='slave'} at 127.21.64.193:57229)
I20260810 02:00:18.308269 3973 tablet_copy_service.cc:161] P 82f93d1d11364ceeb485585b4ae78871: Beginning new tablet copy session on tablet 2e72e04459b140cc9e20ad633b1ab5c4 from peer dc85be7d460a404f997177f57680850f at {username='slave'} at 127.21.64.193:57229: session id = dc85be7d460a404f997177f57680850f-2e72e04459b140cc9e20ad633b1ab5c4
I20260810 02:00:18.312279 3973 tablet_copy_source_session.cc:215] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 02:00:18.321283 6735 consensus_queue.cc:237] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 2.10, Last appended by leader: 6, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 02:00:18.325846 22122 ts_tablet_manager.cc:1916] T 2e72e04459b140cc9e20ad633b1ab5c4 P dc85be7d460a404f997177f57680850f: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260810 02:00:18.334658 6395 raft_consensus.cc:1275] T da507bc24d964ce1a5835edad5177726 P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 FOLLOWER]: Refusing update from remote peer c5ed5317da9c464b93f979c405f0f6e4: Log matching property violated. Preceding OpId in replica: term: 2 index: 10. Preceding OpId from leader: term: 2 index: 11. (index mismatch)
I20260810 02:00:18.335315 18966 consensus_queue.cc:1048] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260810 02:00:18.336078 6655 consensus_peers.cc:597] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4 -> Peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): Couldn't send request to peer 82f93d1d11364ceeb485585b4ae78871. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 02:00:18.360308 3756 raft_consensus.cc:1275] T da507bc24d964ce1a5835edad5177726 P dc85be7d460a404f997177f57680850f [term 2 FOLLOWER]: Refusing update from remote peer c5ed5317da9c464b93f979c405f0f6e4: Log matching property violated. Preceding OpId in replica: term: 2 index: 10. Preceding OpId from leader: term: 2 index: 11. (index mismatch)
I20260810 02:00:18.362057 22137 consensus_queue.cc:1048] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260810 02:00:18.390862 22122 ts_tablet_manager.cc:1929] T 2e72e04459b140cc9e20ad633b1ab5c4 P dc85be7d460a404f997177f57680850f: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.4
I20260810 02:00:18.394295 22122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e72e04459b140cc9e20ad633b1ab5c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 02:00:18.403031 22122 tablet_copy_client.cc:806] T 2e72e04459b140cc9e20ad633b1ab5c4 P dc85be7d460a404f997177f57680850f: tablet copy: Starting download of 0 data blocks...
I20260810 02:00:18.403415 22122 tablet_copy_client.cc:670] T 2e72e04459b140cc9e20ad633b1ab5c4 P dc85be7d460a404f997177f57680850f: tablet copy: Starting download of 1 WAL segments...
I20260810 02:00:18.405571 22122 tablet_copy_client.cc:538] T 2e72e04459b140cc9e20ad633b1ab5c4 P dc85be7d460a404f997177f57680850f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 02:00:18.416278 22122 tablet_bootstrap.cc:492] T 2e72e04459b140cc9e20ad633b1ab5c4 P dc85be7d460a404f997177f57680850f: Bootstrap starting.
I20260810 02:00:18.445106 18966 raft_consensus.cc:2955] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4 [term 2 LEADER]: Committing config change with OpId 2.11: config changed from index 10 to 11, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:18.445801 3759 raft_consensus.cc:2955] T da507bc24d964ce1a5835edad5177726 P dc85be7d460a404f997177f57680850f [term 2 FOLLOWER]: Committing config change with OpId 2.11: config changed from index 10 to 11, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:18.453567 3564 catalog_manager.cc:5719] T da507bc24d964ce1a5835edad5177726 P dc85be7d460a404f997177f57680850f reported cstate change: config changed from index 10 to 11, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) added. New cstate: current_term: 2 leader_uuid: "c5ed5317da9c464b93f979c405f0f6e4" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:18.540334 6395 raft_consensus.cc:2955] T da507bc24d964ce1a5835edad5177726 P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 FOLLOWER]: Committing config change with OpId 2.11: config changed from index 10 to 11, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:18.577795 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:18.598624 6369 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:18.601359 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:18.608584 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:18.618170 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:18.639357 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:18.650843 3943 consensus_queue.cc:237] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 02:00:18.666886 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:18.684921 6907 raft_consensus.cc:1275] T f7a36f7ebd5d4342a259b093e45d4c32 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260810 02:00:18.685835 22059 consensus_queue.cc:1048] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 02:00:18.690936 6395 raft_consensus.cc:1275] T f7a36f7ebd5d4342a259b093e45d4c32 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260810 02:00:18.691596 22059 consensus_queue.cc:1048] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 02:00:18.695029 22061 raft_consensus.cc:2955] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:18.696134 22122 tablet_bootstrap.cc:492] T 2e72e04459b140cc9e20ad633b1ab5c4 P dc85be7d460a404f997177f57680850f: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 02:00:18.696748 22122 tablet_bootstrap.cc:492] T 2e72e04459b140cc9e20ad633b1ab5c4 P dc85be7d460a404f997177f57680850f: Bootstrap complete.
I20260810 02:00:18.697125 22122 ts_tablet_manager.cc:1403] T 2e72e04459b140cc9e20ad633b1ab5c4 P dc85be7d460a404f997177f57680850f: Time spent bootstrapping tablet: real 0.281s user 0.045s sys 0.018s
I20260810 02:00:18.701413 6395 raft_consensus.cc:2955] T f7a36f7ebd5d4342a259b093e45d4c32 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:18.703140 3564 catalog_manager.cc:5719] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 reported cstate change: config changed from index 8 to 9, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) evicted. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:18.743000 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:18.747246 6907 raft_consensus.cc:2955] T f7a36f7ebd5d4342a259b093e45d4c32 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:18.754385 6541 tablet_service.cc:1558] Processing DeleteTablet for tablet f7a36f7ebd5d4342a259b093e45d4c32 with delete_type TABLET_DATA_TOMBSTONED (TS 22ce0e487f0341fd9bf853393d6e7683 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:37902
I20260810 02:00:18.764500 22122 raft_consensus.cc:359] T 2e72e04459b140cc9e20ad633b1ab5c4 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 02:00:18.764825 22122 raft_consensus.cc:740] T 2e72e04459b140cc9e20ad633b1ab5c4 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc85be7d460a404f997177f57680850f, State: Initialized, Role: FOLLOWER
I20260810 02:00:18.768421 22122 consensus_queue.cc:260] T 2e72e04459b140cc9e20ad633b1ab5c4 P dc85be7d460a404f997177f57680850f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 02:00:18.769248 22122 ts_tablet_manager.cc:1434] T 2e72e04459b140cc9e20ad633b1ab5c4 P dc85be7d460a404f997177f57680850f: Time spent starting tablet: real 0.072s user 0.005s sys 0.000s
I20260810 02:00:18.770319 3973 tablet_copy_service.cc:342] P 82f93d1d11364ceeb485585b4ae78871: Request end of tablet copy session dc85be7d460a404f997177f57680850f-2e72e04459b140cc9e20ad633b1ab5c4 received from {username='slave'} at 127.21.64.193:57229
I20260810 02:00:18.770470 3973 tablet_copy_service.cc:434] P 82f93d1d11364ceeb485585b4ae78871: ending tablet copy session dc85be7d460a404f997177f57680850f-2e72e04459b140cc9e20ad633b1ab5c4 on tablet 2e72e04459b140cc9e20ad633b1ab5c4 with peer dc85be7d460a404f997177f57680850f
I20260810 02:00:18.798357 22235 tablet_replica.cc:333] T f7a36f7ebd5d4342a259b093e45d4c32 P 22ce0e487f0341fd9bf853393d6e7683: stopping tablet replica
I20260810 02:00:18.799222 22235 raft_consensus.cc:2243] T f7a36f7ebd5d4342a259b093e45d4c32 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:18.800158 22235 raft_consensus.cc:2272] T f7a36f7ebd5d4342a259b093e45d4c32 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:18.803367 22235 ts_tablet_manager.cc:1916] T f7a36f7ebd5d4342a259b093e45d4c32 P 22ce0e487f0341fd9bf853393d6e7683: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 02:00:18.842453 22246 ts_tablet_manager.cc:933] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871: Initiating tablet copy from peer c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199:41689)
I20260810 02:00:18.859722 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:18.863328 22246 tablet_copy_client.cc:323] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.199:41689
I20260810 02:00:18.864279 6762 tablet_copy_service.cc:140] P c5ed5317da9c464b93f979c405f0f6e4: Received BeginTabletCopySession request for tablet da507bc24d964ce1a5835edad5177726 from peer 82f93d1d11364ceeb485585b4ae78871 ({username='slave'} at 127.21.64.194:38241)
I20260810 02:00:18.864506 6762 tablet_copy_service.cc:161] P c5ed5317da9c464b93f979c405f0f6e4: Beginning new tablet copy session on tablet da507bc24d964ce1a5835edad5177726 from peer 82f93d1d11364ceeb485585b4ae78871 at {username='slave'} at 127.21.64.194:38241: session id = 82f93d1d11364ceeb485585b4ae78871-da507bc24d964ce1a5835edad5177726
I20260810 02:00:18.868002 6762 tablet_copy_source_session.cc:215] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 02:00:18.870143 22246 ts_tablet_manager.cc:1916] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260810 02:00:18.857201 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:18.889117 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:18.895417 6369 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:18.897864 22235 ts_tablet_manager.cc:1929] T f7a36f7ebd5d4342a259b093e45d4c32 P 22ce0e487f0341fd9bf853393d6e7683: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20260810 02:00:18.898110 22235 log.cc:1199] T f7a36f7ebd5d4342a259b093e45d4c32 P 22ce0e487f0341fd9bf853393d6e7683: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/wal/wals/f7a36f7ebd5d4342a259b093e45d4c32
I20260810 02:00:18.899137 3553 catalog_manager.cc:5050] TS 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317): tablet f7a36f7ebd5d4342a259b093e45d4c32 (table rebalance_test_table_6 [id=5b2df46262b142169af9a32c47535432]) successfully deleted
I20260810 02:00:18.921522 22246 ts_tablet_manager.cc:1929] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 2.9
I20260810 02:00:18.922049 22246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da507bc24d964ce1a5835edad5177726. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 02:00:18.931859 22246 tablet_copy_client.cc:806] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871: tablet copy: Starting download of 0 data blocks...
I20260810 02:00:18.932207 22246 tablet_copy_client.cc:670] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871: tablet copy: Starting download of 1 WAL segments...
I20260810 02:00:18.935158 22246 tablet_copy_client.cc:538] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 02:00:18.940734 22246 tablet_bootstrap.cc:492] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871: Bootstrap starting.
I20260810 02:00:18.961650 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:18.987852 3759 consensus_queue.cc:237] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 02:00:18.990267 3943 consensus_queue.cc:237] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 02:00:18.995056 3756 raft_consensus.cc:1217] T 2e72e04459b140cc9e20ad633b1ab5c4 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20260810 02:00:19.018784 6565 raft_consensus.cc:1275] T 4a4350cf2ece4769b8547620ac5bedcb P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
W20260810 02:00:19.019481 3672 consensus_peers.cc:597] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f -> Peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): Couldn't send request to peer ca4469fc2dbc48488bc7ad7f482f129e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 389d3abfeadd4fe6a4efa74427d71c4d. This is attempt 1: this message will repeat every 5th retry.
I20260810 02:00:19.019490 22061 consensus_queue.cc:1048] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260810 02:00:19.025311 3855 consensus_peers.cc:597] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 -> Peer 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197:38787): Couldn't send request to peer 4dd4cba155c941b4b7ad4d64c7431536. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4a4350cf2ece4769b8547620ac5bedcb. This is attempt 1: this message will repeat every 5th retry.
I20260810 02:00:19.027586 6735 raft_consensus.cc:1275] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20260810 02:00:19.027709 6563 raft_consensus.cc:1275] T 389d3abfeadd4fe6a4efa74427d71c4d P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260810 02:00:19.028442 22061 consensus_queue.cc:1048] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260810 02:00:19.028553 22085 consensus_queue.cc:1048] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 02:00:19.033627 6734 raft_consensus.cc:1275] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260810 02:00:19.034360 22085 consensus_queue.cc:1048] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 02:00:19.038084 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:19.044507 22246 tablet_bootstrap.cc:492] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 02:00:19.050032 22246 tablet_bootstrap.cc:492] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871: Bootstrap complete.
I20260810 02:00:19.050982 22246 ts_tablet_manager.cc:1403] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871: Time spent bootstrapping tablet: real 0.110s user 0.066s sys 0.003s
I20260810 02:00:19.054886 22246 raft_consensus.cc:359] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 02:00:19.056114 22246 raft_consensus.cc:740] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f93d1d11364ceeb485585b4ae78871, State: Initialized, Role: FOLLOWER
I20260810 02:00:19.056631 22246 consensus_queue.cc:260] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 2.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 02:00:19.057854 22246 ts_tablet_manager.cc:1434] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260810 02:00:19.062075 6762 tablet_copy_service.cc:342] P c5ed5317da9c464b93f979c405f0f6e4: Request end of tablet copy session 82f93d1d11364ceeb485585b4ae78871-da507bc24d964ce1a5835edad5177726 received from {username='slave'} at 127.21.64.194:38241
I20260810 02:00:19.062250 6762 tablet_copy_service.cc:434] P c5ed5317da9c464b93f979c405f0f6e4: ending tablet copy session 82f93d1d11364ceeb485585b4ae78871-da507bc24d964ce1a5835edad5177726 on tablet da507bc24d964ce1a5835edad5177726 with peer 82f93d1d11364ceeb485585b4ae78871
I20260810 02:00:19.062740 22059 raft_consensus.cc:2955] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.12: config changed from index 11 to 12, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:19.072501 6565 raft_consensus.cc:2955] T 4a4350cf2ece4769b8547620ac5bedcb P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:19.080158 3574 catalog_manager.cc:5719] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 reported cstate change: config changed from index 11 to 12, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:19.097783 6734 raft_consensus.cc:2955] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:19.110392 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:19.124032 20932 raft_consensus.cc:2955] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
I20260810 02:00:19.128669 6567 raft_consensus.cc:2955] T 389d3abfeadd4fe6a4efa74427d71c4d P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
I20260810 02:00:19.135076 6735 raft_consensus.cc:2955] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
I20260810 02:00:19.140753 3574 catalog_manager.cc:5719] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f reported cstate change: config changed from index 7 to 8, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) added. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
I20260810 02:00:19.141433 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:19.210517 3943 raft_consensus.cc:1217] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [term 2 FOLLOWER]: Deduplicated request from leader. Original: 2.10->[2.11-2.11] Dedup: 2.11->[]
I20260810 02:00:19.331228 3943 consensus_queue.cc:237] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
W20260810 02:00:19.352849 3855 consensus_peers.cc:597] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 -> Peer 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995): Couldn't send request to peer 3136daf7101445beadc1aa19bc01c227. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b6c5892f4de449fb8cb7f4cff7eb2e20. This is attempt 1: this message will repeat every 5th retry.
I20260810 02:00:19.354074 6734 raft_consensus.cc:1275] T b6c5892f4de449fb8cb7f4cff7eb2e20 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260810 02:00:19.354760 22061 consensus_queue.cc:1048] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260810 02:00:19.360040 6563 raft_consensus.cc:1275] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260810 02:00:19.361084 22061 consensus_queue.cc:1048] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260810 02:00:19.380155 22061 raft_consensus.cc:2955] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:19.395624 6563 raft_consensus.cc:2955] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:19.428182 3565 catalog_manager.cc:5719] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 22ce0e487f0341fd9bf853393d6e7683 reported cstate change: config changed from index 9 to 10, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:19.439329 22372 ts_tablet_manager.cc:933] T 4a4350cf2ece4769b8547620ac5bedcb P 4dd4cba155c941b4b7ad4d64c7431536: Initiating tablet copy from peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 02:00:19.452787 22372 tablet_copy_client.cc:323] T 4a4350cf2ece4769b8547620ac5bedcb P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.194:43893
I20260810 02:00:19.453677 3973 tablet_copy_service.cc:140] P 82f93d1d11364ceeb485585b4ae78871: Received BeginTabletCopySession request for tablet 4a4350cf2ece4769b8547620ac5bedcb from peer 4dd4cba155c941b4b7ad4d64c7431536 ({username='slave'} at 127.21.64.197:54659)
I20260810 02:00:19.453846 3973 tablet_copy_service.cc:161] P 82f93d1d11364ceeb485585b4ae78871: Beginning new tablet copy session on tablet 4a4350cf2ece4769b8547620ac5bedcb from peer 4dd4cba155c941b4b7ad4d64c7431536 at {username='slave'} at 127.21.64.197:54659: session id = 4dd4cba155c941b4b7ad4d64c7431536-4a4350cf2ece4769b8547620ac5bedcb
I20260810 02:00:19.457202 3973 tablet_copy_source_session.cc:215] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 02:00:19.505911 22372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a4350cf2ece4769b8547620ac5bedcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 02:00:19.548748 6734 raft_consensus.cc:2955] T b6c5892f4de449fb8cb7f4cff7eb2e20 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:19.559568 22372 tablet_copy_client.cc:806] T 4a4350cf2ece4769b8547620ac5bedcb P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Starting download of 0 data blocks...
I20260810 02:00:19.560158 22372 tablet_copy_client.cc:670] T 4a4350cf2ece4769b8547620ac5bedcb P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Starting download of 1 WAL segments...
I20260810 02:00:19.570428 22372 tablet_copy_client.cc:538] T 4a4350cf2ece4769b8547620ac5bedcb P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 02:00:19.579603 22372 tablet_bootstrap.cc:492] T 4a4350cf2ece4769b8547620ac5bedcb P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap starting.
I20260810 02:00:19.610672 3759 consensus_queue.cc:237] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 1.14, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 02:00:19.634574 6907 raft_consensus.cc:1275] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 14. Preceding OpId from leader: term: 1 index: 15. (index mismatch)
I20260810 02:00:19.635335 22085 consensus_queue.cc:1048] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260810 02:00:19.659394 22085 raft_consensus.cc:2955] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.15: config changed from index 14 to 15, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:19.668016 3565 catalog_manager.cc:5719] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f reported cstate change: config changed from index 14 to 15, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:19.673213 4284 tablet_service.cc:1558] Processing DeleteTablet for tablet 252899385eaa45b392974d2768e3cf01 with delete_type TABLET_DATA_TOMBSTONED (TS ca4469fc2dbc48488bc7ad7f482f129e not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:40788
I20260810 02:00:19.677408 6563 raft_consensus.cc:1275] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 14. Preceding OpId from leader: term: 1 index: 15. (index mismatch)
I20260810 02:00:19.677249 6907 raft_consensus.cc:2955] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.15: config changed from index 14 to 15, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:19.682458 22085 consensus_queue.cc:1048] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260810 02:00:19.693691 22449 ts_tablet_manager.cc:933] T 389d3abfeadd4fe6a4efa74427d71c4d P ca4469fc2dbc48488bc7ad7f482f129e: Initiating tablet copy from peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
I20260810 02:00:19.697877 6563 raft_consensus.cc:2955] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.15: config changed from index 14 to 15, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:19.699791 22449 tablet_copy_client.cc:323] T 389d3abfeadd4fe6a4efa74427d71c4d P ca4469fc2dbc48488bc7ad7f482f129e: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.193:36797
I20260810 02:00:19.700944 3787 tablet_copy_service.cc:140] P dc85be7d460a404f997177f57680850f: Received BeginTabletCopySession request for tablet 389d3abfeadd4fe6a4efa74427d71c4d from peer ca4469fc2dbc48488bc7ad7f482f129e ({username='slave'} at 127.21.64.196:44631)
I20260810 02:00:19.701098 3787 tablet_copy_service.cc:161] P dc85be7d460a404f997177f57680850f: Beginning new tablet copy session on tablet 389d3abfeadd4fe6a4efa74427d71c4d from peer ca4469fc2dbc48488bc7ad7f482f129e at {username='slave'} at 127.21.64.196:44631: session id = ca4469fc2dbc48488bc7ad7f482f129e-389d3abfeadd4fe6a4efa74427d71c4d
I20260810 02:00:19.704787 3787 tablet_copy_source_session.cc:215] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 02:00:19.707026 22449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 389d3abfeadd4fe6a4efa74427d71c4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 02:00:19.715123 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:19.710112 22453 tablet_replica.cc:333] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e: stopping tablet replica
I20260810 02:00:19.724779 22453 raft_consensus.cc:2243] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:19.729740 22453 raft_consensus.cc:2272] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:19.729202 22449 tablet_copy_client.cc:806] T 389d3abfeadd4fe6a4efa74427d71c4d P ca4469fc2dbc48488bc7ad7f482f129e: tablet copy: Starting download of 0 data blocks...
I20260810 02:00:19.730762 22449 tablet_copy_client.cc:670] T 389d3abfeadd4fe6a4efa74427d71c4d P ca4469fc2dbc48488bc7ad7f482f129e: tablet copy: Starting download of 1 WAL segments...
I20260810 02:00:19.735543 22449 tablet_copy_client.cc:538] T 389d3abfeadd4fe6a4efa74427d71c4d P ca4469fc2dbc48488bc7ad7f482f129e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 02:00:19.731285 22453 ts_tablet_manager.cc:1916] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 02:00:19.742493 22449 tablet_bootstrap.cc:492] T 389d3abfeadd4fe6a4efa74427d71c4d P ca4469fc2dbc48488bc7ad7f482f129e: Bootstrap starting.
I20260810 02:00:19.744457 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:19.772972 22453 ts_tablet_manager.cc:1929] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.14
I20260810 02:00:19.776705 22453 log.cc:1199] T 252899385eaa45b392974d2768e3cf01 P ca4469fc2dbc48488bc7ad7f482f129e: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal/wals/252899385eaa45b392974d2768e3cf01
I20260810 02:00:19.778322 3553 catalog_manager.cc:5050] TS ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): tablet 252899385eaa45b392974d2768e3cf01 (table rebalance_test_table_8 [id=afa71147917d44a585bcbaa37497a2b1]) successfully deleted
I20260810 02:00:19.817133 4311 consensus_queue.cc:237] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
W20260810 02:00:19.835263 4222 consensus_peers.cc:597] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e -> Peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): Couldn't send request to peer 82f93d1d11364ceeb485585b4ae78871. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 02:00:19.836490 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:19.837405 6563 raft_consensus.cc:1275] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 02:00:19.838167 21359 consensus_queue.cc:1048] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 02:00:19.845275 4131 raft_consensus.cc:1275] T 5528e3ba51a640eaa614f141440bb90b P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 02:00:19.846985 22277 consensus_queue.cc:1048] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 02:00:19.858191 6369 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:19.863224 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:19.870573 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:19.895994 22372 tablet_bootstrap.cc:492] T 4a4350cf2ece4769b8547620ac5bedcb P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 02:00:19.896740 22372 tablet_bootstrap.cc:492] T 4a4350cf2ece4769b8547620ac5bedcb P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap complete.
I20260810 02:00:19.897156 22372 ts_tablet_manager.cc:1403] T 4a4350cf2ece4769b8547620ac5bedcb P 4dd4cba155c941b4b7ad4d64c7431536: Time spent bootstrapping tablet: real 0.318s user 0.060s sys 0.004s
I20260810 02:00:19.898310 22372 raft_consensus.cc:359] T 4a4350cf2ece4769b8547620ac5bedcb P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 02:00:19.898648 22372 raft_consensus.cc:740] T 4a4350cf2ece4769b8547620ac5bedcb P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dd4cba155c941b4b7ad4d64c7431536, State: Initialized, Role: FOLLOWER
I20260810 02:00:19.899003 22372 consensus_queue.cc:260] T 4a4350cf2ece4769b8547620ac5bedcb P 4dd4cba155c941b4b7ad4d64c7431536 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 02:00:19.899598 22372 ts_tablet_manager.cc:1434] T 4a4350cf2ece4769b8547620ac5bedcb P 4dd4cba155c941b4b7ad4d64c7431536: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 02:00:19.903558 3973 tablet_copy_service.cc:342] P 82f93d1d11364ceeb485585b4ae78871: Request end of tablet copy session 4dd4cba155c941b4b7ad4d64c7431536-4a4350cf2ece4769b8547620ac5bedcb received from {username='slave'} at 127.21.64.197:54659
I20260810 02:00:19.903693 3973 tablet_copy_service.cc:434] P 82f93d1d11364ceeb485585b4ae78871: ending tablet copy session 4dd4cba155c941b4b7ad4d64c7431536-4a4350cf2ece4769b8547620ac5bedcb on tablet 4a4350cf2ece4769b8547620ac5bedcb with peer 4dd4cba155c941b4b7ad4d64c7431536
I20260810 02:00:19.912356 4313 consensus_queue.cc:237] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 02:00:19.917918 6734 raft_consensus.cc:1275] T a586b7d625bb4c27a6343ae7918c8cea P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260810 02:00:19.918658 22277 consensus_queue.cc:1048] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 02:00:19.920291 4132 raft_consensus.cc:1275] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260810 02:00:19.922209 22277 consensus_queue.cc:1048] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 02:00:19.933573 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:19.990322 22519 ts_tablet_manager.cc:933] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 3136daf7101445beadc1aa19bc01c227: Initiating tablet copy from peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 02:00:19.990803 6395 raft_consensus.cc:1217] T 4a4350cf2ece4769b8547620ac5bedcb P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.11->[1.12-1.12] Dedup: 1.12->[]
I20260810 02:00:20.003274 22519 tablet_copy_client.cc:323] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.194:43893
I20260810 02:00:20.004033 3973 tablet_copy_service.cc:140] P 82f93d1d11364ceeb485585b4ae78871: Received BeginTabletCopySession request for tablet b6c5892f4de449fb8cb7f4cff7eb2e20 from peer 3136daf7101445beadc1aa19bc01c227 ({username='slave'} at 127.21.64.200:39385)
I20260810 02:00:20.004287 3973 tablet_copy_service.cc:161] P 82f93d1d11364ceeb485585b4ae78871: Beginning new tablet copy session on tablet b6c5892f4de449fb8cb7f4cff7eb2e20 from peer 3136daf7101445beadc1aa19bc01c227 at {username='slave'} at 127.21.64.200:39385: session id = 3136daf7101445beadc1aa19bc01c227-b6c5892f4de449fb8cb7f4cff7eb2e20
I20260810 02:00:20.009048 3973 tablet_copy_source_session.cc:215] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 02:00:20.014430 22519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6c5892f4de449fb8cb7f4cff7eb2e20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 02:00:20.018685 21359 raft_consensus.cc:2955] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } }
I20260810 02:00:20.022750 22519 tablet_copy_client.cc:806] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Starting download of 0 data blocks...
I20260810 02:00:20.023149 22519 tablet_copy_client.cc:670] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Starting download of 1 WAL segments...
I20260810 02:00:20.024277 6734 raft_consensus.cc:2955] T a586b7d625bb4c27a6343ae7918c8cea P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } }
I20260810 02:00:20.027683 3565 catalog_manager.cc:5719] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e reported cstate change: config changed from index 8 to 9, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) evicted. New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } }
I20260810 02:00:20.029791 22519 tablet_copy_client.cc:538] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 3136daf7101445beadc1aa19bc01c227: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 02:00:20.032174 4129 raft_consensus.cc:2955] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } }
I20260810 02:00:20.032400 22277 raft_consensus.cc:2955] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:20.037462 6884 tablet_service.cc:1558] Processing DeleteTablet for tablet a586b7d625bb4c27a6343ae7918c8cea with delete_type TABLET_DATA_TOMBSTONED (TS 3136daf7101445beadc1aa19bc01c227 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:41662
I20260810 02:00:20.051601 22519 tablet_bootstrap.cc:492] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 3136daf7101445beadc1aa19bc01c227: Bootstrap starting.
I20260810 02:00:20.072988 22527 tablet_replica.cc:333] T a586b7d625bb4c27a6343ae7918c8cea P 3136daf7101445beadc1aa19bc01c227: stopping tablet replica
I20260810 02:00:20.073314 22527 raft_consensus.cc:2243] T a586b7d625bb4c27a6343ae7918c8cea P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:20.073686 22527 raft_consensus.cc:2272] T a586b7d625bb4c27a6343ae7918c8cea P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:20.074615 22527 ts_tablet_manager.cc:1916] T a586b7d625bb4c27a6343ae7918c8cea P 3136daf7101445beadc1aa19bc01c227: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 02:00:20.074774 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:20.121256 22527 ts_tablet_manager.cc:1929] T a586b7d625bb4c27a6343ae7918c8cea P 3136daf7101445beadc1aa19bc01c227: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20260810 02:00:20.123085 22527 log.cc:1199] T a586b7d625bb4c27a6343ae7918c8cea P 3136daf7101445beadc1aa19bc01c227: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/wal/wals/a586b7d625bb4c27a6343ae7918c8cea
W20260810 02:00:20.124816 4220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.195:39189, user_credentials={real_user=slave}} blocked reactor thread for 85273.3us
I20260810 02:00:20.127545 3565 catalog_manager.cc:5719] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e reported cstate change: config changed from index 5 to 6, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) added. New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:20.128495 3551 catalog_manager.cc:5050] TS 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995): tablet a586b7d625bb4c27a6343ae7918c8cea (table rebalance_test_table_1 [id=945a223441a04ba2bf938b104bc91cf8]) successfully deleted
I20260810 02:00:20.125221 6563 raft_consensus.cc:2955] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:20.138329 4131 raft_consensus.cc:2955] T 5528e3ba51a640eaa614f141440bb90b P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:20.200366 22449 tablet_bootstrap.cc:492] T 389d3abfeadd4fe6a4efa74427d71c4d P ca4469fc2dbc48488bc7ad7f482f129e: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 02:00:20.200992 22449 tablet_bootstrap.cc:492] T 389d3abfeadd4fe6a4efa74427d71c4d P ca4469fc2dbc48488bc7ad7f482f129e: Bootstrap complete.
I20260810 02:00:20.201392 22449 ts_tablet_manager.cc:1403] T 389d3abfeadd4fe6a4efa74427d71c4d P ca4469fc2dbc48488bc7ad7f482f129e: Time spent bootstrapping tablet: real 0.459s user 0.057s sys 0.014s
I20260810 02:00:20.202203 22449 raft_consensus.cc:359] T 389d3abfeadd4fe6a4efa74427d71c4d P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 02:00:20.202503 22449 raft_consensus.cc:740] T 389d3abfeadd4fe6a4efa74427d71c4d P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca4469fc2dbc48488bc7ad7f482f129e, State: Initialized, Role: FOLLOWER
I20260810 02:00:20.202817 22449 consensus_queue.cc:260] T 389d3abfeadd4fe6a4efa74427d71c4d P ca4469fc2dbc48488bc7ad7f482f129e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 02:00:20.206537 22449 ts_tablet_manager.cc:1434] T 389d3abfeadd4fe6a4efa74427d71c4d P ca4469fc2dbc48488bc7ad7f482f129e: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260810 02:00:20.212378 3787 tablet_copy_service.cc:342] P dc85be7d460a404f997177f57680850f: Request end of tablet copy session ca4469fc2dbc48488bc7ad7f482f129e-389d3abfeadd4fe6a4efa74427d71c4d received from {username='slave'} at 127.21.64.196:44631
I20260810 02:00:20.212510 3787 tablet_copy_service.cc:434] P dc85be7d460a404f997177f57680850f: ending tablet copy session ca4469fc2dbc48488bc7ad7f482f129e-389d3abfeadd4fe6a4efa74427d71c4d on tablet 389d3abfeadd4fe6a4efa74427d71c4d with peer ca4469fc2dbc48488bc7ad7f482f129e
I20260810 02:00:20.391733 22519 tablet_bootstrap.cc:492] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 3136daf7101445beadc1aa19bc01c227: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 02:00:20.392238 22519 tablet_bootstrap.cc:492] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 3136daf7101445beadc1aa19bc01c227: Bootstrap complete.
I20260810 02:00:20.392556 22519 ts_tablet_manager.cc:1403] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 3136daf7101445beadc1aa19bc01c227: Time spent bootstrapping tablet: real 0.341s user 0.065s sys 0.004s
I20260810 02:00:20.393457 22519 raft_consensus.cc:359] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 02:00:20.393765 22519 raft_consensus.cc:740] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3136daf7101445beadc1aa19bc01c227, State: Initialized, Role: FOLLOWER
I20260810 02:00:20.394047 22519 consensus_queue.cc:260] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 3136daf7101445beadc1aa19bc01c227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 1.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 02:00:20.394583 22519 ts_tablet_manager.cc:1434] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 3136daf7101445beadc1aa19bc01c227: Time spent starting tablet: real 0.002s user 0.004s sys 0.000s
I20260810 02:00:20.397476 3973 tablet_copy_service.cc:342] P 82f93d1d11364ceeb485585b4ae78871: Request end of tablet copy session 3136daf7101445beadc1aa19bc01c227-b6c5892f4de449fb8cb7f4cff7eb2e20 received from {username='slave'} at 127.21.64.200:39385
I20260810 02:00:20.397635 3973 tablet_copy_service.cc:434] P 82f93d1d11364ceeb485585b4ae78871: ending tablet copy session 3136daf7101445beadc1aa19bc01c227-b6c5892f4de449fb8cb7f4cff7eb2e20 on tablet b6c5892f4de449fb8cb7f4cff7eb2e20 with peer 3136daf7101445beadc1aa19bc01c227
I20260810 02:00:20.434439 22604 ts_tablet_manager.cc:933] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871: Initiating tablet copy from peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943)
I20260810 02:00:20.452454 6907 raft_consensus.cc:1217] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.9->[1.10-1.10] Dedup: 1.10->[]
I20260810 02:00:20.469368 22604 tablet_copy_client.cc:323] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.196:41943
I20260810 02:00:20.471027 4337 tablet_copy_service.cc:140] P ca4469fc2dbc48488bc7ad7f482f129e: Received BeginTabletCopySession request for tablet 5528e3ba51a640eaa614f141440bb90b from peer 82f93d1d11364ceeb485585b4ae78871 ({username='slave'} at 127.21.64.194:37889)
I20260810 02:00:20.471263 4337 tablet_copy_service.cc:161] P ca4469fc2dbc48488bc7ad7f482f129e: Beginning new tablet copy session on tablet 5528e3ba51a640eaa614f141440bb90b from peer 82f93d1d11364ceeb485585b4ae78871 at {username='slave'} at 127.21.64.194:37889: session id = 82f93d1d11364ceeb485585b4ae78871-5528e3ba51a640eaa614f141440bb90b
I20260810 02:00:20.479542 4337 tablet_copy_source_session.cc:215] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 02:00:20.482643 22604 ts_tablet_manager.cc:1916] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260810 02:00:20.509846 22604 ts_tablet_manager.cc:1929] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.4
I20260810 02:00:20.514892 22604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5528e3ba51a640eaa614f141440bb90b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 02:00:20.542629 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:20.557222 22604 tablet_copy_client.cc:806] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871: tablet copy: Starting download of 0 data blocks...
I20260810 02:00:20.557567 22604 tablet_copy_client.cc:670] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871: tablet copy: Starting download of 1 WAL segments...
I20260810 02:00:20.558188 4311 raft_consensus.cc:1217] T 389d3abfeadd4fe6a4efa74427d71c4d P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20260810 02:00:20.566136 22604 tablet_copy_client.cc:538] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 02:00:20.615329 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:20.617084 22604 tablet_bootstrap.cc:492] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871: Bootstrap starting.
I20260810 02:00:20.637084 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:20.655565 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:20.687651 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:20.692610 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:20.742308 6369 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:20.752351 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:20.811832 3759 consensus_queue.cc:237] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 02:00:20.816679 3943 raft_consensus.cc:1275] T cf531b93380e43bfa103837bd6350834 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260810 02:00:20.817775 22439 consensus_queue.cc:1048] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260810 02:00:20.819178 6567 raft_consensus.cc:1275] T cf531b93380e43bfa103837bd6350834 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260810 02:00:20.819909 22085 consensus_queue.cc:1048] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260810 02:00:20.840566 22085 raft_consensus.cc:2955] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:20.846583 6567 raft_consensus.cc:2955] T cf531b93380e43bfa103837bd6350834 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:20.852877 3565 catalog_manager.cc:5719] T cf531b93380e43bfa103837bd6350834 P dc85be7d460a404f997177f57680850f reported cstate change: config changed from index 10 to 11, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) evicted. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:20.876520 22604 tablet_bootstrap.cc:492] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 02:00:20.876701 6714 tablet_service.cc:1558] Processing DeleteTablet for tablet cf531b93380e43bfa103837bd6350834 with delete_type TABLET_DATA_TOMBSTONED (TS c5ed5317da9c464b93f979c405f0f6e4 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:58550
I20260810 02:00:20.877019 22604 tablet_bootstrap.cc:492] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871: Bootstrap complete.
I20260810 02:00:20.877370 22604 ts_tablet_manager.cc:1403] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871: Time spent bootstrapping tablet: real 0.288s user 0.068s sys 0.000s
I20260810 02:00:20.878165 22604 raft_consensus.cc:359] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 02:00:20.881757 22687 tablet_replica.cc:333] T cf531b93380e43bfa103837bd6350834 P c5ed5317da9c464b93f979c405f0f6e4: stopping tablet replica
I20260810 02:00:20.883271 22687 raft_consensus.cc:2243] T cf531b93380e43bfa103837bd6350834 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:20.883826 22604 raft_consensus.cc:740] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f93d1d11364ceeb485585b4ae78871, State: Initialized, Role: FOLLOWER
I20260810 02:00:20.884392 22687 raft_consensus.cc:2272] T cf531b93380e43bfa103837bd6350834 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:20.884769 22604 consensus_queue.cc:260] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 1.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 02:00:20.891700 22687 ts_tablet_manager.cc:1916] T cf531b93380e43bfa103837bd6350834 P c5ed5317da9c464b93f979c405f0f6e4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 02:00:20.892285 22604 ts_tablet_manager.cc:1434] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20260810 02:00:20.894480 4337 tablet_copy_service.cc:342] P ca4469fc2dbc48488bc7ad7f482f129e: Request end of tablet copy session 82f93d1d11364ceeb485585b4ae78871-5528e3ba51a640eaa614f141440bb90b received from {username='slave'} at 127.21.64.194:37889
I20260810 02:00:20.894620 4337 tablet_copy_service.cc:434] P ca4469fc2dbc48488bc7ad7f482f129e: ending tablet copy session 82f93d1d11364ceeb485585b4ae78871-5528e3ba51a640eaa614f141440bb90b on tablet 5528e3ba51a640eaa614f141440bb90b with peer 82f93d1d11364ceeb485585b4ae78871
I20260810 02:00:20.929327 3945 raft_consensus.cc:2955] T cf531b93380e43bfa103837bd6350834 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:20.995831 3943 raft_consensus.cc:1217] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.5->[1.6-1.6] Dedup: 1.6->[]
I20260810 02:00:20.999269 22687 ts_tablet_manager.cc:1929] T cf531b93380e43bfa103837bd6350834 P c5ed5317da9c464b93f979c405f0f6e4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.10
I20260810 02:00:20.999495 22687 log.cc:1199] T cf531b93380e43bfa103837bd6350834 P c5ed5317da9c464b93f979c405f0f6e4: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/wal/wals/cf531b93380e43bfa103837bd6350834
I20260810 02:00:21.000536 3554 catalog_manager.cc:5050] TS c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199:41689): tablet cf531b93380e43bfa103837bd6350834 (table rebalance_test_table_3 [id=c515c90b2c71492f812b4df18501ee04]) successfully deleted
I20260810 02:00:21.398738 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:21.419219 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:21.433691 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:21.445997 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:21.484489 6369 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:21.511229 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:21.517184 4131 consensus_queue.cc:237] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 02:00:21.533494 4311 raft_consensus.cc:1275] T 4fc45932b9634d6d98d8a0204d4b121a P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260810 02:00:21.533654 6395 raft_consensus.cc:1275] T 4fc45932b9634d6d98d8a0204d4b121a P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260810 02:00:21.534386 21414 consensus_queue.cc:1048] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 02:00:21.534660 22824 consensus_queue.cc:1048] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 02:00:21.550068 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:21.552325 21414 raft_consensus.cc:2955] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
I20260810 02:00:21.559757 4311 raft_consensus.cc:2955] T 4fc45932b9634d6d98d8a0204d4b121a P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
I20260810 02:00:21.574240 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:21.575803 6394 raft_consensus.cc:2955] T 4fc45932b9634d6d98d8a0204d4b121a P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
I20260810 02:00:21.583540 3565 catalog_manager.cc:5719] T 4fc45932b9634d6d98d8a0204d4b121a P 4dd4cba155c941b4b7ad4d64c7431536 reported cstate change: config changed from index 8 to 9, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) evicted. New cstate: current_term: 1 leader_uuid: "17b49c694faf479ea2e5083470fc0302" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
I20260810 02:00:21.587168 6369 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:21.624758 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:21.631040 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:21.675105 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:21.703315 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:21.747120 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:21.772610 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:21.779563 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:21.788525 6541 tablet_service.cc:1558] Processing DeleteTablet for tablet 4fc45932b9634d6d98d8a0204d4b121a with delete_type TABLET_DATA_TOMBSTONED (TS 22ce0e487f0341fd9bf853393d6e7683 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:37902
I20260810 02:00:21.808593 22862 tablet_replica.cc:333] T 4fc45932b9634d6d98d8a0204d4b121a P 22ce0e487f0341fd9bf853393d6e7683: stopping tablet replica
I20260810 02:00:21.808925 22862 raft_consensus.cc:2243] T 4fc45932b9634d6d98d8a0204d4b121a P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:21.809304 22862 raft_consensus.cc:2272] T 4fc45932b9634d6d98d8a0204d4b121a P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:21.810267 22862 ts_tablet_manager.cc:1916] T 4fc45932b9634d6d98d8a0204d4b121a P 22ce0e487f0341fd9bf853393d6e7683: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 02:00:21.824987 22862 ts_tablet_manager.cc:1929] T 4fc45932b9634d6d98d8a0204d4b121a P 22ce0e487f0341fd9bf853393d6e7683: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20260810 02:00:21.825242 22862 log.cc:1199] T 4fc45932b9634d6d98d8a0204d4b121a P 22ce0e487f0341fd9bf853393d6e7683: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/wal/wals/4fc45932b9634d6d98d8a0204d4b121a
I20260810 02:00:21.826321 3553 catalog_manager.cc:5050] TS 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317): tablet 4fc45932b9634d6d98d8a0204d4b121a (table rebalance_test_table_8 [id=afa71147917d44a585bcbaa37497a2b1]) successfully deleted
I20260810 02:00:21.924899 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:21.977620 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:21.978704 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:22.010033 6369 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:22.030798 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:22.090410 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:22.154238 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:22.206709 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:22.330642 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:22.358897 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:22.360196 6369 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:22.372861 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:22.391702 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:22.424171 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:22.458217 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:22.510187 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:22.568126 4311 consensus_queue.cc:237] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 02:00:22.580506 3945 raft_consensus.cc:1275] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 02:00:22.581230 22903 consensus_queue.cc:1048] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 02:00:22.595115 4131 raft_consensus.cc:1275] T 5528e3ba51a640eaa614f141440bb90b P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 02:00:22.595989 22903 consensus_queue.cc:1048] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 02:00:22.622078 22829 raft_consensus.cc:2955] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:22.623247 4129 raft_consensus.cc:2955] T 5528e3ba51a640eaa614f141440bb90b P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:22.642792 3565 catalog_manager.cc:5719] T 5528e3ba51a640eaa614f141440bb90b P 17b49c694faf479ea2e5083470fc0302 reported cstate change: config changed from index 6 to 7, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) evicted. New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:22.663276 3945 raft_consensus.cc:2955] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:22.682880 6541 tablet_service.cc:1558] Processing DeleteTablet for tablet 5528e3ba51a640eaa614f141440bb90b with delete_type TABLET_DATA_TOMBSTONED (TS 22ce0e487f0341fd9bf853393d6e7683 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:37902
I20260810 02:00:22.711885 22987 tablet_replica.cc:333] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683: stopping tablet replica
I20260810 02:00:22.712479 22987 raft_consensus.cc:2243] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:22.712823 22987 raft_consensus.cc:2272] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:22.716207 22987 ts_tablet_manager.cc:1916] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 02:00:22.741144 22987 ts_tablet_manager.cc:1929] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20260810 02:00:22.743132 22987 log.cc:1199] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/wal/wals/5528e3ba51a640eaa614f141440bb90b
I20260810 02:00:22.744400 3553 catalog_manager.cc:5050] TS 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317): tablet 5528e3ba51a640eaa614f141440bb90b (table rebalance_test_table_9 [id=372310cb713644ada1071e8eb628b0c9]) successfully deleted
I20260810 02:00:22.948226 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:23.079243 4311 consensus_queue.cc:237] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 02:00:23.109549 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260810 02:00:23.120617 4224 consensus_peers.cc:597] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e -> Peer c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199:41689): Couldn't send request to peer c5ed5317da9c464b93f979c405f0f6e4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8308d63e9002418b876c3d3ae0095d9f. This is attempt 1: this message will repeat every 5th retry.
I20260810 02:00:23.120723 3945 raft_consensus.cc:1275] T 8308d63e9002418b876c3d3ae0095d9f P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260810 02:00:23.123275 6567 raft_consensus.cc:1275] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260810 02:00:23.123523 22968 consensus_queue.cc:1048] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260810 02:00:23.124764 22829 consensus_queue.cc:1048] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260810 02:00:23.128955 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:23.134719 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:23.166245 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:23.173892 22829 raft_consensus.cc:2955] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 02:00:23.182034 6563 raft_consensus.cc:2955] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 02:00:23.191833 3565 catalog_manager.cc:5719] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e reported cstate change: config changed from index 9 to 10, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 02:00:23.191514 3943 raft_consensus.cc:2955] T 8308d63e9002418b876c3d3ae0095d9f P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 02:00:23.202514 6369 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:23.240638 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:23.273494 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:23.327224 3759 consensus_queue.cc:237] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 1.15, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 02:00:23.338366 6907 raft_consensus.cc:1275] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 15. Preceding OpId from leader: term: 1 index: 16. (index mismatch)
I20260810 02:00:23.339124 23069 consensus_queue.cc:1048] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260810 02:00:23.364835 23069 raft_consensus.cc:2955] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.16: config changed from index 15 to 16, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:23.371668 6909 raft_consensus.cc:2955] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.16: config changed from index 15 to 16, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:23.378064 3564 catalog_manager.cc:5719] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227 reported cstate change: config changed from index 15 to 16, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) evicted. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:23.385722 6541 tablet_service.cc:1558] Processing DeleteTablet for tablet 252899385eaa45b392974d2768e3cf01 with delete_type TABLET_DATA_TOMBSTONED (TS 22ce0e487f0341fd9bf853393d6e7683 not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:37902
I20260810 02:00:23.386672 3759 consensus_queue.cc:237] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 1.16, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 02:00:23.387919 23132 tablet_replica.cc:333] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683: stopping tablet replica
I20260810 02:00:23.388130 23132 raft_consensus.cc:2243] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:23.388314 23132 raft_consensus.cc:2272] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:23.389086 23132 ts_tablet_manager.cc:1916] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 02:00:23.390460 6909 raft_consensus.cc:1275] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 16. Preceding OpId from leader: term: 1 index: 17. (index mismatch)
W20260810 02:00:23.395512 3670 consensus_peers.cc:597] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f -> Peer 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197:38787): Couldn't send request to peer 4dd4cba155c941b4b7ad4d64c7431536. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 252899385eaa45b392974d2768e3cf01. This is attempt 1: this message will repeat every 5th retry.
I20260810 02:00:23.396695 22919 consensus_queue.cc:1048] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260810 02:00:23.402498 23134 raft_consensus.cc:2955] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.17: config changed from index 16 to 17, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:23.403187 6909 raft_consensus.cc:2955] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.17: config changed from index 16 to 17, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:23.414640 3564 catalog_manager.cc:5719] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227 reported cstate change: config changed from index 16 to 17, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:23.419471 3551 catalog_manager.cc:5232] ChangeConfig:ADD_PEER:VOTER RPC for tablet 252899385eaa45b392974d2768e3cf01 with cas_config_opid_index 16: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260810 02:00:23.425174 23132 ts_tablet_manager.cc:1929] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.15
I20260810 02:00:23.426388 23132 log.cc:1199] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/wal/wals/252899385eaa45b392974d2768e3cf01
I20260810 02:00:23.427378 3553 catalog_manager.cc:5050] TS 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317): tablet 252899385eaa45b392974d2768e3cf01 (table rebalance_test_table_8 [id=afa71147917d44a585bcbaa37497a2b1]) successfully deleted
I20260810 02:00:23.626156 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:23.642161 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:23.664023 6369 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:23.682294 23171 ts_tablet_manager.cc:933] T 8308d63e9002418b876c3d3ae0095d9f P c5ed5317da9c464b93f979c405f0f6e4: Initiating tablet copy from peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943)
I20260810 02:00:23.701371 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:23.722689 23171 tablet_copy_client.cc:323] T 8308d63e9002418b876c3d3ae0095d9f P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.196:41943
I20260810 02:00:23.724879 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:23.755827 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:23.786510 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:23.822615 4337 tablet_copy_service.cc:140] P ca4469fc2dbc48488bc7ad7f482f129e: Received BeginTabletCopySession request for tablet 8308d63e9002418b876c3d3ae0095d9f from peer c5ed5317da9c464b93f979c405f0f6e4 ({username='slave'} at 127.21.64.199:39019)
I20260810 02:00:23.822786 4337 tablet_copy_service.cc:161] P ca4469fc2dbc48488bc7ad7f482f129e: Beginning new tablet copy session on tablet 8308d63e9002418b876c3d3ae0095d9f from peer c5ed5317da9c464b93f979c405f0f6e4 at {username='slave'} at 127.21.64.199:39019: session id = c5ed5317da9c464b93f979c405f0f6e4-8308d63e9002418b876c3d3ae0095d9f
I20260810 02:00:23.828321 4337 tablet_copy_source_session.cc:215] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 02:00:23.829888 23171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8308d63e9002418b876c3d3ae0095d9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 02:00:23.837129 23171 tablet_copy_client.cc:806] T 8308d63e9002418b876c3d3ae0095d9f P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Starting download of 0 data blocks...
I20260810 02:00:23.837478 23171 tablet_copy_client.cc:670] T 8308d63e9002418b876c3d3ae0095d9f P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Starting download of 1 WAL segments...
I20260810 02:00:23.844993 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:23.848565 23171 tablet_copy_client.cc:538] T 8308d63e9002418b876c3d3ae0095d9f P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 02:00:23.850433 23222 ts_tablet_manager.cc:933] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536: Initiating tablet copy from peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
W20260810 02:00:23.859238 4222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.194:43893, user_credentials={real_user=slave}} blocked reactor thread for 51302.9us
I20260810 02:00:23.864516 23222 tablet_copy_client.cc:323] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.193:36797
I20260810 02:00:23.865540 3787 tablet_copy_service.cc:140] P dc85be7d460a404f997177f57680850f: Received BeginTabletCopySession request for tablet 252899385eaa45b392974d2768e3cf01 from peer 4dd4cba155c941b4b7ad4d64c7431536 ({username='slave'} at 127.21.64.197:44713)
I20260810 02:00:23.865708 3787 tablet_copy_service.cc:161] P dc85be7d460a404f997177f57680850f: Beginning new tablet copy session on tablet 252899385eaa45b392974d2768e3cf01 from peer 4dd4cba155c941b4b7ad4d64c7431536 at {username='slave'} at 127.21.64.197:44713: session id = 4dd4cba155c941b4b7ad4d64c7431536-252899385eaa45b392974d2768e3cf01
I20260810 02:00:23.868361 3787 tablet_copy_source_session.cc:215] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 02:00:23.869388 23171 tablet_bootstrap.cc:492] T 8308d63e9002418b876c3d3ae0095d9f P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap starting.
I20260810 02:00:23.870524 23222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 252899385eaa45b392974d2768e3cf01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 02:00:23.881173 23222 tablet_copy_client.cc:806] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Starting download of 0 data blocks...
I20260810 02:00:23.881695 23222 tablet_copy_client.cc:670] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Starting download of 1 WAL segments...
I20260810 02:00:23.885811 23222 tablet_copy_client.cc:538] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 02:00:23.890233 23222 tablet_bootstrap.cc:492] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap starting.
I20260810 02:00:24.031248 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:24.041607 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:24.069876 23222 tablet_bootstrap.cc:492] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap replayed 1/1 log segments. Stats: ops{read=17 overwritten=0 applied=17 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 02:00:24.070565 23222 tablet_bootstrap.cc:492] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap complete.
I20260810 02:00:24.071034 23222 ts_tablet_manager.cc:1403] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536: Time spent bootstrapping tablet: real 0.181s user 0.067s sys 0.009s
I20260810 02:00:24.072485 23222 raft_consensus.cc:359] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 02:00:24.072817 23222 raft_consensus.cc:740] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dd4cba155c941b4b7ad4d64c7431536, State: Initialized, Role: FOLLOWER
I20260810 02:00:24.073122 23222 consensus_queue.cc:260] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 17, Last appended: 1.17, Last appended by leader: 17, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 02:00:24.073817 23222 ts_tablet_manager.cc:1434] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260810 02:00:24.079260 3787 tablet_copy_service.cc:342] P dc85be7d460a404f997177f57680850f: Request end of tablet copy session 4dd4cba155c941b4b7ad4d64c7431536-252899385eaa45b392974d2768e3cf01 received from {username='slave'} at 127.21.64.197:44713
I20260810 02:00:24.079389 3787 tablet_copy_service.cc:434] P dc85be7d460a404f997177f57680850f: ending tablet copy session 4dd4cba155c941b4b7ad4d64c7431536-252899385eaa45b392974d2768e3cf01 on tablet 252899385eaa45b392974d2768e3cf01 with peer 4dd4cba155c941b4b7ad4d64c7431536
I20260810 02:00:24.088352 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:24.120541 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:24.121059 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:24.155825 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:24.160229 6369 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:24.164057 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:24.171363 3759 consensus_queue.cc:237] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 02:00:24.225091 4311 raft_consensus.cc:1275] T 389d3abfeadd4fe6a4efa74427d71c4d P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260810 02:00:24.225924 23134 consensus_queue.cc:1048] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 02:00:24.230269 6734 raft_consensus.cc:1275] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260810 02:00:24.231495 23134 consensus_queue.cc:1048] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 02:00:24.255534 23134 raft_consensus.cc:2955] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
I20260810 02:00:24.258100 6735 raft_consensus.cc:2955] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
I20260810 02:00:24.270788 3564 catalog_manager.cc:5719] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4 reported cstate change: config changed from index 8 to 9, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) evicted. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
I20260810 02:00:24.287729 6541 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260810 02:00:24.299904 4311 raft_consensus.cc:2955] T 389d3abfeadd4fe6a4efa74427d71c4d P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
W20260810 02:00:24.308866 23276 log.cc:927] Time spent T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f: Append to log took a long time: real 0.108s user 0.000s sys 0.000s
I20260810 02:00:24.314375 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:24.353763 6541 tablet_service.cc:1558] Processing DeleteTablet for tablet 389d3abfeadd4fe6a4efa74427d71c4d with delete_type TABLET_DATA_TOMBSTONED (TS 22ce0e487f0341fd9bf853393d6e7683 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:37902
I20260810 02:00:24.392381 23316 tablet_replica.cc:333] T 389d3abfeadd4fe6a4efa74427d71c4d P 22ce0e487f0341fd9bf853393d6e7683: stopping tablet replica
I20260810 02:00:24.392764 23316 raft_consensus.cc:2243] T 389d3abfeadd4fe6a4efa74427d71c4d P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:24.392836 6369 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:24.393599 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:24.393743 23316 raft_consensus.cc:2272] T 389d3abfeadd4fe6a4efa74427d71c4d P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:24.398615 23316 ts_tablet_manager.cc:1916] T 389d3abfeadd4fe6a4efa74427d71c4d P 22ce0e487f0341fd9bf853393d6e7683: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 02:00:24.410364 3917 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260810 02:00:24.418336 6394 raft_consensus.cc:1217] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.16->[1.17-1.17] Dedup: 1.17->[]
I20260810 02:00:24.439872 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:24.444310 23316 ts_tablet_manager.cc:1929] T 389d3abfeadd4fe6a4efa74427d71c4d P 22ce0e487f0341fd9bf853393d6e7683: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20260810 02:00:24.444478 23316 log.cc:1199] T 389d3abfeadd4fe6a4efa74427d71c4d P 22ce0e487f0341fd9bf853393d6e7683: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/wal/wals/389d3abfeadd4fe6a4efa74427d71c4d
I20260810 02:00:24.445470 3553 catalog_manager.cc:5050] TS 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317): tablet 389d3abfeadd4fe6a4efa74427d71c4d (table rebalance_test_table_9 [id=372310cb713644ada1071e8eb628b0c9]) successfully deleted
I20260810 02:00:24.478564 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:24.479589 23171 tablet_bootstrap.cc:492] T 8308d63e9002418b876c3d3ae0095d9f P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 02:00:24.480015 23171 tablet_bootstrap.cc:492] T 8308d63e9002418b876c3d3ae0095d9f P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap complete.
I20260810 02:00:24.480357 23171 ts_tablet_manager.cc:1403] T 8308d63e9002418b876c3d3ae0095d9f P c5ed5317da9c464b93f979c405f0f6e4: Time spent bootstrapping tablet: real 0.611s user 0.054s sys 0.006s
I20260810 02:00:24.501214 3735 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:24.481299 23171 raft_consensus.cc:359] T 8308d63e9002418b876c3d3ae0095d9f P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 02:00:24.516433 23171 raft_consensus.cc:740] T 8308d63e9002418b876c3d3ae0095d9f P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ed5317da9c464b93f979c405f0f6e4, State: Initialized, Role: FOLLOWER
I20260810 02:00:24.517091 23171 consensus_queue.cc:260] T 8308d63e9002418b876c3d3ae0095d9f P c5ed5317da9c464b93f979c405f0f6e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 1.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 02:00:24.523236 23171 ts_tablet_manager.cc:1434] T 8308d63e9002418b876c3d3ae0095d9f P c5ed5317da9c464b93f979c405f0f6e4: Time spent starting tablet: real 0.043s user 0.002s sys 0.003s
I20260810 02:00:24.532677 4337 tablet_copy_service.cc:342] P ca4469fc2dbc48488bc7ad7f482f129e: Request end of tablet copy session c5ed5317da9c464b93f979c405f0f6e4-8308d63e9002418b876c3d3ae0095d9f received from {username='slave'} at 127.21.64.199:39019
I20260810 02:00:24.532835 4337 tablet_copy_service.cc:434] P ca4469fc2dbc48488bc7ad7f482f129e: ending tablet copy session c5ed5317da9c464b93f979c405f0f6e4-8308d63e9002418b876c3d3ae0095d9f on tablet 8308d63e9002418b876c3d3ae0095d9f with peer c5ed5317da9c464b93f979c405f0f6e4
I20260810 02:00:24.677594 3943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6c5892f4de449fb8cb7f4cff7eb2e20"
dest_uuid: "82f93d1d11364ceeb485585b4ae78871"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:38806
I20260810 02:00:24.677886 3943 raft_consensus.cc:606] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Received request to transfer leadership
I20260810 02:00:24.687618 6734 raft_consensus.cc:1217] T 8308d63e9002418b876c3d3ae0095d9f P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.9->[1.10-1.10] Dedup: 1.10->[]
I20260810 02:00:24.703754 22540 raft_consensus.cc:993] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871: : Instructing follower 22ce0e487f0341fd9bf853393d6e7683 to start an election
I20260810 02:00:24.703878 22540 raft_consensus.cc:1081] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Signalling peer 22ce0e487f0341fd9bf853393d6e7683 to start an election
I20260810 02:00:24.704615 6567 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b6c5892f4de449fb8cb7f4cff7eb2e20"
dest_uuid: "22ce0e487f0341fd9bf853393d6e7683"
from {username='slave'} at 127.21.64.194:42911
I20260810 02:00:24.704882 6567 raft_consensus.cc:493] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260810 02:00:24.705018 6567 raft_consensus.cc:3060] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Advancing to term 2
I20260810 02:00:24.711830 6567 raft_consensus.cc:515] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 22ce0e487f0341fd9bf853393d6e7683 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 02:00:24.724634 3759 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df5b102a0b03406f9449cdd84dfd147e"
dest_uuid: "dc85be7d460a404f997177f57680850f"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:33664
I20260810 02:00:24.724999 3759 raft_consensus.cc:606] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Received request to transfer leadership
I20260810 02:00:24.739857 6567 leader_election.cc:290] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 22ce0e487f0341fd9bf853393d6e7683 [CANDIDATE]: Term 2 election: Requested vote from peers 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893), c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199:41689), 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995)
I20260810 02:00:24.742448 3943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c5892f4de449fb8cb7f4cff7eb2e20" candidate_uuid: "22ce0e487f0341fd9bf853393d6e7683" candidate_term: 2 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: true dest_uuid: "82f93d1d11364ceeb485585b4ae78871"
I20260810 02:00:24.742705 3943 raft_consensus.cc:3055] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Stepping down as leader of term 1
I20260810 02:00:24.742818 3943 raft_consensus.cc:740] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 82f93d1d11364ceeb485585b4ae78871, State: Running, Role: LEADER
I20260810 02:00:24.743152 3943 consensus_queue.cc:260] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 10, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 02:00:24.743690 3943 raft_consensus.cc:3060] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Advancing to term 2
I20260810 02:00:24.748384 3943 raft_consensus.cc:2468] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ce0e487f0341fd9bf853393d6e7683 in term 2.
I20260810 02:00:24.792235 6909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c5892f4de449fb8cb7f4cff7eb2e20" candidate_uuid: "22ce0e487f0341fd9bf853393d6e7683" candidate_term: 2 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: true dest_uuid: "3136daf7101445beadc1aa19bc01c227"
I20260810 02:00:24.792486 6909 raft_consensus.cc:3060] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Advancing to term 2
I20260810 02:00:24.795482 6909 raft_consensus.cc:2468] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ce0e487f0341fd9bf853393d6e7683 in term 2.
I20260810 02:00:24.806386 6479 leader_election.cc:304] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 22ce0e487f0341fd9bf853393d6e7683 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 22ce0e487f0341fd9bf853393d6e7683, 3136daf7101445beadc1aa19bc01c227, 82f93d1d11364ceeb485585b4ae78871; no voters:
I20260810 02:00:24.816905 23377 raft_consensus.cc:2804] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 22ce0e487f0341fd9bf853393d6e7683 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 02:00:24.818838 6734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c5892f4de449fb8cb7f4cff7eb2e20" candidate_uuid: "22ce0e487f0341fd9bf853393d6e7683" candidate_term: 2 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: true dest_uuid: "c5ed5317da9c464b93f979c405f0f6e4"
I20260810 02:00:24.819219 6734 raft_consensus.cc:3060] T b6c5892f4de449fb8cb7f4cff7eb2e20 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Advancing to term 2
I20260810 02:00:24.822813 6734 raft_consensus.cc:2468] T b6c5892f4de449fb8cb7f4cff7eb2e20 P c5ed5317da9c464b93f979c405f0f6e4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ce0e487f0341fd9bf853393d6e7683 in term 2.
I20260810 02:00:24.849681 23377 raft_consensus.cc:697] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 22ce0e487f0341fd9bf853393d6e7683 [term 2 LEADER]: Becoming Leader. State: Replica: 22ce0e487f0341fd9bf853393d6e7683, State: Running, Role: LEADER
I20260810 02:00:24.850283 23377 consensus_queue.cc:237] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 22ce0e487f0341fd9bf853393d6e7683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 10, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 02:00:24.879910 3565 catalog_manager.cc:5719] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 22ce0e487f0341fd9bf853393d6e7683 reported cstate change: term changed from 1 to 2, leader changed from 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) to 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198). New cstate: current_term: 2 leader_uuid: "22ce0e487f0341fd9bf853393d6e7683" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:25.032923 23426 raft_consensus.cc:993] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f: : Instructing follower 4dd4cba155c941b4b7ad4d64c7431536 to start an election
I20260810 02:00:25.033140 23426 raft_consensus.cc:1081] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Signalling peer 4dd4cba155c941b4b7ad4d64c7431536 to start an election
I20260810 02:00:25.038198 6395 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df5b102a0b03406f9449cdd84dfd147e"
dest_uuid: "4dd4cba155c941b4b7ad4d64c7431536"
from {username='slave'} at 127.21.64.193:41057
I20260810 02:00:25.038412 6395 raft_consensus.cc:493] T df5b102a0b03406f9449cdd84dfd147e P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260810 02:00:25.038496 6395 raft_consensus.cc:3060] T df5b102a0b03406f9449cdd84dfd147e P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Advancing to term 2
I20260810 02:00:25.045398 6395 raft_consensus.cc:515] T df5b102a0b03406f9449cdd84dfd147e P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 02:00:25.048748 6395 leader_election.cc:290] T df5b102a0b03406f9449cdd84dfd147e P 4dd4cba155c941b4b7ad4d64c7431536 [CANDIDATE]: Term 2 election: Requested vote from peers dc85be7d460a404f997177f57680850f (127.21.64.193:36797), c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199:41689), 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317)
I20260810 02:00:25.048862 6567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df5b102a0b03406f9449cdd84dfd147e" candidate_uuid: "4dd4cba155c941b4b7ad4d64c7431536" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: true dest_uuid: "22ce0e487f0341fd9bf853393d6e7683"
I20260810 02:00:25.049070 6567 raft_consensus.cc:3060] T df5b102a0b03406f9449cdd84dfd147e P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Advancing to term 2
I20260810 02:00:25.052168 6567 raft_consensus.cc:2468] T df5b102a0b03406f9449cdd84dfd147e P 22ce0e487f0341fd9bf853393d6e7683 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dd4cba155c941b4b7ad4d64c7431536 in term 2.
I20260810 02:00:25.054425 3759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df5b102a0b03406f9449cdd84dfd147e" candidate_uuid: "4dd4cba155c941b4b7ad4d64c7431536" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: true dest_uuid: "dc85be7d460a404f997177f57680850f"
I20260810 02:00:25.054653 3759 raft_consensus.cc:3055] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Stepping down as leader of term 1
I20260810 02:00:25.054736 3759 raft_consensus.cc:740] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dc85be7d460a404f997177f57680850f, State: Running, Role: LEADER
I20260810 02:00:25.055109 3759 consensus_queue.cc:260] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 02:00:25.055637 3759 raft_consensus.cc:3060] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Advancing to term 2
I20260810 02:00:25.058902 3759 raft_consensus.cc:2468] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dd4cba155c941b4b7ad4d64c7431536 in term 2.
I20260810 02:00:25.061690 6308 leader_election.cc:304] T df5b102a0b03406f9449cdd84dfd147e P 4dd4cba155c941b4b7ad4d64c7431536 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 22ce0e487f0341fd9bf853393d6e7683, 4dd4cba155c941b4b7ad4d64c7431536, dc85be7d460a404f997177f57680850f; no voters:
I20260810 02:00:25.061988 21734 raft_consensus.cc:2804] T df5b102a0b03406f9449cdd84dfd147e P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 02:00:25.072886 6734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df5b102a0b03406f9449cdd84dfd147e" candidate_uuid: "4dd4cba155c941b4b7ad4d64c7431536" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: true dest_uuid: "c5ed5317da9c464b93f979c405f0f6e4"
I20260810 02:00:25.073140 6734 raft_consensus.cc:3060] T df5b102a0b03406f9449cdd84dfd147e P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Advancing to term 2
I20260810 02:00:25.076231 6734 raft_consensus.cc:2468] T df5b102a0b03406f9449cdd84dfd147e P c5ed5317da9c464b93f979c405f0f6e4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dd4cba155c941b4b7ad4d64c7431536 in term 2.
I20260810 02:00:25.119525 21734 raft_consensus.cc:697] T df5b102a0b03406f9449cdd84dfd147e P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 LEADER]: Becoming Leader. State: Replica: 4dd4cba155c941b4b7ad4d64c7431536, State: Running, Role: LEADER
I20260810 02:00:25.123899 21734 consensus_queue.cc:237] T df5b102a0b03406f9449cdd84dfd147e P 4dd4cba155c941b4b7ad4d64c7431536 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 02:00:25.158905 3574 catalog_manager.cc:5719] T df5b102a0b03406f9449cdd84dfd147e P 4dd4cba155c941b4b7ad4d64c7431536 reported cstate change: term changed from 1 to 2, leader changed from dc85be7d460a404f997177f57680850f (127.21.64.193) to 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197). New cstate: current_term: 2 leader_uuid: "4dd4cba155c941b4b7ad4d64c7431536" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:25.259704 3943 raft_consensus.cc:1275] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [term 2 FOLLOWER]: Refusing update from remote peer 22ce0e487f0341fd9bf853393d6e7683: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 2 index: 11. (index mismatch)
I20260810 02:00:25.272543 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:25.304113 23377 consensus_queue.cc:1048] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 22ce0e487f0341fd9bf853393d6e7683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260810 02:00:25.305205 6479 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.194:43893, user_credentials={real_user=slave}} blocked reactor thread for 44489.2us
I20260810 02:00:25.345533 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:25.362221 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:25.367096 6734 raft_consensus.cc:1275] T b6c5892f4de449fb8cb7f4cff7eb2e20 P c5ed5317da9c464b93f979c405f0f6e4 [term 2 FOLLOWER]: Refusing update from remote peer 22ce0e487f0341fd9bf853393d6e7683: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 2 index: 11. (index mismatch)
I20260810 02:00:25.374698 23377 consensus_queue.cc:1048] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 22ce0e487f0341fd9bf853393d6e7683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260810 02:00:25.406713 6909 raft_consensus.cc:1275] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Refusing update from remote peer 22ce0e487f0341fd9bf853393d6e7683: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 2 index: 11. (index mismatch)
I20260810 02:00:25.407905 23377 consensus_queue.cc:1048] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 22ce0e487f0341fd9bf853393d6e7683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260810 02:00:25.429772 4224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.199:41689, user_credentials={real_user=slave}} blocked reactor thread for 69004.7us
I20260810 02:00:25.442066 6369 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:25.456688 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:25.473940 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:25.484711 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:25.487908 3917 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:25.531091 3917 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:25.561539 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:25.561758 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:25.566380 6369 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:25.573114 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:25.614121 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
W20260810 02:00:25.633931 6480 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.199:41689, user_credentials={real_user=slave}} blocked reactor thread for 71301.4us
I20260810 02:00:25.639672 3735 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260810 02:00:25.656772 3759 raft_consensus.cc:1275] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [term 2 FOLLOWER]: Refusing update from remote peer 4dd4cba155c941b4b7ad4d64c7431536: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20260810 02:00:25.657694 21734 consensus_queue.cc:1048] T df5b102a0b03406f9449cdd84dfd147e P 4dd4cba155c941b4b7ad4d64c7431536 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 02:00:25.683946 6567 raft_consensus.cc:1275] T df5b102a0b03406f9449cdd84dfd147e P 22ce0e487f0341fd9bf853393d6e7683 [term 2 FOLLOWER]: Refusing update from remote peer 4dd4cba155c941b4b7ad4d64c7431536: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20260810 02:00:25.684644 21734 consensus_queue.cc:1048] T df5b102a0b03406f9449cdd84dfd147e P 4dd4cba155c941b4b7ad4d64c7431536 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 02:00:25.731477 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:25.756073 3735 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
W20260810 02:00:25.771566 6311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.198:45317, user_credentials={real_user=slave}} blocked reactor thread for 46775.9us
I20260810 02:00:25.775825 6734 raft_consensus.cc:1275] T df5b102a0b03406f9449cdd84dfd147e P c5ed5317da9c464b93f979c405f0f6e4 [term 2 FOLLOWER]: Refusing update from remote peer 4dd4cba155c941b4b7ad4d64c7431536: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20260810 02:00:25.777616 21734 consensus_queue.cc:1048] T df5b102a0b03406f9449cdd84dfd147e P 4dd4cba155c941b4b7ad4d64c7431536 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 02:00:25.814947 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:25.867172 3917 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:25.875129 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:25.881738 6369 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:25.926800 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:25.944151 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:25.945133 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:25.954077 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:26.045519 3735 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260810 02:00:26.045919 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:26.059949 6369 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:26.106156 3917 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:26.133675 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:26.178789 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:26.192035 3735 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260810 02:00:26.448478 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:26.464443 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:26.493778 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:26.548625 3917 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:26.572027 3735 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260810 02:00:26.579003 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:26.607363 6369 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:26.615051 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
W20260810 02:00:26.689219 4038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.196:41943, user_credentials={real_user=slave}} blocked reactor thread for 65956.9us
I20260810 02:00:26.756677 3759 consensus_queue.cc:237] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 1.17, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
W20260810 02:00:26.773478 3672 consensus_peers.cc:597] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f -> Peer 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317): Couldn't send request to peer 22ce0e487f0341fd9bf853393d6e7683. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 02:00:26.774637 6395 raft_consensus.cc:1275] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 17. Preceding OpId from leader: term: 1 index: 18. (index mismatch)
I20260810 02:00:26.775345 23618 consensus_queue.cc:1048] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260810 02:00:26.782209 6909 raft_consensus.cc:1275] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 17. Preceding OpId from leader: term: 1 index: 18. (index mismatch)
I20260810 02:00:26.782986 23618 consensus_queue.cc:1048] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260810 02:00:26.801990 23618 raft_consensus.cc:2955] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.18: config changed from index 17 to 18, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:26.808233 6394 raft_consensus.cc:2955] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Committing config change with OpId 1.18: config changed from index 17 to 18, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:26.818107 3558 catalog_manager.cc:5719] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f reported cstate change: config changed from index 17 to 18, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:26.822429 6909 raft_consensus.cc:2955] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.18: config changed from index 17 to 18, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:26.898468 6567 consensus_queue.cc:237] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 22ce0e487f0341fd9bf853393d6e7683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 2.11, Last appended by leader: 10, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 02:00:26.905220 6909 raft_consensus.cc:1275] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Refusing update from remote peer 22ce0e487f0341fd9bf853393d6e7683: Log matching property violated. Preceding OpId in replica: term: 2 index: 11. Preceding OpId from leader: term: 2 index: 12. (index mismatch)
I20260810 02:00:26.907465 6734 raft_consensus.cc:1275] T b6c5892f4de449fb8cb7f4cff7eb2e20 P c5ed5317da9c464b93f979c405f0f6e4 [term 2 FOLLOWER]: Refusing update from remote peer 22ce0e487f0341fd9bf853393d6e7683: Log matching property violated. Preceding OpId in replica: term: 2 index: 11. Preceding OpId from leader: term: 2 index: 12. (index mismatch)
I20260810 02:00:26.908527 23546 consensus_queue.cc:1048] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 22ce0e487f0341fd9bf853393d6e7683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260810 02:00:26.908957 23762 consensus_queue.cc:1048] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 22ce0e487f0341fd9bf853393d6e7683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260810 02:00:26.912460 6735 consensus_queue.cc:237] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 2.11, Last appended by leader: 6, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 02:00:26.921661 23546 raft_consensus.cc:2955] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 22ce0e487f0341fd9bf853393d6e7683 [term 2 LEADER]: Committing config change with OpId 2.12: config changed from index 10 to 12, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:26.925096 6734 raft_consensus.cc:2955] T b6c5892f4de449fb8cb7f4cff7eb2e20 P c5ed5317da9c464b93f979c405f0f6e4 [term 2 FOLLOWER]: Committing config change with OpId 2.12: config changed from index 10 to 12, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:26.934243 3565 catalog_manager.cc:5719] T b6c5892f4de449fb8cb7f4cff7eb2e20 P c5ed5317da9c464b93f979c405f0f6e4 reported cstate change: config changed from index 10 to 12, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New cstate: current_term: 2 leader_uuid: "22ce0e487f0341fd9bf853393d6e7683" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:26.939452 3917 tablet_service.cc:1558] Processing DeleteTablet for tablet b6c5892f4de449fb8cb7f4cff7eb2e20 with delete_type TABLET_DATA_TOMBSTONED (TS 82f93d1d11364ceeb485585b4ae78871 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:51288
I20260810 02:00:26.958364 23775 tablet_replica.cc:333] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871: stopping tablet replica
I20260810 02:00:26.959872 23775 raft_consensus.cc:2243] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:26.960278 23775 raft_consensus.cc:2272] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:26.961615 23775 ts_tablet_manager.cc:1916] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 02:00:26.966502 6909 raft_consensus.cc:2955] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Committing config change with OpId 2.12: config changed from index 10 to 12, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:26.973470 3943 raft_consensus.cc:1275] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [term 2 FOLLOWER]: Refusing update from remote peer c5ed5317da9c464b93f979c405f0f6e4: Log matching property violated. Preceding OpId in replica: term: 2 index: 11. Preceding OpId from leader: term: 2 index: 12. (index mismatch)
I20260810 02:00:26.974318 18966 consensus_queue.cc:1048] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260810 02:00:26.980141 6395 raft_consensus.cc:1275] T da507bc24d964ce1a5835edad5177726 P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 FOLLOWER]: Refusing update from remote peer c5ed5317da9c464b93f979c405f0f6e4: Log matching property violated. Preceding OpId in replica: term: 2 index: 11. Preceding OpId from leader: term: 2 index: 12. (index mismatch)
I20260810 02:00:26.981014 18966 consensus_queue.cc:1048] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260810 02:00:26.995643 23775 ts_tablet_manager.cc:1929] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.11
I20260810 02:00:26.995891 23775 log.cc:1199] T b6c5892f4de449fb8cb7f4cff7eb2e20 P 82f93d1d11364ceeb485585b4ae78871: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal/wals/b6c5892f4de449fb8cb7f4cff7eb2e20
I20260810 02:00:26.997213 3553 catalog_manager.cc:5050] TS 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): tablet b6c5892f4de449fb8cb7f4cff7eb2e20 (table rebalance_test_table_4 [id=3e1f7b9b31614ed383207098de38230c]) successfully deleted
I20260810 02:00:27.002698 6395 raft_consensus.cc:2955] T da507bc24d964ce1a5835edad5177726 P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 FOLLOWER]: Committing config change with OpId 2.12: config changed from index 11 to 12, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:27.001754 23792 raft_consensus.cc:2955] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4 [term 2 LEADER]: Committing config change with OpId 2.12: config changed from index 11 to 12, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:27.011036 3565 catalog_manager.cc:5719] T da507bc24d964ce1a5835edad5177726 P 4dd4cba155c941b4b7ad4d64c7431536 reported cstate change: config changed from index 11 to 12, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New cstate: current_term: 2 leader_uuid: "c5ed5317da9c464b93f979c405f0f6e4" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:27.018385 3735 tablet_service.cc:1558] Processing DeleteTablet for tablet da507bc24d964ce1a5835edad5177726 with delete_type TABLET_DATA_TOMBSTONED (TS dc85be7d460a404f997177f57680850f not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:33870
I20260810 02:00:27.056325 23797 tablet_replica.cc:333] T da507bc24d964ce1a5835edad5177726 P dc85be7d460a404f997177f57680850f: stopping tablet replica
I20260810 02:00:27.056589 23797 raft_consensus.cc:2243] T da507bc24d964ce1a5835edad5177726 P dc85be7d460a404f997177f57680850f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:27.056828 23797 raft_consensus.cc:2272] T da507bc24d964ce1a5835edad5177726 P dc85be7d460a404f997177f57680850f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:27.057730 23797 ts_tablet_manager.cc:1916] T da507bc24d964ce1a5835edad5177726 P dc85be7d460a404f997177f57680850f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 02:00:27.078630 6395 consensus_queue.cc:237] T df5b102a0b03406f9449cdd84dfd147e P 4dd4cba155c941b4b7ad4d64c7431536 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 2.9, Last appended by leader: 8, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
W20260810 02:00:27.086750 6655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.194:43893, user_credentials={real_user=slave}} blocked reactor thread for 60904.9us
I20260810 02:00:27.088124 3943 raft_consensus.cc:2955] T da507bc24d964ce1a5835edad5177726 P 82f93d1d11364ceeb485585b4ae78871 [term 2 FOLLOWER]: Committing config change with OpId 2.12: config changed from index 11 to 12, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:27.100908 6735 raft_consensus.cc:1275] T df5b102a0b03406f9449cdd84dfd147e P c5ed5317da9c464b93f979c405f0f6e4 [term 2 FOLLOWER]: Refusing update from remote peer 4dd4cba155c941b4b7ad4d64c7431536: Log matching property violated. Preceding OpId in replica: term: 2 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20260810 02:00:27.101428 6567 raft_consensus.cc:1275] T df5b102a0b03406f9449cdd84dfd147e P 22ce0e487f0341fd9bf853393d6e7683 [term 2 FOLLOWER]: Refusing update from remote peer 4dd4cba155c941b4b7ad4d64c7431536: Log matching property violated. Preceding OpId in replica: term: 2 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20260810 02:00:27.101678 23640 consensus_queue.cc:1048] T df5b102a0b03406f9449cdd84dfd147e P 4dd4cba155c941b4b7ad4d64c7431536 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260810 02:00:27.102720 23640 consensus_queue.cc:1048] T df5b102a0b03406f9449cdd84dfd147e P 4dd4cba155c941b4b7ad4d64c7431536 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260810 02:00:27.104765 23797 ts_tablet_manager.cc:1929] T da507bc24d964ce1a5835edad5177726 P dc85be7d460a404f997177f57680850f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.11
I20260810 02:00:27.104933 23797 log.cc:1199] T da507bc24d964ce1a5835edad5177726 P dc85be7d460a404f997177f57680850f: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/wal/wals/da507bc24d964ce1a5835edad5177726
I20260810 02:00:27.106124 3551 catalog_manager.cc:5050] TS dc85be7d460a404f997177f57680850f (127.21.64.193:36797): tablet da507bc24d964ce1a5835edad5177726 (table rebalance_test_table_3 [id=c515c90b2c71492f812b4df18501ee04]) successfully deleted
I20260810 02:00:27.143283 6563 raft_consensus.cc:2955] T df5b102a0b03406f9449cdd84dfd147e P 22ce0e487f0341fd9bf853393d6e7683 [term 2 FOLLOWER]: Committing config change with OpId 2.10: config changed from index 8 to 10, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:27.156177 3565 catalog_manager.cc:5719] T df5b102a0b03406f9449cdd84dfd147e P 22ce0e487f0341fd9bf853393d6e7683 reported cstate change: config changed from index 8 to 10, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New cstate: current_term: 2 leader_uuid: "4dd4cba155c941b4b7ad4d64c7431536" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:27.153606 23827 raft_consensus.cc:2955] T df5b102a0b03406f9449cdd84dfd147e P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 LEADER]: Committing config change with OpId 2.10: config changed from index 8 to 10, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:27.160387 6735 raft_consensus.cc:2955] T df5b102a0b03406f9449cdd84dfd147e P c5ed5317da9c464b93f979c405f0f6e4 [term 2 FOLLOWER]: Committing config change with OpId 2.10: config changed from index 8 to 10, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:27.173058 3735 tablet_service.cc:1558] Processing DeleteTablet for tablet df5b102a0b03406f9449cdd84dfd147e with delete_type TABLET_DATA_TOMBSTONED (TS dc85be7d460a404f997177f57680850f not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:33870
I20260810 02:00:27.173543 23797 tablet_replica.cc:333] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f: stopping tablet replica
I20260810 02:00:27.173815 23797 raft_consensus.cc:2243] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:27.174026 23797 raft_consensus.cc:2272] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:27.175048 23797 ts_tablet_manager.cc:1916] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 02:00:27.183522 23797 ts_tablet_manager.cc:1929] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.9
I20260810 02:00:27.186656 23797 log.cc:1199] T df5b102a0b03406f9449cdd84dfd147e P dc85be7d460a404f997177f57680850f: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/wal/wals/df5b102a0b03406f9449cdd84dfd147e
I20260810 02:00:27.187507 3551 catalog_manager.cc:5050] TS dc85be7d460a404f997177f57680850f (127.21.64.193:36797): tablet df5b102a0b03406f9449cdd84dfd147e (table rebalance_test_table_2 [id=5e8751d351ba4b7da7861e02b0c3c634]) successfully deleted
I20260810 02:00:27.242251 23862 ts_tablet_manager.cc:933] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683: Initiating tablet copy from peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
I20260810 02:00:27.267521 23862 tablet_copy_client.cc:323] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.193:36797
I20260810 02:00:27.267885 4311 consensus_queue.cc:237] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 02:00:27.268941 3787 tablet_copy_service.cc:140] P dc85be7d460a404f997177f57680850f: Received BeginTabletCopySession request for tablet 252899385eaa45b392974d2768e3cf01 from peer 22ce0e487f0341fd9bf853393d6e7683 ({username='slave'} at 127.21.64.198:55265)
I20260810 02:00:27.269125 3787 tablet_copy_service.cc:161] P dc85be7d460a404f997177f57680850f: Beginning new tablet copy session on tablet 252899385eaa45b392974d2768e3cf01 from peer 22ce0e487f0341fd9bf853393d6e7683 at {username='slave'} at 127.21.64.198:55265: session id = 22ce0e487f0341fd9bf853393d6e7683-252899385eaa45b392974d2768e3cf01
I20260810 02:00:27.277921 3945 consensus_queue.cc:237] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 02:00:27.282984 3787 tablet_copy_source_session.cc:215] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 02:00:27.291468 23862 ts_tablet_manager.cc:1916] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260810 02:00:27.299479 3943 raft_consensus.cc:1275] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260810 02:00:27.304769 23495 consensus_queue.cc:1048] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 02:00:27.307725 6735 raft_consensus.cc:1275] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20260810 02:00:27.308807 23857 consensus_queue.cc:1048] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260810 02:00:27.311642 4129 raft_consensus.cc:1275] T 5528e3ba51a640eaa614f141440bb90b P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260810 02:00:27.313110 6395 raft_consensus.cc:1275] T 4a4350cf2ece4769b8547620ac5bedcb P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20260810 02:00:27.313666 23745 consensus_queue.cc:1048] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 02:00:27.317273 23857 consensus_queue.cc:1048] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260810 02:00:27.319727 23862 ts_tablet_manager.cc:1929] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.15
I20260810 02:00:27.320241 23862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 252899385eaa45b392974d2768e3cf01. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 02:00:27.320544 4222 consensus_peers.cc:597] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e -> Peer 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317): Couldn't send request to peer 22ce0e487f0341fd9bf853393d6e7683. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 02:00:27.335404 23862 tablet_copy_client.cc:806] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Starting download of 0 data blocks...
I20260810 02:00:27.336004 23862 tablet_copy_client.cc:670] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Starting download of 1 WAL segments...
I20260810 02:00:27.338737 23862 tablet_copy_client.cc:538] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 02:00:27.345566 23862 tablet_bootstrap.cc:492] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap starting.
I20260810 02:00:27.351751 22897 raft_consensus.cc:2955] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:27.352605 6394 raft_consensus.cc:2955] T 4a4350cf2ece4769b8547620ac5bedcb P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:27.358520 3574 catalog_manager.cc:5719] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 reported cstate change: config changed from index 12 to 13, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) evicted. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:27.360304 6734 raft_consensus.cc:2955] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:27.364845 6541 tablet_service.cc:1558] Processing DeleteTablet for tablet 4a4350cf2ece4769b8547620ac5bedcb with delete_type TABLET_DATA_TOMBSTONED (TS 22ce0e487f0341fd9bf853393d6e7683 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:37902
I20260810 02:00:27.401693 23896 tablet_replica.cc:333] T 4a4350cf2ece4769b8547620ac5bedcb P 22ce0e487f0341fd9bf853393d6e7683: stopping tablet replica
I20260810 02:00:27.402209 23896 raft_consensus.cc:2243] T 4a4350cf2ece4769b8547620ac5bedcb P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:27.402774 23896 raft_consensus.cc:2272] T 4a4350cf2ece4769b8547620ac5bedcb P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:27.407182 23896 ts_tablet_manager.cc:1916] T 4a4350cf2ece4769b8547620ac5bedcb P 22ce0e487f0341fd9bf853393d6e7683: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 02:00:27.420334 23495 raft_consensus.cc:2955] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:27.421090 3943 raft_consensus.cc:2955] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:27.427134 4129 raft_consensus.cc:2955] T 5528e3ba51a640eaa614f141440bb90b P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:27.435139 3565 catalog_manager.cc:5719] T 5528e3ba51a640eaa614f141440bb90b P 17b49c694faf479ea2e5083470fc0302 reported cstate change: config changed from index 7 to 8, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:27.455446 23896 ts_tablet_manager.cc:1929] T 4a4350cf2ece4769b8547620ac5bedcb P 22ce0e487f0341fd9bf853393d6e7683: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.12
I20260810 02:00:27.455694 23896 log.cc:1199] T 4a4350cf2ece4769b8547620ac5bedcb P 22ce0e487f0341fd9bf853393d6e7683: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/wal/wals/4a4350cf2ece4769b8547620ac5bedcb
I20260810 02:00:27.456785 3553 catalog_manager.cc:5050] TS 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317): tablet 4a4350cf2ece4769b8547620ac5bedcb (table rebalance_test_table_8 [id=afa71147917d44a585bcbaa37497a2b1]) successfully deleted
I20260810 02:00:27.501926 23862 tablet_bootstrap.cc:492] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap replayed 1/1 log segments. Stats: ops{read=18 overwritten=0 applied=18 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 02:00:27.502619 23862 tablet_bootstrap.cc:492] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap complete.
I20260810 02:00:27.503036 23862 ts_tablet_manager.cc:1403] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683: Time spent bootstrapping tablet: real 0.158s user 0.087s sys 0.017s
I20260810 02:00:27.504153 23862 raft_consensus.cc:359] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 02:00:27.504485 23862 raft_consensus.cc:740] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ce0e487f0341fd9bf853393d6e7683, State: Initialized, Role: FOLLOWER
I20260810 02:00:27.504812 23862 consensus_queue.cc:260] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 18, Last appended: 1.18, Last appended by leader: 18, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 02:00:27.505790 23862 ts_tablet_manager.cc:1434] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260810 02:00:27.506675 3787 tablet_copy_service.cc:342] P dc85be7d460a404f997177f57680850f: Request end of tablet copy session 22ce0e487f0341fd9bf853393d6e7683-252899385eaa45b392974d2768e3cf01 received from {username='slave'} at 127.21.64.198:55265
I20260810 02:00:27.506817 3787 tablet_copy_service.cc:434] P dc85be7d460a404f997177f57680850f: ending tablet copy session 22ce0e487f0341fd9bf853393d6e7683-252899385eaa45b392974d2768e3cf01 on tablet 252899385eaa45b392974d2768e3cf01 with peer 22ce0e487f0341fd9bf853393d6e7683
I20260810 02:00:27.721477 6563 raft_consensus.cc:1217] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.17->[1.18-1.18] Dedup: 1.18->[]
I20260810 02:00:27.730744 23862 ts_tablet_manager.cc:933] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683: Initiating tablet copy from peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943)
I20260810 02:00:27.773674 23862 tablet_copy_client.cc:323] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.196:41943
I20260810 02:00:27.788578 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:27.837970 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:27.842121 3759 consensus_queue.cc:237] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 02:00:27.870373 6369 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:27.872797 6397 raft_consensus.cc:1275] T 3a15b27dbdaf4092aea66c3670204fcc P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
W20260810 02:00:27.873744 3670 consensus_peers.cc:597] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f -> Peer 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995): Couldn't send request to peer 3136daf7101445beadc1aa19bc01c227. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3a15b27dbdaf4092aea66c3670204fcc. This is attempt 1: this message will repeat every 5th retry.
I20260810 02:00:27.875984 23436 consensus_queue.cc:1048] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 02:00:27.891435 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:27.917970 4337 tablet_copy_service.cc:140] P ca4469fc2dbc48488bc7ad7f482f129e: Received BeginTabletCopySession request for tablet 5528e3ba51a640eaa614f141440bb90b from peer 22ce0e487f0341fd9bf853393d6e7683 ({username='slave'} at 127.21.64.198:59283)
I20260810 02:00:27.918181 4337 tablet_copy_service.cc:161] P ca4469fc2dbc48488bc7ad7f482f129e: Beginning new tablet copy session on tablet 5528e3ba51a640eaa614f141440bb90b from peer 22ce0e487f0341fd9bf853393d6e7683 at {username='slave'} at 127.21.64.198:59283: session id = 22ce0e487f0341fd9bf853393d6e7683-5528e3ba51a640eaa614f141440bb90b
I20260810 02:00:27.919324 3735 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260810 02:00:27.923192 4337 tablet_copy_source_session.cc:215] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 02:00:27.931020 23862 ts_tablet_manager.cc:1916] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260810 02:00:27.952275 6563 raft_consensus.cc:1275] T 3a15b27dbdaf4092aea66c3670204fcc P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260810 02:00:27.953305 23436 consensus_queue.cc:1048] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 02:00:27.965693 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:27.961174 23862 ts_tablet_manager.cc:1929] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.6
I20260810 02:00:27.973318 23862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5528e3ba51a640eaa614f141440bb90b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 02:00:27.979120 23862 tablet_copy_client.cc:806] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Starting download of 0 data blocks...
I20260810 02:00:27.979360 23862 tablet_copy_client.cc:670] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Starting download of 1 WAL segments...
I20260810 02:00:27.997295 23862 tablet_copy_client.cc:538] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 02:00:28.005195 23862 tablet_bootstrap.cc:492] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap starting.
I20260810 02:00:28.029978 24019 raft_consensus.cc:2955] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:28.035782 3917 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:28.035573 6563 raft_consensus.cc:2955] T 3a15b27dbdaf4092aea66c3670204fcc P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:28.059265 6394 raft_consensus.cc:2955] T 3a15b27dbdaf4092aea66c3670204fcc P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:28.066805 3564 catalog_manager.cc:5719] T 3a15b27dbdaf4092aea66c3670204fcc P 4dd4cba155c941b4b7ad4d64c7431536 reported cstate change: config changed from index 7 to 8, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:28.139426 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:28.234457 23862 tablet_bootstrap.cc:492] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 02:00:28.234961 23862 tablet_bootstrap.cc:492] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap complete.
I20260810 02:00:28.235281 23862 ts_tablet_manager.cc:1403] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683: Time spent bootstrapping tablet: real 0.230s user 0.058s sys 0.003s
I20260810 02:00:28.236310 23862 raft_consensus.cc:359] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 02:00:28.236577 23862 raft_consensus.cc:740] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ce0e487f0341fd9bf853393d6e7683, State: Initialized, Role: FOLLOWER
I20260810 02:00:28.236900 23862 consensus_queue.cc:260] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 02:00:28.239190 23862 ts_tablet_manager.cc:1434] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260810 02:00:28.239960 4337 tablet_copy_service.cc:342] P ca4469fc2dbc48488bc7ad7f482f129e: Request end of tablet copy session 22ce0e487f0341fd9bf853393d6e7683-5528e3ba51a640eaa614f141440bb90b received from {username='slave'} at 127.21.64.198:59283
I20260810 02:00:28.240097 4337 tablet_copy_service.cc:434] P ca4469fc2dbc48488bc7ad7f482f129e: ending tablet copy session 22ce0e487f0341fd9bf853393d6e7683-5528e3ba51a640eaa614f141440bb90b on tablet 5528e3ba51a640eaa614f141440bb90b with peer 22ce0e487f0341fd9bf853393d6e7683
I20260810 02:00:28.423250 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
W20260810 02:00:28.462414 3857 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.198:45317, user_credentials={real_user=slave}} blocked reactor thread for 178752us
I20260810 02:00:28.513676 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:28.585776 24138 ts_tablet_manager.cc:933] T 3a15b27dbdaf4092aea66c3670204fcc P 3136daf7101445beadc1aa19bc01c227: Initiating tablet copy from peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
I20260810 02:00:28.601998 24138 tablet_copy_client.cc:323] T 3a15b27dbdaf4092aea66c3670204fcc P 3136daf7101445beadc1aa19bc01c227: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.193:36797
I20260810 02:00:28.602928 3787 tablet_copy_service.cc:140] P dc85be7d460a404f997177f57680850f: Received BeginTabletCopySession request for tablet 3a15b27dbdaf4092aea66c3670204fcc from peer 3136daf7101445beadc1aa19bc01c227 ({username='slave'} at 127.21.64.200:47703)
I20260810 02:00:28.603246 3787 tablet_copy_service.cc:161] P dc85be7d460a404f997177f57680850f: Beginning new tablet copy session on tablet 3a15b27dbdaf4092aea66c3670204fcc from peer 3136daf7101445beadc1aa19bc01c227 at {username='slave'} at 127.21.64.200:47703: session id = 3136daf7101445beadc1aa19bc01c227-3a15b27dbdaf4092aea66c3670204fcc
I20260810 02:00:28.608045 3787 tablet_copy_source_session.cc:215] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 02:00:28.612540 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:28.612990 24138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a15b27dbdaf4092aea66c3670204fcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 02:00:28.643716 3735 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260810 02:00:28.650238 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:28.656895 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:28.685916 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:28.696183 6369 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:28.708283 6369 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:28.712455 3917 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:28.731544 24138 tablet_copy_client.cc:806] T 3a15b27dbdaf4092aea66c3670204fcc P 3136daf7101445beadc1aa19bc01c227: tablet copy: Starting download of 0 data blocks...
I20260810 02:00:28.731912 24138 tablet_copy_client.cc:670] T 3a15b27dbdaf4092aea66c3670204fcc P 3136daf7101445beadc1aa19bc01c227: tablet copy: Starting download of 1 WAL segments...
I20260810 02:00:28.733876 24138 tablet_copy_client.cc:538] T 3a15b27dbdaf4092aea66c3670204fcc P 3136daf7101445beadc1aa19bc01c227: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 02:00:28.737841 24138 tablet_bootstrap.cc:492] T 3a15b27dbdaf4092aea66c3670204fcc P 3136daf7101445beadc1aa19bc01c227: Bootstrap starting.
I20260810 02:00:28.765555 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:28.768553 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:28.774863 3917 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
W20260810 02:00:28.780256 4222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.194:43893, user_credentials={real_user=slave}} blocked reactor thread for 111203us
I20260810 02:00:28.780652 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:28.781014 6563 raft_consensus.cc:1217] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20260810 02:00:28.842804 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:28.846891 3735 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260810 02:00:28.999017 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:29.055217 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:29.086921 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:29.090541 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:29.107218 6369 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:29.111243 3917 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:29.144915 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:29.179454 3735 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260810 02:00:29.381486 24138 tablet_bootstrap.cc:492] T 3a15b27dbdaf4092aea66c3670204fcc P 3136daf7101445beadc1aa19bc01c227: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 02:00:29.381989 24138 tablet_bootstrap.cc:492] T 3a15b27dbdaf4092aea66c3670204fcc P 3136daf7101445beadc1aa19bc01c227: Bootstrap complete.
I20260810 02:00:29.382306 24138 ts_tablet_manager.cc:1403] T 3a15b27dbdaf4092aea66c3670204fcc P 3136daf7101445beadc1aa19bc01c227: Time spent bootstrapping tablet: real 0.645s user 0.059s sys 0.004s
I20260810 02:00:29.382995 24138 raft_consensus.cc:359] T 3a15b27dbdaf4092aea66c3670204fcc P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 02:00:29.383231 24138 raft_consensus.cc:740] T 3a15b27dbdaf4092aea66c3670204fcc P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3136daf7101445beadc1aa19bc01c227, State: Initialized, Role: FOLLOWER
I20260810 02:00:29.383553 24138 consensus_queue.cc:260] T 3a15b27dbdaf4092aea66c3670204fcc P 3136daf7101445beadc1aa19bc01c227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 02:00:29.387079 24138 ts_tablet_manager.cc:1434] T 3a15b27dbdaf4092aea66c3670204fcc P 3136daf7101445beadc1aa19bc01c227: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260810 02:00:29.391685 3787 tablet_copy_service.cc:342] P dc85be7d460a404f997177f57680850f: Request end of tablet copy session 3136daf7101445beadc1aa19bc01c227-3a15b27dbdaf4092aea66c3670204fcc received from {username='slave'} at 127.21.64.200:47703
I20260810 02:00:29.391834 3787 tablet_copy_service.cc:434] P dc85be7d460a404f997177f57680850f: ending tablet copy session 3136daf7101445beadc1aa19bc01c227-3a15b27dbdaf4092aea66c3670204fcc on tablet 3a15b27dbdaf4092aea66c3670204fcc with peer 3136daf7101445beadc1aa19bc01c227
I20260810 02:00:29.505270 6908 raft_consensus.cc:1217] T 3a15b27dbdaf4092aea66c3670204fcc P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20260810 02:00:29.526585 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:29.543465 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:29.579025 3943 consensus_queue.cc:237] T e70193bd4055469d870a76542eaef524 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 2.9, Last appended by leader: 6, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 02:00:29.597965 3945 consensus_queue.cc:237] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 02:00:29.620648 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:29.625370 4311 raft_consensus.cc:1275] T e70193bd4055469d870a76542eaef524 P ca4469fc2dbc48488bc7ad7f482f129e [term 2 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 2 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20260810 02:00:29.626055 23857 consensus_queue.cc:1048] T e70193bd4055469d870a76542eaef524 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260810 02:00:29.630807 3759 raft_consensus.cc:1275] T 2e72e04459b140cc9e20ad633b1ab5c4 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260810 02:00:29.631526 23857 consensus_queue.cc:1048] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 02:00:29.640569 6908 raft_consensus.cc:1275] T 2e72e04459b140cc9e20ad633b1ab5c4 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260810 02:00:29.641392 23857 consensus_queue.cc:1048] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 02:00:29.650501 6563 raft_consensus.cc:1275] T e70193bd4055469d870a76542eaef524 P 22ce0e487f0341fd9bf853393d6e7683 [term 2 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 2 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20260810 02:00:29.652180 23857 consensus_queue.cc:1048] T e70193bd4055469d870a76542eaef524 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260810 02:00:29.658908 23857 raft_consensus.cc:2955] T e70193bd4055469d870a76542eaef524 P 82f93d1d11364ceeb485585b4ae78871 [term 2 LEADER]: Committing config change with OpId 2.10: config changed from index 9 to 10, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
I20260810 02:00:29.690323 4311 raft_consensus.cc:2955] T e70193bd4055469d870a76542eaef524 P ca4469fc2dbc48488bc7ad7f482f129e [term 2 FOLLOWER]: Committing config change with OpId 2.10: config changed from index 9 to 10, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
I20260810 02:00:29.707901 3568 catalog_manager.cc:5719] T e70193bd4055469d870a76542eaef524 P ca4469fc2dbc48488bc7ad7f482f129e reported cstate change: config changed from index 9 to 10, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) evicted. New cstate: current_term: 2 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
I20260810 02:00:29.711916 3759 raft_consensus.cc:2955] T 2e72e04459b140cc9e20ad633b1ab5c4 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } }
I20260810 02:00:29.715359 6908 raft_consensus.cc:2955] T 2e72e04459b140cc9e20ad633b1ab5c4 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } }
I20260810 02:00:29.720408 3562 catalog_manager.cc:5719] T 2e72e04459b140cc9e20ad633b1ab5c4 P dc85be7d460a404f997177f57680850f reported cstate change: config changed from index 8 to 9, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) evicted. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } }
I20260810 02:00:29.711100 24363 raft_consensus.cc:2955] T 2e72e04459b140cc9e20ad633b1ab5c4 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } }
I20260810 02:00:29.741972 6563 raft_consensus.cc:2955] T e70193bd4055469d870a76542eaef524 P 22ce0e487f0341fd9bf853393d6e7683 [term 2 FOLLOWER]: Committing config change with OpId 2.10: config changed from index 9 to 10, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } }
I20260810 02:00:29.743702 6884 tablet_service.cc:1558] Processing DeleteTablet for tablet e70193bd4055469d870a76542eaef524 with delete_type TABLET_DATA_TOMBSTONED (TS 3136daf7101445beadc1aa19bc01c227 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:41662
I20260810 02:00:29.750427 6541 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e72e04459b140cc9e20ad633b1ab5c4 with delete_type TABLET_DATA_TOMBSTONED (TS 22ce0e487f0341fd9bf853393d6e7683 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:37902
I20260810 02:00:29.751405 24388 tablet_replica.cc:333] T 2e72e04459b140cc9e20ad633b1ab5c4 P 22ce0e487f0341fd9bf853393d6e7683: stopping tablet replica
I20260810 02:00:29.751706 24388 raft_consensus.cc:2243] T 2e72e04459b140cc9e20ad633b1ab5c4 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:29.751973 24388 raft_consensus.cc:2272] T 2e72e04459b140cc9e20ad633b1ab5c4 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:29.752813 24388 ts_tablet_manager.cc:1916] T 2e72e04459b140cc9e20ad633b1ab5c4 P 22ce0e487f0341fd9bf853393d6e7683: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 02:00:29.760128 24388 ts_tablet_manager.cc:1929] T 2e72e04459b140cc9e20ad633b1ab5c4 P 22ce0e487f0341fd9bf853393d6e7683: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20260810 02:00:29.760351 24388 log.cc:1199] T 2e72e04459b140cc9e20ad633b1ab5c4 P 22ce0e487f0341fd9bf853393d6e7683: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/wal/wals/2e72e04459b140cc9e20ad633b1ab5c4
I20260810 02:00:29.763324 3553 catalog_manager.cc:5050] TS 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317): tablet 2e72e04459b140cc9e20ad633b1ab5c4 (table rebalance_test_table_1 [id=945a223441a04ba2bf938b104bc91cf8]) successfully deleted
I20260810 02:00:29.769070 6369 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:29.770890 3917 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:29.773660 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:29.776381 24386 tablet_replica.cc:333] T e70193bd4055469d870a76542eaef524 P 3136daf7101445beadc1aa19bc01c227: stopping tablet replica
I20260810 02:00:29.776675 24386 raft_consensus.cc:2243] T e70193bd4055469d870a76542eaef524 P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:29.776944 24386 raft_consensus.cc:2272] T e70193bd4055469d870a76542eaef524 P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:29.777884 24386 ts_tablet_manager.cc:1916] T e70193bd4055469d870a76542eaef524 P 3136daf7101445beadc1aa19bc01c227: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 02:00:29.807040 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
W20260810 02:00:29.851024 4224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.199:41689, user_credentials={real_user=slave}} blocked reactor thread for 52016.4us
I20260810 02:00:29.855108 24386 ts_tablet_manager.cc:1929] T e70193bd4055469d870a76542eaef524 P 3136daf7101445beadc1aa19bc01c227: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.9
I20260810 02:00:29.876788 24386 log.cc:1199] T e70193bd4055469d870a76542eaef524 P 3136daf7101445beadc1aa19bc01c227: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-7/wal/wals/e70193bd4055469d870a76542eaef524
I20260810 02:00:29.878880 3551 catalog_manager.cc:5050] TS 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995): tablet e70193bd4055469d870a76542eaef524 (table rebalance_test_table_7 [id=b572363d270a4bfda571d46e96d0bfda]) successfully deleted
I20260810 02:00:29.901372 4311 consensus_queue.cc:237] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 02:00:29.908614 6563 raft_consensus.cc:1275] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260810 02:00:29.909519 23881 consensus_queue.cc:1048] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260810 02:00:29.911284 6735 raft_consensus.cc:1275] T 8308d63e9002418b876c3d3ae0095d9f P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260810 02:00:29.912889 23881 consensus_queue.cc:1048] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260810 02:00:29.917272 24408 raft_consensus.cc:2955] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 02:00:29.917862 6563 raft_consensus.cc:2955] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 02:00:29.923848 3565 catalog_manager.cc:5719] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683 reported cstate change: config changed from index 10 to 11, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 02:00:29.933028 3917 tablet_service.cc:1558] Processing DeleteTablet for tablet 8308d63e9002418b876c3d3ae0095d9f with delete_type TABLET_DATA_TOMBSTONED (TS 82f93d1d11364ceeb485585b4ae78871 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:51288
I20260810 02:00:29.934356 6734 raft_consensus.cc:2955] T 8308d63e9002418b876c3d3ae0095d9f P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 02:00:29.945243 3735 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260810 02:00:29.950806 24451 tablet_replica.cc:333] T 8308d63e9002418b876c3d3ae0095d9f P 82f93d1d11364ceeb485585b4ae78871: stopping tablet replica
I20260810 02:00:29.951097 24451 raft_consensus.cc:2243] T 8308d63e9002418b876c3d3ae0095d9f P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:29.951494 24451 raft_consensus.cc:2272] T 8308d63e9002418b876c3d3ae0095d9f P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:29.952425 24451 ts_tablet_manager.cc:1916] T 8308d63e9002418b876c3d3ae0095d9f P 82f93d1d11364ceeb485585b4ae78871: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 02:00:30.024204 24451 ts_tablet_manager.cc:1929] T 8308d63e9002418b876c3d3ae0095d9f P 82f93d1d11364ceeb485585b4ae78871: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.10
I20260810 02:00:30.046842 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:30.054646 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:30.059954 24451 log.cc:1199] T 8308d63e9002418b876c3d3ae0095d9f P 82f93d1d11364ceeb485585b4ae78871: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal/wals/8308d63e9002418b876c3d3ae0095d9f
I20260810 02:00:30.067516 6369 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:30.075641 3553 catalog_manager.cc:5050] TS 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): tablet 8308d63e9002418b876c3d3ae0095d9f (table rebalance_test_table_6 [id=5b2df46262b142169af9a32c47535432]) successfully deleted
I20260810 02:00:30.077427 6884 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:30.119836 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:30.134331 3917 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:30.142336 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:30.192781 3735 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260810 02:00:30.452677 3759 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a15b27dbdaf4092aea66c3670204fcc"
dest_uuid: "dc85be7d460a404f997177f57680850f"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:33826
I20260810 02:00:30.452989 3759 raft_consensus.cc:606] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Received request to transfer leadership
I20260810 02:00:30.614631 24508 raft_consensus.cc:993] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f: : Instructing follower 3136daf7101445beadc1aa19bc01c227 to start an election
I20260810 02:00:30.614814 24508 raft_consensus.cc:1081] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Signalling peer 3136daf7101445beadc1aa19bc01c227 to start an election
I20260810 02:00:30.615885 6908 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3a15b27dbdaf4092aea66c3670204fcc"
dest_uuid: "3136daf7101445beadc1aa19bc01c227"
from {username='slave'} at 127.21.64.193:48249
I20260810 02:00:30.616173 6908 raft_consensus.cc:493] T 3a15b27dbdaf4092aea66c3670204fcc P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260810 02:00:30.616310 6908 raft_consensus.cc:3060] T 3a15b27dbdaf4092aea66c3670204fcc P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Advancing to term 2
I20260810 02:00:30.621383 6908 raft_consensus.cc:515] T 3a15b27dbdaf4092aea66c3670204fcc P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 02:00:30.623077 3759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a15b27dbdaf4092aea66c3670204fcc" candidate_uuid: "3136daf7101445beadc1aa19bc01c227" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: true dest_uuid: "dc85be7d460a404f997177f57680850f"
I20260810 02:00:30.623306 3759 raft_consensus.cc:3055] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Stepping down as leader of term 1
I20260810 02:00:30.623416 3759 raft_consensus.cc:740] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dc85be7d460a404f997177f57680850f, State: Running, Role: LEADER
I20260810 02:00:30.623795 3759 consensus_queue.cc:260] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 02:00:30.624331 3759 raft_consensus.cc:3060] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Advancing to term 2
I20260810 02:00:30.629330 3759 raft_consensus.cc:2468] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3136daf7101445beadc1aa19bc01c227 in term 2.
I20260810 02:00:30.639345 6908 leader_election.cc:290] T 3a15b27dbdaf4092aea66c3670204fcc P 3136daf7101445beadc1aa19bc01c227 [CANDIDATE]: Term 2 election: Requested vote from peers dc85be7d460a404f997177f57680850f (127.21.64.193:36797), 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317), 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197:38787)
I20260810 02:00:30.639976 6394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a15b27dbdaf4092aea66c3670204fcc" candidate_uuid: "3136daf7101445beadc1aa19bc01c227" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: true dest_uuid: "4dd4cba155c941b4b7ad4d64c7431536"
I20260810 02:00:30.640267 6394 raft_consensus.cc:3060] T 3a15b27dbdaf4092aea66c3670204fcc P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Advancing to term 2
I20260810 02:00:30.644598 6394 raft_consensus.cc:2468] T 3a15b27dbdaf4092aea66c3670204fcc P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3136daf7101445beadc1aa19bc01c227 in term 2.
I20260810 02:00:30.645323 6824 leader_election.cc:304] T 3a15b27dbdaf4092aea66c3670204fcc P 3136daf7101445beadc1aa19bc01c227 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3136daf7101445beadc1aa19bc01c227, 4dd4cba155c941b4b7ad4d64c7431536, dc85be7d460a404f997177f57680850f; no voters:
I20260810 02:00:30.645697 21889 raft_consensus.cc:2804] T 3a15b27dbdaf4092aea66c3670204fcc P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 02:00:30.647704 21889 raft_consensus.cc:697] T 3a15b27dbdaf4092aea66c3670204fcc P 3136daf7101445beadc1aa19bc01c227 [term 2 LEADER]: Becoming Leader. State: Replica: 3136daf7101445beadc1aa19bc01c227, State: Running, Role: LEADER
I20260810 02:00:30.648140 21889 consensus_queue.cc:237] T 3a15b27dbdaf4092aea66c3670204fcc P 3136daf7101445beadc1aa19bc01c227 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 02:00:30.653273 3562 catalog_manager.cc:5719] T 3a15b27dbdaf4092aea66c3670204fcc P 3136daf7101445beadc1aa19bc01c227 reported cstate change: term changed from 1 to 2, leader changed from dc85be7d460a404f997177f57680850f (127.21.64.193) to 3136daf7101445beadc1aa19bc01c227 (127.21.64.200). New cstate: current_term: 2 leader_uuid: "3136daf7101445beadc1aa19bc01c227" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:30.701683 6567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a15b27dbdaf4092aea66c3670204fcc" candidate_uuid: "3136daf7101445beadc1aa19bc01c227" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: true dest_uuid: "22ce0e487f0341fd9bf853393d6e7683"
I20260810 02:00:30.701913 6567 raft_consensus.cc:3060] T 3a15b27dbdaf4092aea66c3670204fcc P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Advancing to term 2
I20260810 02:00:30.705130 6567 raft_consensus.cc:2468] T 3a15b27dbdaf4092aea66c3670204fcc P 22ce0e487f0341fd9bf853393d6e7683 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3136daf7101445beadc1aa19bc01c227 in term 2.
I20260810 02:00:30.852456 4131 consensus_queue.cc:237] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
W20260810 02:00:30.883934 4036 consensus_peers.cc:597] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 -> Peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797): Couldn't send request to peer dc85be7d460a404f997177f57680850f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c53fc4008faf445fa05e436b9c8e0282. This is attempt 1: this message will repeat every 5th retry.
I20260810 02:00:30.885135 6394 raft_consensus.cc:1275] T c53fc4008faf445fa05e436b9c8e0282 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260810 02:00:30.891021 23699 consensus_queue.cc:1048] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 02:00:30.935894 6908 raft_consensus.cc:1275] T c53fc4008faf445fa05e436b9c8e0282 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260810 02:00:30.937695 23699 consensus_queue.cc:1048] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 02:00:30.942286 23699 raft_consensus.cc:2955] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } }
I20260810 02:00:30.947057 6908 raft_consensus.cc:2955] T c53fc4008faf445fa05e436b9c8e0282 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } }
I20260810 02:00:30.966717 6397 raft_consensus.cc:2955] T c53fc4008faf445fa05e436b9c8e0282 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } }
I20260810 02:00:30.977327 3565 catalog_manager.cc:5719] T c53fc4008faf445fa05e436b9c8e0282 P 3136daf7101445beadc1aa19bc01c227 reported cstate change: config changed from index 7 to 8, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) added. New cstate: current_term: 1 leader_uuid: "17b49c694faf479ea2e5083470fc0302" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } }
I20260810 02:00:31.043884 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:31.054095 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:31.063161 6369 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:31.103591 6567 raft_consensus.cc:1275] T 3a15b27dbdaf4092aea66c3670204fcc P 22ce0e487f0341fd9bf853393d6e7683 [term 2 FOLLOWER]: Refusing update from remote peer 3136daf7101445beadc1aa19bc01c227: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20260810 02:00:31.104969 21889 consensus_queue.cc:1048] T 3a15b27dbdaf4092aea66c3670204fcc P 3136daf7101445beadc1aa19bc01c227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 02:00:31.111207 3917 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:31.154932 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:31.166179 3735 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 02:00:31.184430 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:31.225003 6884 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:31.226308 3759 raft_consensus.cc:1275] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f [term 2 FOLLOWER]: Refusing update from remote peer 3136daf7101445beadc1aa19bc01c227: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20260810 02:00:31.230538 21889 consensus_queue.cc:1048] T 3a15b27dbdaf4092aea66c3670204fcc P 3136daf7101445beadc1aa19bc01c227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260810 02:00:31.300865 6824 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.193:36797, user_credentials={real_user=slave}} blocked reactor thread for 71240us
I20260810 02:00:31.302016 6397 raft_consensus.cc:1275] T 3a15b27dbdaf4092aea66c3670204fcc P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 FOLLOWER]: Refusing update from remote peer 3136daf7101445beadc1aa19bc01c227: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20260810 02:00:31.285586 24780 ts_tablet_manager.cc:933] T c53fc4008faf445fa05e436b9c8e0282 P dc85be7d460a404f997177f57680850f: Initiating tablet copy from peer 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189)
I20260810 02:00:31.303233 21889 consensus_queue.cc:1048] T 3a15b27dbdaf4092aea66c3670204fcc P 3136daf7101445beadc1aa19bc01c227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 02:00:31.327817 24780 tablet_copy_client.cc:323] T c53fc4008faf445fa05e436b9c8e0282 P dc85be7d460a404f997177f57680850f: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.195:39189
I20260810 02:00:31.328732 4162 tablet_copy_service.cc:140] P 17b49c694faf479ea2e5083470fc0302: Received BeginTabletCopySession request for tablet c53fc4008faf445fa05e436b9c8e0282 from peer dc85be7d460a404f997177f57680850f ({username='slave'} at 127.21.64.193:57583)
I20260810 02:00:31.328910 4162 tablet_copy_service.cc:161] P 17b49c694faf479ea2e5083470fc0302: Beginning new tablet copy session on tablet c53fc4008faf445fa05e436b9c8e0282 from peer dc85be7d460a404f997177f57680850f at {username='slave'} at 127.21.64.193:57583: session id = dc85be7d460a404f997177f57680850f-c53fc4008faf445fa05e436b9c8e0282
I20260810 02:00:31.332543 4162 tablet_copy_source_session.cc:215] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 02:00:31.337317 24780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c53fc4008faf445fa05e436b9c8e0282. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 02:00:31.392913 6884 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:31.395905 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:31.403213 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:31.409240 24780 tablet_copy_client.cc:806] T c53fc4008faf445fa05e436b9c8e0282 P dc85be7d460a404f997177f57680850f: tablet copy: Starting download of 0 data blocks...
I20260810 02:00:31.409615 24780 tablet_copy_client.cc:670] T c53fc4008faf445fa05e436b9c8e0282 P dc85be7d460a404f997177f57680850f: tablet copy: Starting download of 1 WAL segments...
I20260810 02:00:31.412848 24780 tablet_copy_client.cc:538] T c53fc4008faf445fa05e436b9c8e0282 P dc85be7d460a404f997177f57680850f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 02:00:31.420544 24780 tablet_bootstrap.cc:492] T c53fc4008faf445fa05e436b9c8e0282 P dc85be7d460a404f997177f57680850f: Bootstrap starting.
I20260810 02:00:31.478288 3917 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:31.546680 6369 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:31.551798 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:31.583117 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:31.590904 3735 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 02:00:31.625058 3759 consensus_queue.cc:237] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 02:00:31.710016 6734 raft_consensus.cc:1275] T abf302f27a12414a8647dab82ab8101f P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260810 02:00:31.711285 24765 consensus_queue.cc:1048] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 02:00:31.749266 4131 raft_consensus.cc:1275] T abf302f27a12414a8647dab82ab8101f P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
W20260810 02:00:31.750821 3670 consensus_peers.cc:597] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f -> Peer 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995): Couldn't send request to peer 3136daf7101445beadc1aa19bc01c227. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: abf302f27a12414a8647dab82ab8101f. This is attempt 1: this message will repeat every 5th retry.
I20260810 02:00:31.751242 24765 consensus_queue.cc:1048] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260810 02:00:31.773730 3855 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.200:32995, user_credentials={real_user=slave}} blocked reactor thread for 58376.9us
I20260810 02:00:31.774443 24301 raft_consensus.cc:2955] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:31.782354 4131 raft_consensus.cc:2955] T abf302f27a12414a8647dab82ab8101f P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:31.788352 3568 catalog_manager.cc:5719] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f reported cstate change: config changed from index 7 to 8, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:31.800623 6734 raft_consensus.cc:2955] T abf302f27a12414a8647dab82ab8101f P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 3136daf7101445beadc1aa19bc01c227 (127.21.64.200) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:31.889896 24780 tablet_bootstrap.cc:492] T c53fc4008faf445fa05e436b9c8e0282 P dc85be7d460a404f997177f57680850f: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 02:00:31.893766 24780 tablet_bootstrap.cc:492] T c53fc4008faf445fa05e436b9c8e0282 P dc85be7d460a404f997177f57680850f: Bootstrap complete.
I20260810 02:00:31.894222 24780 ts_tablet_manager.cc:1403] T c53fc4008faf445fa05e436b9c8e0282 P dc85be7d460a404f997177f57680850f: Time spent bootstrapping tablet: real 0.474s user 0.108s sys 0.057s
I20260810 02:00:31.904062 24780 raft_consensus.cc:359] T c53fc4008faf445fa05e436b9c8e0282 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 02:00:31.913533 24780 raft_consensus.cc:740] T c53fc4008faf445fa05e436b9c8e0282 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc85be7d460a404f997177f57680850f, State: Initialized, Role: FOLLOWER
I20260810 02:00:31.914463 24780 consensus_queue.cc:260] T c53fc4008faf445fa05e436b9c8e0282 P dc85be7d460a404f997177f57680850f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 02:00:31.919216 24780 ts_tablet_manager.cc:1434] T c53fc4008faf445fa05e436b9c8e0282 P dc85be7d460a404f997177f57680850f: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
I20260810 02:00:31.921620 4162 tablet_copy_service.cc:342] P 17b49c694faf479ea2e5083470fc0302: Request end of tablet copy session dc85be7d460a404f997177f57680850f-c53fc4008faf445fa05e436b9c8e0282 received from {username='slave'} at 127.21.64.193:57583
I20260810 02:00:31.921759 4162 tablet_copy_service.cc:434] P 17b49c694faf479ea2e5083470fc0302: ending tablet copy session dc85be7d460a404f997177f57680850f-c53fc4008faf445fa05e436b9c8e0282 on tablet c53fc4008faf445fa05e436b9c8e0282 with peer dc85be7d460a404f997177f57680850f
W20260810 02:00:31.927145 4036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.197:38787, user_credentials={real_user=slave}} blocked reactor thread for 75225.8us
I20260810 02:00:31.928113 3759 raft_consensus.cc:1217] T c53fc4008faf445fa05e436b9c8e0282 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20260810 02:00:32.010715 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:32.017805 6884 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:32.033084 6369 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:32.055035 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:32.067132 3917 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:32.099997 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:32.140026 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:32.164633 3735 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 02:00:32.275667 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:32.277522 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:32.290402 6884 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:32.328519 6369 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:32.329869 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:32.336783 3943 consensus_queue.cc:237] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 1.13, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 02:00:32.354682 24968 ts_tablet_manager.cc:933] T abf302f27a12414a8647dab82ab8101f P 3136daf7101445beadc1aa19bc01c227: Initiating tablet copy from peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
W20260810 02:00:32.367609 3857 consensus_peers.cc:597] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 -> Peer 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317): Couldn't send request to peer 22ce0e487f0341fd9bf853393d6e7683. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 02:00:32.368491 6397 raft_consensus.cc:1275] T 4a4350cf2ece4769b8547620ac5bedcb P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 13. Preceding OpId from leader: term: 1 index: 14. (index mismatch)
I20260810 02:00:32.369418 24363 consensus_queue.cc:1048] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260810 02:00:32.370574 6735 raft_consensus.cc:1275] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 13. Preceding OpId from leader: term: 1 index: 14. (index mismatch)
I20260810 02:00:32.372123 24363 consensus_queue.cc:1048] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260810 02:00:32.381078 4220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.195:39189, user_credentials={real_user=slave}} blocked reactor thread for 77275.1us
I20260810 02:00:32.391711 3917 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:32.408358 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:32.418359 24979 raft_consensus.cc:2955] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.14: config changed from index 13 to 14, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:32.419883 6734 raft_consensus.cc:2955] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.14: config changed from index 13 to 14, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:32.428187 3574 catalog_manager.cc:5719] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4 reported cstate change: config changed from index 13 to 14, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:32.446508 24968 tablet_copy_client.cc:323] T abf302f27a12414a8647dab82ab8101f P 3136daf7101445beadc1aa19bc01c227: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.193:36797
I20260810 02:00:32.447275 3787 tablet_copy_service.cc:140] P dc85be7d460a404f997177f57680850f: Received BeginTabletCopySession request for tablet abf302f27a12414a8647dab82ab8101f from peer 3136daf7101445beadc1aa19bc01c227 ({username='slave'} at 127.21.64.200:47703)
I20260810 02:00:32.447468 3787 tablet_copy_service.cc:161] P dc85be7d460a404f997177f57680850f: Beginning new tablet copy session on tablet abf302f27a12414a8647dab82ab8101f from peer 3136daf7101445beadc1aa19bc01c227 at {username='slave'} at 127.21.64.200:47703: session id = 3136daf7101445beadc1aa19bc01c227-abf302f27a12414a8647dab82ab8101f
I20260810 02:00:32.450668 3787 tablet_copy_source_session.cc:215] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 02:00:32.452205 24968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abf302f27a12414a8647dab82ab8101f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 02:00:32.458249 3735 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 02:00:32.479686 6397 raft_consensus.cc:2955] T 4a4350cf2ece4769b8547620ac5bedcb P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Committing config change with OpId 1.14: config changed from index 13 to 14, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:32.526235 24968 tablet_copy_client.cc:806] T abf302f27a12414a8647dab82ab8101f P 3136daf7101445beadc1aa19bc01c227: tablet copy: Starting download of 0 data blocks...
I20260810 02:00:32.526641 24968 tablet_copy_client.cc:670] T abf302f27a12414a8647dab82ab8101f P 3136daf7101445beadc1aa19bc01c227: tablet copy: Starting download of 1 WAL segments...
I20260810 02:00:32.535856 24968 tablet_copy_client.cc:538] T abf302f27a12414a8647dab82ab8101f P 3136daf7101445beadc1aa19bc01c227: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 02:00:32.540701 24968 tablet_bootstrap.cc:492] T abf302f27a12414a8647dab82ab8101f P 3136daf7101445beadc1aa19bc01c227: Bootstrap starting.
I20260810 02:00:32.731724 24968 tablet_bootstrap.cc:492] T abf302f27a12414a8647dab82ab8101f P 3136daf7101445beadc1aa19bc01c227: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 02:00:32.734901 24968 tablet_bootstrap.cc:492] T abf302f27a12414a8647dab82ab8101f P 3136daf7101445beadc1aa19bc01c227: Bootstrap complete.
I20260810 02:00:32.736292 24968 ts_tablet_manager.cc:1403] T abf302f27a12414a8647dab82ab8101f P 3136daf7101445beadc1aa19bc01c227: Time spent bootstrapping tablet: real 0.196s user 0.042s sys 0.009s
I20260810 02:00:32.737062 24968 raft_consensus.cc:359] T abf302f27a12414a8647dab82ab8101f P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 02:00:32.737293 24968 raft_consensus.cc:740] T abf302f27a12414a8647dab82ab8101f P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3136daf7101445beadc1aa19bc01c227, State: Initialized, Role: FOLLOWER
I20260810 02:00:32.739056 24968 consensus_queue.cc:260] T abf302f27a12414a8647dab82ab8101f P 3136daf7101445beadc1aa19bc01c227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 02:00:32.740147 24968 ts_tablet_manager.cc:1434] T abf302f27a12414a8647dab82ab8101f P 3136daf7101445beadc1aa19bc01c227: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260810 02:00:32.742895 3787 tablet_copy_service.cc:342] P dc85be7d460a404f997177f57680850f: Request end of tablet copy session 3136daf7101445beadc1aa19bc01c227-abf302f27a12414a8647dab82ab8101f received from {username='slave'} at 127.21.64.200:47703
I20260810 02:00:32.743037 3787 tablet_copy_service.cc:434] P dc85be7d460a404f997177f57680850f: ending tablet copy session 3136daf7101445beadc1aa19bc01c227-abf302f27a12414a8647dab82ab8101f on tablet abf302f27a12414a8647dab82ab8101f with peer 3136daf7101445beadc1aa19bc01c227
W20260810 02:00:32.832260 3673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.199:41689, user_credentials={real_user=slave}} blocked reactor thread for 54492.6us
I20260810 02:00:32.870751 6908 raft_consensus.cc:1217] T abf302f27a12414a8647dab82ab8101f P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20260810 02:00:32.880522 6908 consensus_queue.cc:237] T 3a15b27dbdaf4092aea66c3670204fcc P 3136daf7101445beadc1aa19bc01c227 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 2.9, Last appended by leader: 8, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 02:00:32.890370 3943 consensus_queue.cc:237] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
W20260810 02:00:32.922363 3857 consensus_peers.cc:597] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 -> Peer 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317): Couldn't send request to peer 22ce0e487f0341fd9bf853393d6e7683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8e8d13caf8054b1daf09b2b114843766. This is attempt 1: this message will repeat every 5th retry.
I20260810 02:00:32.923928 6397 raft_consensus.cc:1275] T 8e8d13caf8054b1daf09b2b114843766 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260810 02:00:32.924944 24979 consensus_queue.cc:1048] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 02:00:32.932176 6907 raft_consensus.cc:1275] T 8e8d13caf8054b1daf09b2b114843766 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260810 02:00:32.932865 24979 consensus_queue.cc:1048] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 02:00:33.024466 25064 ts_tablet_manager.cc:933] T 4a4350cf2ece4769b8547620ac5bedcb P 22ce0e487f0341fd9bf853393d6e7683: Initiating tablet copy from peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 02:00:33.030121 24979 raft_consensus.cc:2955] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:33.039476 6397 raft_consensus.cc:2955] T 8e8d13caf8054b1daf09b2b114843766 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:33.041652 3568 catalog_manager.cc:5719] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 reported cstate change: config changed from index 7 to 8, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:33.047183 6907 raft_consensus.cc:2955] T 8e8d13caf8054b1daf09b2b114843766 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:33.058501 6394 raft_consensus.cc:1275] T 3a15b27dbdaf4092aea66c3670204fcc P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 FOLLOWER]: Refusing update from remote peer 3136daf7101445beadc1aa19bc01c227: Log matching property violated. Preceding OpId in replica: term: 2 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20260810 02:00:33.059273 24772 consensus_queue.cc:1048] T 3a15b27dbdaf4092aea66c3670204fcc P 3136daf7101445beadc1aa19bc01c227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260810 02:00:33.067759 6567 raft_consensus.cc:1275] T 3a15b27dbdaf4092aea66c3670204fcc P 22ce0e487f0341fd9bf853393d6e7683 [term 2 FOLLOWER]: Refusing update from remote peer 3136daf7101445beadc1aa19bc01c227: Log matching property violated. Preceding OpId in replica: term: 2 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20260810 02:00:33.068356 24772 consensus_queue.cc:1048] T 3a15b27dbdaf4092aea66c3670204fcc P 3136daf7101445beadc1aa19bc01c227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260810 02:00:33.082444 25077 raft_consensus.cc:2955] T 3a15b27dbdaf4092aea66c3670204fcc P 3136daf7101445beadc1aa19bc01c227 [term 2 LEADER]: Committing config change with OpId 2.10: config changed from index 8 to 10, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:33.083091 6563 raft_consensus.cc:2955] T 3a15b27dbdaf4092aea66c3670204fcc P 22ce0e487f0341fd9bf853393d6e7683 [term 2 FOLLOWER]: Committing config change with OpId 2.10: config changed from index 8 to 10, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:33.097213 25064 tablet_copy_client.cc:323] T 4a4350cf2ece4769b8547620ac5bedcb P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.194:43893
I20260810 02:00:33.098153 6394 raft_consensus.cc:2955] T 3a15b27dbdaf4092aea66c3670204fcc P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 FOLLOWER]: Committing config change with OpId 2.10: config changed from index 8 to 10, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:33.117995 3973 tablet_copy_service.cc:140] P 82f93d1d11364ceeb485585b4ae78871: Received BeginTabletCopySession request for tablet 4a4350cf2ece4769b8547620ac5bedcb from peer 22ce0e487f0341fd9bf853393d6e7683 ({username='slave'} at 127.21.64.198:54627)
I20260810 02:00:33.118212 3973 tablet_copy_service.cc:161] P 82f93d1d11364ceeb485585b4ae78871: Beginning new tablet copy session on tablet 4a4350cf2ece4769b8547620ac5bedcb from peer 22ce0e487f0341fd9bf853393d6e7683 at {username='slave'} at 127.21.64.198:54627: session id = 22ce0e487f0341fd9bf853393d6e7683-4a4350cf2ece4769b8547620ac5bedcb
I20260810 02:00:33.122455 3563 catalog_manager.cc:5719] T 3a15b27dbdaf4092aea66c3670204fcc P 22ce0e487f0341fd9bf853393d6e7683 reported cstate change: config changed from index 8 to 10, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) evicted. New cstate: current_term: 2 leader_uuid: "3136daf7101445beadc1aa19bc01c227" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:33.123051 3973 tablet_copy_source_session.cc:215] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 02:00:33.126362 25064 ts_tablet_manager.cc:1916] T 4a4350cf2ece4769b8547620ac5bedcb P 22ce0e487f0341fd9bf853393d6e7683: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260810 02:00:33.193922 3735 tablet_service.cc:1558] Processing DeleteTablet for tablet 3a15b27dbdaf4092aea66c3670204fcc with delete_type TABLET_DATA_TOMBSTONED (TS dc85be7d460a404f997177f57680850f not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:33870
I20260810 02:00:33.209653 25098 tablet_replica.cc:333] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f: stopping tablet replica
I20260810 02:00:33.220067 25098 raft_consensus.cc:2243] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:33.221038 25098 raft_consensus.cc:2272] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:33.222366 25098 ts_tablet_manager.cc:1916] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 02:00:33.224496 25064 ts_tablet_manager.cc:1929] T 4a4350cf2ece4769b8547620ac5bedcb P 22ce0e487f0341fd9bf853393d6e7683: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.12
I20260810 02:00:33.224764 25064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a4350cf2ece4769b8547620ac5bedcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 02:00:33.233349 25098 ts_tablet_manager.cc:1929] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.9
I20260810 02:00:33.233603 25098 log.cc:1199] T 3a15b27dbdaf4092aea66c3670204fcc P dc85be7d460a404f997177f57680850f: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/wal/wals/3a15b27dbdaf4092aea66c3670204fcc
I20260810 02:00:33.235082 3551 catalog_manager.cc:5050] TS dc85be7d460a404f997177f57680850f (127.21.64.193:36797): tablet 3a15b27dbdaf4092aea66c3670204fcc (table rebalance_test_table_1 [id=945a223441a04ba2bf938b104bc91cf8]) successfully deleted
I20260810 02:00:33.267861 25064 tablet_copy_client.cc:806] T 4a4350cf2ece4769b8547620ac5bedcb P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Starting download of 0 data blocks...
I20260810 02:00:33.268254 25064 tablet_copy_client.cc:670] T 4a4350cf2ece4769b8547620ac5bedcb P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Starting download of 1 WAL segments...
I20260810 02:00:33.274294 25064 tablet_copy_client.cc:538] T 4a4350cf2ece4769b8547620ac5bedcb P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 02:00:33.278307 25064 tablet_bootstrap.cc:492] T 4a4350cf2ece4769b8547620ac5bedcb P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap starting.
I20260810 02:00:33.322050 25125 ts_tablet_manager.cc:933] T 8e8d13caf8054b1daf09b2b114843766 P 22ce0e487f0341fd9bf853393d6e7683: Initiating tablet copy from peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 02:00:33.324615 25125 tablet_copy_client.cc:323] T 8e8d13caf8054b1daf09b2b114843766 P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.194:43893
I20260810 02:00:33.325618 3973 tablet_copy_service.cc:140] P 82f93d1d11364ceeb485585b4ae78871: Received BeginTabletCopySession request for tablet 8e8d13caf8054b1daf09b2b114843766 from peer 22ce0e487f0341fd9bf853393d6e7683 ({username='slave'} at 127.21.64.198:54627)
I20260810 02:00:33.325794 3973 tablet_copy_service.cc:161] P 82f93d1d11364ceeb485585b4ae78871: Beginning new tablet copy session on tablet 8e8d13caf8054b1daf09b2b114843766 from peer 22ce0e487f0341fd9bf853393d6e7683 at {username='slave'} at 127.21.64.198:54627: session id = 22ce0e487f0341fd9bf853393d6e7683-8e8d13caf8054b1daf09b2b114843766
I20260810 02:00:33.329010 3973 tablet_copy_source_session.cc:215] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 02:00:33.333282 25125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e8d13caf8054b1daf09b2b114843766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 02:00:33.354267 25125 tablet_copy_client.cc:806] T 8e8d13caf8054b1daf09b2b114843766 P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Starting download of 0 data blocks...
I20260810 02:00:33.355149 25125 tablet_copy_client.cc:670] T 8e8d13caf8054b1daf09b2b114843766 P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Starting download of 1 WAL segments...
I20260810 02:00:33.358309 25125 tablet_copy_client.cc:538] T 8e8d13caf8054b1daf09b2b114843766 P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 02:00:33.367097 25125 tablet_bootstrap.cc:492] T 8e8d13caf8054b1daf09b2b114843766 P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap starting.
I20260810 02:00:33.504491 25064 tablet_bootstrap.cc:492] T 4a4350cf2ece4769b8547620ac5bedcb P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 02:00:33.505155 25064 tablet_bootstrap.cc:492] T 4a4350cf2ece4769b8547620ac5bedcb P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap complete.
I20260810 02:00:33.509917 25064 ts_tablet_manager.cc:1403] T 4a4350cf2ece4769b8547620ac5bedcb P 22ce0e487f0341fd9bf853393d6e7683: Time spent bootstrapping tablet: real 0.232s user 0.058s sys 0.003s
I20260810 02:00:33.514010 25064 raft_consensus.cc:359] T 4a4350cf2ece4769b8547620ac5bedcb P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 02:00:33.530328 25064 raft_consensus.cc:740] T 4a4350cf2ece4769b8547620ac5bedcb P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ce0e487f0341fd9bf853393d6e7683, State: Initialized, Role: FOLLOWER
I20260810 02:00:33.530807 25064 consensus_queue.cc:260] T 4a4350cf2ece4769b8547620ac5bedcb P 22ce0e487f0341fd9bf853393d6e7683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 1.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 02:00:33.531708 25064 ts_tablet_manager.cc:1434] T 4a4350cf2ece4769b8547620ac5bedcb P 22ce0e487f0341fd9bf853393d6e7683: Time spent starting tablet: real 0.022s user 0.000s sys 0.002s
I20260810 02:00:33.532593 3973 tablet_copy_service.cc:342] P 82f93d1d11364ceeb485585b4ae78871: Request end of tablet copy session 22ce0e487f0341fd9bf853393d6e7683-4a4350cf2ece4769b8547620ac5bedcb received from {username='slave'} at 127.21.64.198:54627
I20260810 02:00:33.532771 3973 tablet_copy_service.cc:434] P 82f93d1d11364ceeb485585b4ae78871: ending tablet copy session 22ce0e487f0341fd9bf853393d6e7683-4a4350cf2ece4769b8547620ac5bedcb on tablet 4a4350cf2ece4769b8547620ac5bedcb with peer 22ce0e487f0341fd9bf853393d6e7683
I20260810 02:00:33.546255 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:33.558117 25125 tablet_bootstrap.cc:492] T 8e8d13caf8054b1daf09b2b114843766 P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 02:00:33.567807 25125 tablet_bootstrap.cc:492] T 8e8d13caf8054b1daf09b2b114843766 P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap complete.
I20260810 02:00:33.571276 25125 ts_tablet_manager.cc:1403] T 8e8d13caf8054b1daf09b2b114843766 P 22ce0e487f0341fd9bf853393d6e7683: Time spent bootstrapping tablet: real 0.204s user 0.060s sys 0.000s
I20260810 02:00:33.577206 25125 raft_consensus.cc:359] T 8e8d13caf8054b1daf09b2b114843766 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 02:00:33.577838 25125 raft_consensus.cc:740] T 8e8d13caf8054b1daf09b2b114843766 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ce0e487f0341fd9bf853393d6e7683, State: Initialized, Role: FOLLOWER
I20260810 02:00:33.579279 25125 consensus_queue.cc:260] T 8e8d13caf8054b1daf09b2b114843766 P 22ce0e487f0341fd9bf853393d6e7683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 02:00:33.579614 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:33.580240 25125 ts_tablet_manager.cc:1434] T 8e8d13caf8054b1daf09b2b114843766 P 22ce0e487f0341fd9bf853393d6e7683: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20260810 02:00:33.581132 3973 tablet_copy_service.cc:342] P 82f93d1d11364ceeb485585b4ae78871: Request end of tablet copy session 22ce0e487f0341fd9bf853393d6e7683-8e8d13caf8054b1daf09b2b114843766 received from {username='slave'} at 127.21.64.198:54627
I20260810 02:00:33.581284 3973 tablet_copy_service.cc:434] P 82f93d1d11364ceeb485585b4ae78871: ending tablet copy session 22ce0e487f0341fd9bf853393d6e7683-8e8d13caf8054b1daf09b2b114843766 on tablet 8e8d13caf8054b1daf09b2b114843766 with peer 22ce0e487f0341fd9bf853393d6e7683
I20260810 02:00:33.590914 4131 consensus_queue.cc:237] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 02:00:33.603026 6369 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:33.632781 6397 raft_consensus.cc:1275] T 4fc45932b9634d6d98d8a0204d4b121a P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260810 02:00:33.635274 4311 raft_consensus.cc:1275] T 4fc45932b9634d6d98d8a0204d4b121a P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260810 02:00:33.636238 24882 consensus_queue.cc:1048] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260810 02:00:33.637573 4038 consensus_peers.cc:597] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 -> Peer 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317): Couldn't send request to peer 22ce0e487f0341fd9bf853393d6e7683. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 02:00:33.651775 24882 consensus_queue.cc:1048] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260810 02:00:33.668789 3917 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:33.677907 6884 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:33.683344 25227 raft_consensus.cc:2955] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:33.702412 6397 raft_consensus.cc:2955] T 4fc45932b9634d6d98d8a0204d4b121a P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:33.720206 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:33.723742 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:33.730979 4311 raft_consensus.cc:2955] T 4fc45932b9634d6d98d8a0204d4b121a P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:33.734628 3573 catalog_manager.cc:5719] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 reported cstate change: config changed from index 9 to 10, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New cstate: current_term: 1 leader_uuid: "17b49c694faf479ea2e5083470fc0302" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:33.817528 3735 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 02:00:33.854816 6563 raft_consensus.cc:1217] T 8e8d13caf8054b1daf09b2b114843766 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
W20260810 02:00:33.862329 6311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.198:45317, user_credentials={real_user=slave}} blocked reactor thread for 125280us
I20260810 02:00:33.972368 6563 raft_consensus.cc:1217] T 4a4350cf2ece4769b8547620ac5bedcb P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.13->[1.14-1.14] Dedup: 1.14->[]
I20260810 02:00:34.026643 25125 ts_tablet_manager.cc:933] T 4fc45932b9634d6d98d8a0204d4b121a P 22ce0e487f0341fd9bf853393d6e7683: Initiating tablet copy from peer 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189)
I20260810 02:00:34.080370 25125 tablet_copy_client.cc:323] T 4fc45932b9634d6d98d8a0204d4b121a P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.195:39189
I20260810 02:00:34.150094 4162 tablet_copy_service.cc:140] P 17b49c694faf479ea2e5083470fc0302: Received BeginTabletCopySession request for tablet 4fc45932b9634d6d98d8a0204d4b121a from peer 22ce0e487f0341fd9bf853393d6e7683 ({username='slave'} at 127.21.64.198:45369)
I20260810 02:00:34.150345 4162 tablet_copy_service.cc:161] P 17b49c694faf479ea2e5083470fc0302: Beginning new tablet copy session on tablet 4fc45932b9634d6d98d8a0204d4b121a from peer 22ce0e487f0341fd9bf853393d6e7683 at {username='slave'} at 127.21.64.198:45369: session id = 22ce0e487f0341fd9bf853393d6e7683-4fc45932b9634d6d98d8a0204d4b121a
I20260810 02:00:34.155833 4162 tablet_copy_source_session.cc:215] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 02:00:34.157225 25125 ts_tablet_manager.cc:1916] T 4fc45932b9634d6d98d8a0204d4b121a P 22ce0e487f0341fd9bf853393d6e7683: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260810 02:00:34.233748 25125 ts_tablet_manager.cc:1929] T 4fc45932b9634d6d98d8a0204d4b121a P 22ce0e487f0341fd9bf853393d6e7683: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.8
I20260810 02:00:34.234160 25125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fc45932b9634d6d98d8a0204d4b121a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 02:00:34.263362 25125 tablet_copy_client.cc:806] T 4fc45932b9634d6d98d8a0204d4b121a P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Starting download of 0 data blocks...
I20260810 02:00:34.263799 25125 tablet_copy_client.cc:670] T 4fc45932b9634d6d98d8a0204d4b121a P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Starting download of 1 WAL segments...
I20260810 02:00:34.281616 25125 tablet_copy_client.cc:538] T 4fc45932b9634d6d98d8a0204d4b121a P 22ce0e487f0341fd9bf853393d6e7683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 02:00:34.295356 25125 tablet_bootstrap.cc:492] T 4fc45932b9634d6d98d8a0204d4b121a P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap starting.
I20260810 02:00:34.306345 6884 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:34.307519 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:34.368182 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:34.372107 6369 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:34.449056 3917 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:34.500131 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:34.500475 3735 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 02:00:34.528883 25125 tablet_bootstrap.cc:492] T 4fc45932b9634d6d98d8a0204d4b121a P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 02:00:34.529554 25125 tablet_bootstrap.cc:492] T 4fc45932b9634d6d98d8a0204d4b121a P 22ce0e487f0341fd9bf853393d6e7683: Bootstrap complete.
I20260810 02:00:34.529867 25125 ts_tablet_manager.cc:1403] T 4fc45932b9634d6d98d8a0204d4b121a P 22ce0e487f0341fd9bf853393d6e7683: Time spent bootstrapping tablet: real 0.237s user 0.066s sys 0.007s
I20260810 02:00:34.530786 25125 raft_consensus.cc:359] T 4fc45932b9634d6d98d8a0204d4b121a P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 02:00:34.531019 25125 raft_consensus.cc:740] T 4fc45932b9634d6d98d8a0204d4b121a P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ce0e487f0341fd9bf853393d6e7683, State: Initialized, Role: FOLLOWER
I20260810 02:00:34.534907 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:34.544201 25125 consensus_queue.cc:260] T 4fc45932b9634d6d98d8a0204d4b121a P 22ce0e487f0341fd9bf853393d6e7683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 1.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 02:00:34.544915 25125 ts_tablet_manager.cc:1434] T 4fc45932b9634d6d98d8a0204d4b121a P 22ce0e487f0341fd9bf853393d6e7683: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20260810 02:00:34.545857 4162 tablet_copy_service.cc:342] P 17b49c694faf479ea2e5083470fc0302: Request end of tablet copy session 22ce0e487f0341fd9bf853393d6e7683-4fc45932b9634d6d98d8a0204d4b121a received from {username='slave'} at 127.21.64.198:45369
I20260810 02:00:34.546026 4162 tablet_copy_service.cc:434] P 17b49c694faf479ea2e5083470fc0302: ending tablet copy session 22ce0e487f0341fd9bf853393d6e7683-4fc45932b9634d6d98d8a0204d4b121a on tablet 4fc45932b9634d6d98d8a0204d4b121a with peer 22ce0e487f0341fd9bf853393d6e7683
I20260810 02:00:34.569096 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:34.606037 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:34.629760 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:34.658591 6369 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:34.691048 6884 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:34.691144 3735 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 02:00:34.692731 3917 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:34.709758 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:34.716480 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:34.757619 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:34.785405 6884 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:34.811264 3917 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
W20260810 02:00:34.821276 3855 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.197:38787, user_credentials={real_user=slave}} blocked reactor thread for 45477.4us
I20260810 02:00:34.822700 6563 raft_consensus.cc:1217] T 4fc45932b9634d6d98d8a0204d4b121a P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.9->[1.10-1.10] Dedup: 1.10->[]
I20260810 02:00:34.853323 6369 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:34.884529 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:34.909916 3735 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 02:00:34.966367 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:35.112628 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:35.115043 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:35.155524 6884 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:35.203431 3917 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:35.213479 6369 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:35.280139 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:35.281914 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:35.313611 3735 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
W20260810 02:00:35.644927 4036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.193:36797, user_credentials={real_user=slave}} blocked reactor thread for 45463.3us
I20260810 02:00:35.652398 4313 consensus_queue.cc:237] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 02:00:35.659847 6563 raft_consensus.cc:1275] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260810 02:00:35.660692 23881 consensus_queue.cc:1048] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 02:00:35.663703 4131 raft_consensus.cc:1275] T 5528e3ba51a640eaa614f141440bb90b P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260810 02:00:35.664429 25527 consensus_queue.cc:1048] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 02:00:35.672048 25527 raft_consensus.cc:2955] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:35.677270 4131 raft_consensus.cc:2955] T 5528e3ba51a640eaa614f141440bb90b P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:35.680204 6563 raft_consensus.cc:2955] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:35.687155 3558 catalog_manager.cc:5719] T 5528e3ba51a640eaa614f141440bb90b P 17b49c694faf479ea2e5083470fc0302 reported cstate change: config changed from index 8 to 9, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:35.719667 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:35.734719 3917 tablet_service.cc:1558] Processing DeleteTablet for tablet 5528e3ba51a640eaa614f141440bb90b with delete_type TABLET_DATA_TOMBSTONED (TS 82f93d1d11364ceeb485585b4ae78871 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:51288
I20260810 02:00:35.749451 25579 tablet_replica.cc:333] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871: stopping tablet replica
I20260810 02:00:35.749871 25579 raft_consensus.cc:2243] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:35.750236 25579 raft_consensus.cc:2272] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:35.751223 25579 ts_tablet_manager.cc:1916] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 02:00:35.759968 25579 ts_tablet_manager.cc:1929] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20260810 02:00:35.760210 25579 log.cc:1199] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal/wals/5528e3ba51a640eaa614f141440bb90b
I20260810 02:00:35.761416 3553 catalog_manager.cc:5050] TS 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): tablet 5528e3ba51a640eaa614f141440bb90b (table rebalance_test_table_9 [id=372310cb713644ada1071e8eb628b0c9]) successfully deleted
I20260810 02:00:35.767400 3943 consensus_queue.cc:237] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 1.14, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 02:00:35.776643 6563 raft_consensus.cc:1275] T 4a4350cf2ece4769b8547620ac5bedcb P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 14. Preceding OpId from leader: term: 1 index: 15. (index mismatch)
I20260810 02:00:35.777390 25401 consensus_queue.cc:1048] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260810 02:00:35.782738 6734 raft_consensus.cc:1275] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 14. Preceding OpId from leader: term: 1 index: 15. (index mismatch)
I20260810 02:00:35.789206 25401 consensus_queue.cc:1048] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260810 02:00:35.798668 25401 raft_consensus.cc:2955] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.15: config changed from index 14 to 15, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:35.800587 6567 raft_consensus.cc:2955] T 4a4350cf2ece4769b8547620ac5bedcb P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.15: config changed from index 14 to 15, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:35.810719 3572 catalog_manager.cc:5719] T 4a4350cf2ece4769b8547620ac5bedcb P 22ce0e487f0341fd9bf853393d6e7683 reported cstate change: config changed from index 14 to 15, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) evicted. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:35.816207 6369 tablet_service.cc:1558] Processing DeleteTablet for tablet 4a4350cf2ece4769b8547620ac5bedcb with delete_type TABLET_DATA_TOMBSTONED (TS 4dd4cba155c941b4b7ad4d64c7431536 not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:60156
I20260810 02:00:35.830629 6368 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:35.837229 3917 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:35.842334 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:35.859253 25596 tablet_replica.cc:333] T 4a4350cf2ece4769b8547620ac5bedcb P 4dd4cba155c941b4b7ad4d64c7431536: stopping tablet replica
I20260810 02:00:35.859681 25596 raft_consensus.cc:2243] T 4a4350cf2ece4769b8547620ac5bedcb P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:35.860047 25596 raft_consensus.cc:2272] T 4a4350cf2ece4769b8547620ac5bedcb P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:35.861233 25596 ts_tablet_manager.cc:1916] T 4a4350cf2ece4769b8547620ac5bedcb P 4dd4cba155c941b4b7ad4d64c7431536: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 02:00:35.874508 6884 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:35.884382 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:35.914827 3735 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 02:00:35.935938 6735 raft_consensus.cc:2955] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.15: config changed from index 14 to 15, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:35.938445 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:36.038075 25596 ts_tablet_manager.cc:1929] T 4a4350cf2ece4769b8547620ac5bedcb P 4dd4cba155c941b4b7ad4d64c7431536: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.14
I20260810 02:00:36.039848 25596 log.cc:1199] T 4a4350cf2ece4769b8547620ac5bedcb P 4dd4cba155c941b4b7ad4d64c7431536: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/wal/wals/4a4350cf2ece4769b8547620ac5bedcb
I20260810 02:00:36.041260 3551 catalog_manager.cc:5050] TS 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197:38787): tablet 4a4350cf2ece4769b8547620ac5bedcb (table rebalance_test_table_8 [id=afa71147917d44a585bcbaa37497a2b1]) successfully deleted
I20260810 02:00:36.074954 4131 consensus_queue.cc:237] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 02:00:36.098120 6563 raft_consensus.cc:1275] T 4fc45932b9634d6d98d8a0204d4b121a P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260810 02:00:36.099318 25519 consensus_queue.cc:1048] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260810 02:00:36.109550 4313 raft_consensus.cc:1275] T 4fc45932b9634d6d98d8a0204d4b121a P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260810 02:00:36.110248 25519 consensus_queue.cc:1048] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260810 02:00:36.124359 25519 raft_consensus.cc:2955] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:36.126956 6567 raft_consensus.cc:2955] T 4fc45932b9634d6d98d8a0204d4b121a P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:36.137554 3572 catalog_manager.cc:5719] T 4fc45932b9634d6d98d8a0204d4b121a P 22ce0e487f0341fd9bf853393d6e7683 reported cstate change: config changed from index 10 to 11, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) evicted. New cstate: current_term: 1 leader_uuid: "17b49c694faf479ea2e5083470fc0302" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:36.143792 6369 tablet_service.cc:1558] Processing DeleteTablet for tablet 4fc45932b9634d6d98d8a0204d4b121a with delete_type TABLET_DATA_TOMBSTONED (TS 4dd4cba155c941b4b7ad4d64c7431536 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:60156
I20260810 02:00:36.144137 25596 tablet_replica.cc:333] T 4fc45932b9634d6d98d8a0204d4b121a P 4dd4cba155c941b4b7ad4d64c7431536: stopping tablet replica
I20260810 02:00:36.144331 25596 raft_consensus.cc:2243] T 4fc45932b9634d6d98d8a0204d4b121a P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:36.144513 25596 raft_consensus.cc:2272] T 4fc45932b9634d6d98d8a0204d4b121a P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:36.145263 25596 ts_tablet_manager.cc:1916] T 4fc45932b9634d6d98d8a0204d4b121a P 4dd4cba155c941b4b7ad4d64c7431536: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 02:00:36.155333 25596 ts_tablet_manager.cc:1929] T 4fc45932b9634d6d98d8a0204d4b121a P 4dd4cba155c941b4b7ad4d64c7431536: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.10
I20260810 02:00:36.155537 25596 log.cc:1199] T 4fc45932b9634d6d98d8a0204d4b121a P 4dd4cba155c941b4b7ad4d64c7431536: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/wal/wals/4fc45932b9634d6d98d8a0204d4b121a
I20260810 02:00:36.156442 3551 catalog_manager.cc:5050] TS 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197:38787): tablet 4fc45932b9634d6d98d8a0204d4b121a (table rebalance_test_table_8 [id=afa71147917d44a585bcbaa37497a2b1]) successfully deleted
I20260810 02:00:36.178154 4313 raft_consensus.cc:2955] T 4fc45932b9634d6d98d8a0204d4b121a P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:36.702947 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:36.757509 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:36.770885 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:36.786075 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:36.821915 6369 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:36.832669 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:36.866550 6884 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:36.874677 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:36.880895 6884 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:36.919106 6884 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:36.930979 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:36.962641 6369 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:36.964491 3917 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:36.972965 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:36.979511 6369 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:36.992260 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:37.015733 3917 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:37.033895 3735 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 02:00:37.058238 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:37.075304 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:37.078922 3735 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 02:00:37.082904 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:37.125437 3917 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:37.157588 3735 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 02:00:37.734382 3756 consensus_queue.cc:237] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 1.18, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 02:00:37.796921 6563 raft_consensus.cc:1275] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 18. Preceding OpId from leader: term: 1 index: 19. (index mismatch)
I20260810 02:00:37.797537 6907 raft_consensus.cc:1275] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 18. Preceding OpId from leader: term: 1 index: 19. (index mismatch)
I20260810 02:00:37.799276 25889 consensus_queue.cc:1048] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260810 02:00:37.802124 25889 consensus_queue.cc:1048] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260810 02:00:37.868305 3756 consensus_queue.cc:237] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 02:00:37.871220 4131 raft_consensus.cc:1275] T abf302f27a12414a8647dab82ab8101f P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260810 02:00:37.871866 25889 consensus_queue.cc:1048] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 02:00:37.889313 6907 raft_consensus.cc:1275] T abf302f27a12414a8647dab82ab8101f P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260810 02:00:37.889238 25889 raft_consensus.cc:2955] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:37.890640 4129 raft_consensus.cc:2955] T abf302f27a12414a8647dab82ab8101f P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:37.898752 3572 catalog_manager.cc:5719] T abf302f27a12414a8647dab82ab8101f P 17b49c694faf479ea2e5083470fc0302 reported cstate change: config changed from index 8 to 9, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) evicted. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:37.903005 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:37.905212 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:37.935834 6369 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
W20260810 02:00:37.946352 3670 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.200:32995, user_credentials={real_user=slave}} blocked reactor thread for 56726.3us
I20260810 02:00:37.946926 25940 raft_consensus.cc:2955] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.19: config changed from index 18 to 19, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) evicted. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:37.948698 6563 raft_consensus.cc:2955] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.19: config changed from index 18 to 19, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) evicted. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:37.952725 25760 consensus_queue.cc:1048] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 02:00:37.959965 6884 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:37.962162 6908 raft_consensus.cc:2955] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.19: config changed from index 18 to 19, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) evicted. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:37.963387 3573 catalog_manager.cc:5719] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683 reported cstate change: config changed from index 18 to 19, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) evicted. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
W20260810 02:00:37.969312 3671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.195:39189, user_credentials={real_user=slave}} blocked reactor thread for 73491.5us
I20260810 02:00:37.977303 6908 raft_consensus.cc:2955] T abf302f27a12414a8647dab82ab8101f P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:37.985683 6715 tablet_service.cc:1558] Processing DeleteTablet for tablet abf302f27a12414a8647dab82ab8101f with delete_type TABLET_DATA_TOMBSTONED (TS c5ed5317da9c464b93f979c405f0f6e4 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:58550
I20260810 02:00:38.003490 25961 tablet_replica.cc:333] T abf302f27a12414a8647dab82ab8101f P c5ed5317da9c464b93f979c405f0f6e4: stopping tablet replica
I20260810 02:00:38.003746 25961 raft_consensus.cc:2243] T abf302f27a12414a8647dab82ab8101f P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:38.004010 25961 raft_consensus.cc:2272] T abf302f27a12414a8647dab82ab8101f P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:38.005141 25961 ts_tablet_manager.cc:1916] T abf302f27a12414a8647dab82ab8101f P c5ed5317da9c464b93f979c405f0f6e4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 02:00:38.018564 25961 ts_tablet_manager.cc:1929] T abf302f27a12414a8647dab82ab8101f P c5ed5317da9c464b93f979c405f0f6e4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20260810 02:00:38.018690 25961 log.cc:1199] T abf302f27a12414a8647dab82ab8101f P c5ed5317da9c464b93f979c405f0f6e4: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/wal/wals/abf302f27a12414a8647dab82ab8101f
I20260810 02:00:38.022778 3554 catalog_manager.cc:5050] TS c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199:41689): tablet abf302f27a12414a8647dab82ab8101f (table rebalance_test_table_6 [id=5b2df46262b142169af9a32c47535432]) successfully deleted
I20260810 02:00:38.042371 6369 tablet_service.cc:1558] Processing DeleteTablet for tablet 252899385eaa45b392974d2768e3cf01 with delete_type TABLET_DATA_TOMBSTONED (TS 4dd4cba155c941b4b7ad4d64c7431536 not found in new config with opid_index 19) from {username='slave'} at 127.0.0.1:60156
I20260810 02:00:38.059643 25971 tablet_replica.cc:333] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536: stopping tablet replica
I20260810 02:00:38.060585 25971 raft_consensus.cc:2243] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:38.065658 25971 raft_consensus.cc:2272] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:38.066017 3917 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:38.066923 25971 ts_tablet_manager.cc:1916] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 02:00:38.089210 3735 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 02:00:38.099459 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:38.114996 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:38.116086 25971 ts_tablet_manager.cc:1929] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.18
I20260810 02:00:38.119166 25971 log.cc:1199] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/wal/wals/252899385eaa45b392974d2768e3cf01
I20260810 02:00:38.120144 3551 catalog_manager.cc:5050] TS 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197:38787): tablet 252899385eaa45b392974d2768e3cf01 (table rebalance_test_table_8 [id=afa71147917d44a585bcbaa37497a2b1]) successfully deleted
I20260810 02:00:38.564544 3943 consensus_queue.cc:237] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 1.15, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 02:00:38.567600 6567 raft_consensus.cc:1275] T 4a4350cf2ece4769b8547620ac5bedcb P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 15. Preceding OpId from leader: term: 1 index: 16. (index mismatch)
W20260810 02:00:38.567957 3855 consensus_peers.cc:597] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 -> Peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797): Couldn't send request to peer dc85be7d460a404f997177f57680850f. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 02:00:38.568774 25968 consensus_queue.cc:1048] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260810 02:00:38.585474 6734 raft_consensus.cc:1275] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 15. Preceding OpId from leader: term: 1 index: 16. (index mismatch)
I20260810 02:00:38.586655 26111 consensus_queue.cc:1048] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260810 02:00:38.613831 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:38.614432 25968 raft_consensus.cc:2955] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.16: config changed from index 15 to 16, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } }
I20260810 02:00:38.627918 6734 raft_consensus.cc:2955] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.16: config changed from index 15 to 16, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } }
I20260810 02:00:38.637059 3558 catalog_manager.cc:5719] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4 reported cstate change: config changed from index 15 to 16, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) added. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } }
I20260810 02:00:38.641638 6567 raft_consensus.cc:2955] T 4a4350cf2ece4769b8547620ac5bedcb P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.16: config changed from index 15 to 16, VOTER dc85be7d460a404f997177f57680850f (127.21.64.193) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } }
I20260810 02:00:38.655126 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:38.663225 6884 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:38.674948 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:38.708566 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:38.745391 6884 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:38.746883 3917 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:38.753726 6369 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:38.828315 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:38.851150 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:38.872570 6369 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:38.874341 3917 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:38.958806 3735 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 02:00:38.988004 3735 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 02:00:39.007097 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:39.016185 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:39.031057 4313 consensus_queue.cc:237] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 02:00:39.068944 26187 ts_tablet_manager.cc:933] T 4a4350cf2ece4769b8547620ac5bedcb P dc85be7d460a404f997177f57680850f: Initiating tablet copy from peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
W20260810 02:00:39.081765 4219 consensus_peers.cc:597] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e -> Peer 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197:38787): Couldn't send request to peer 4dd4cba155c941b4b7ad4d64c7431536. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8308d63e9002418b876c3d3ae0095d9f. This is attempt 1: this message will repeat every 5th retry.
I20260810 02:00:39.081945 6734 raft_consensus.cc:1275] T 8308d63e9002418b876c3d3ae0095d9f P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20260810 02:00:39.082607 26003 consensus_queue.cc:1048] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260810 02:00:39.092106 6567 raft_consensus.cc:1275] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20260810 02:00:39.092830 26003 consensus_queue.cc:1048] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260810 02:00:39.129715 26187 tablet_copy_client.cc:323] T 4a4350cf2ece4769b8547620ac5bedcb P dc85be7d460a404f997177f57680850f: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.194:43893
I20260810 02:00:39.129959 26203 raft_consensus.cc:2955] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Committing config change with OpId 1.12: config changed from index 11 to 12, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:39.130613 3973 tablet_copy_service.cc:140] P 82f93d1d11364ceeb485585b4ae78871: Received BeginTabletCopySession request for tablet 4a4350cf2ece4769b8547620ac5bedcb from peer dc85be7d460a404f997177f57680850f ({username='slave'} at 127.21.64.193:57229)
I20260810 02:00:39.130777 3973 tablet_copy_service.cc:161] P 82f93d1d11364ceeb485585b4ae78871: Beginning new tablet copy session on tablet 4a4350cf2ece4769b8547620ac5bedcb from peer dc85be7d460a404f997177f57680850f at {username='slave'} at 127.21.64.193:57229: session id = dc85be7d460a404f997177f57680850f-4a4350cf2ece4769b8547620ac5bedcb
I20260810 02:00:39.135339 3973 tablet_copy_source_session.cc:215] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 02:00:39.138518 26187 ts_tablet_manager.cc:1916] T 4a4350cf2ece4769b8547620ac5bedcb P dc85be7d460a404f997177f57680850f: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260810 02:00:39.164876 26187 ts_tablet_manager.cc:1929] T 4a4350cf2ece4769b8547620ac5bedcb P dc85be7d460a404f997177f57680850f: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.5
I20260810 02:00:39.164516 6734 raft_consensus.cc:2955] T 8308d63e9002418b876c3d3ae0095d9f P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:39.167845 26187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a4350cf2ece4769b8547620ac5bedcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 02:00:39.170655 3572 catalog_manager.cc:5719] T 8308d63e9002418b876c3d3ae0095d9f P c5ed5317da9c464b93f979c405f0f6e4 reported cstate change: config changed from index 11 to 12, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:39.188292 6567 raft_consensus.cc:2955] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:39.217433 26187 tablet_copy_client.cc:806] T 4a4350cf2ece4769b8547620ac5bedcb P dc85be7d460a404f997177f57680850f: tablet copy: Starting download of 0 data blocks...
I20260810 02:00:39.217901 26187 tablet_copy_client.cc:670] T 4a4350cf2ece4769b8547620ac5bedcb P dc85be7d460a404f997177f57680850f: tablet copy: Starting download of 1 WAL segments...
I20260810 02:00:39.219905 26187 tablet_copy_client.cc:538] T 4a4350cf2ece4769b8547620ac5bedcb P dc85be7d460a404f997177f57680850f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 02:00:39.223892 26187 tablet_bootstrap.cc:492] T 4a4350cf2ece4769b8547620ac5bedcb P dc85be7d460a404f997177f57680850f: Bootstrap starting.
I20260810 02:00:39.306946 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:39.335216 6369 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:39.337849 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:39.358572 6884 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:39.399190 3917 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:39.403344 3556 maintenance_manager.cc:419] P d34fc1f097c643269bf1e5289413e357: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033336
I20260810 02:00:39.439833 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:39.451996 3735 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 02:00:39.452412 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:39.579941 26262 ts_tablet_manager.cc:933] T 8308d63e9002418b876c3d3ae0095d9f P 4dd4cba155c941b4b7ad4d64c7431536: Initiating tablet copy from peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943)
I20260810 02:00:39.607878 26187 tablet_bootstrap.cc:492] T 4a4350cf2ece4769b8547620ac5bedcb P dc85be7d460a404f997177f57680850f: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=0 applied=16 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 02:00:39.608450 26187 tablet_bootstrap.cc:492] T 4a4350cf2ece4769b8547620ac5bedcb P dc85be7d460a404f997177f57680850f: Bootstrap complete.
I20260810 02:00:39.608848 26187 ts_tablet_manager.cc:1403] T 4a4350cf2ece4769b8547620ac5bedcb P dc85be7d460a404f997177f57680850f: Time spent bootstrapping tablet: real 0.385s user 0.057s sys 0.026s
I20260810 02:00:39.624482 26187 raft_consensus.cc:359] T 4a4350cf2ece4769b8547620ac5bedcb P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 02:00:39.625294 26262 tablet_copy_client.cc:323] T 8308d63e9002418b876c3d3ae0095d9f P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.196:41943
I20260810 02:00:39.626225 4337 tablet_copy_service.cc:140] P ca4469fc2dbc48488bc7ad7f482f129e: Received BeginTabletCopySession request for tablet 8308d63e9002418b876c3d3ae0095d9f from peer 4dd4cba155c941b4b7ad4d64c7431536 ({username='slave'} at 127.21.64.197:55001)
I20260810 02:00:39.626375 4337 tablet_copy_service.cc:161] P ca4469fc2dbc48488bc7ad7f482f129e: Beginning new tablet copy session on tablet 8308d63e9002418b876c3d3ae0095d9f from peer 4dd4cba155c941b4b7ad4d64c7431536 at {username='slave'} at 127.21.64.197:55001: session id = 4dd4cba155c941b4b7ad4d64c7431536-8308d63e9002418b876c3d3ae0095d9f
I20260810 02:00:39.630025 26187 raft_consensus.cc:740] T 4a4350cf2ece4769b8547620ac5bedcb P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc85be7d460a404f997177f57680850f, State: Initialized, Role: FOLLOWER
I20260810 02:00:39.630765 26187 consensus_queue.cc:260] T 4a4350cf2ece4769b8547620ac5bedcb P dc85be7d460a404f997177f57680850f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 16, Last appended: 1.16, Last appended by leader: 16, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 02:00:39.633028 26187 ts_tablet_manager.cc:1434] T 4a4350cf2ece4769b8547620ac5bedcb P dc85be7d460a404f997177f57680850f: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260810 02:00:39.634276 3973 tablet_copy_service.cc:342] P 82f93d1d11364ceeb485585b4ae78871: Request end of tablet copy session dc85be7d460a404f997177f57680850f-4a4350cf2ece4769b8547620ac5bedcb received from {username='slave'} at 127.21.64.193:57229
I20260810 02:00:39.634397 3973 tablet_copy_service.cc:434] P 82f93d1d11364ceeb485585b4ae78871: ending tablet copy session dc85be7d460a404f997177f57680850f-4a4350cf2ece4769b8547620ac5bedcb on tablet 4a4350cf2ece4769b8547620ac5bedcb with peer dc85be7d460a404f997177f57680850f
I20260810 02:00:39.635113 4337 tablet_copy_source_session.cc:215] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 02:00:39.637948 26262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8308d63e9002418b876c3d3ae0095d9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 02:00:39.657450 3555 maintenance_manager.cc:643] P d34fc1f097c643269bf1e5289413e357: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.253s user 0.062s sys 0.029s Metrics: {"bytes_written":20163,"cfile_init":1,"dirs.queue_time_us":6579,"dirs.run_cpu_time_us":253,"dirs.run_wall_time_us":5327,"drs_written":1,"lbm_read_time_us":157,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1374,"lbm_writes_lt_1ms":29,"peak_mem_usage":0,"rows_written":43,"thread_start_us":6787,"threads_started":1}
I20260810 02:00:39.659071 3556 maintenance_manager.cc:419] P d34fc1f097c643269bf1e5289413e357: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10187 bytes on disk
I20260810 02:00:39.660028 3555 maintenance_manager.cc:643] P d34fc1f097c643269bf1e5289413e357: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":100,"lbm_reads_lt_1ms":4}
I20260810 02:00:39.662478 26262 tablet_copy_client.cc:806] T 8308d63e9002418b876c3d3ae0095d9f P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Starting download of 0 data blocks...
I20260810 02:00:39.662874 26262 tablet_copy_client.cc:670] T 8308d63e9002418b876c3d3ae0095d9f P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Starting download of 1 WAL segments...
I20260810 02:00:39.666465 26262 tablet_copy_client.cc:538] T 8308d63e9002418b876c3d3ae0095d9f P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 02:00:39.670948 26262 tablet_bootstrap.cc:492] T 8308d63e9002418b876c3d3ae0095d9f P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap starting.
I20260810 02:00:39.765811 4129 consensus_queue.cc:237] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 02:00:39.779157 3756 raft_consensus.cc:1275] T c53fc4008faf445fa05e436b9c8e0282 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260810 02:00:39.779763 6908 raft_consensus.cc:1275] T c53fc4008faf445fa05e436b9c8e0282 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260810 02:00:39.780484 26186 consensus_queue.cc:1048] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 02:00:39.780797 25519 consensus_queue.cc:1048] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 02:00:39.785987 26186 raft_consensus.cc:2955] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } }
I20260810 02:00:39.794827 6907 raft_consensus.cc:2955] T c53fc4008faf445fa05e436b9c8e0282 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } }
I20260810 02:00:39.803248 26262 tablet_bootstrap.cc:492] T 8308d63e9002418b876c3d3ae0095d9f P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 02:00:39.803802 26262 tablet_bootstrap.cc:492] T 8308d63e9002418b876c3d3ae0095d9f P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap complete.
I20260810 02:00:39.804162 26262 ts_tablet_manager.cc:1403] T 8308d63e9002418b876c3d3ae0095d9f P 4dd4cba155c941b4b7ad4d64c7431536: Time spent bootstrapping tablet: real 0.133s user 0.066s sys 0.009s
I20260810 02:00:39.805025 26262 raft_consensus.cc:359] T 8308d63e9002418b876c3d3ae0095d9f P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 02:00:39.805311 26262 raft_consensus.cc:740] T 8308d63e9002418b876c3d3ae0095d9f P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dd4cba155c941b4b7ad4d64c7431536, State: Initialized, Role: FOLLOWER
I20260810 02:00:39.805540 3563 catalog_manager.cc:5719] T c53fc4008faf445fa05e436b9c8e0282 P 3136daf7101445beadc1aa19bc01c227 reported cstate change: config changed from index 8 to 9, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) evicted. New cstate: current_term: 1 leader_uuid: "17b49c694faf479ea2e5083470fc0302" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } }
I20260810 02:00:39.805725 26262 consensus_queue.cc:260] T 8308d63e9002418b876c3d3ae0095d9f P 4dd4cba155c941b4b7ad4d64c7431536 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 02:00:39.806221 26262 ts_tablet_manager.cc:1434] T 8308d63e9002418b876c3d3ae0095d9f P 4dd4cba155c941b4b7ad4d64c7431536: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260810 02:00:39.814344 4337 tablet_copy_service.cc:342] P ca4469fc2dbc48488bc7ad7f482f129e: Request end of tablet copy session 4dd4cba155c941b4b7ad4d64c7431536-8308d63e9002418b876c3d3ae0095d9f received from {username='slave'} at 127.21.64.197:55001
I20260810 02:00:39.814531 4337 tablet_copy_service.cc:434] P ca4469fc2dbc48488bc7ad7f482f129e: ending tablet copy session 4dd4cba155c941b4b7ad4d64c7431536-8308d63e9002418b876c3d3ae0095d9f on tablet 8308d63e9002418b876c3d3ae0095d9f with peer 4dd4cba155c941b4b7ad4d64c7431536
I20260810 02:00:39.824930 3756 raft_consensus.cc:2955] T c53fc4008faf445fa05e436b9c8e0282 P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } }
I20260810 02:00:39.941094 6369 tablet_service.cc:1558] Processing DeleteTablet for tablet c53fc4008faf445fa05e436b9c8e0282 with delete_type TABLET_DATA_TOMBSTONED (TS 4dd4cba155c941b4b7ad4d64c7431536 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:60156
I20260810 02:00:39.966295 26389 tablet_replica.cc:333] T c53fc4008faf445fa05e436b9c8e0282 P 4dd4cba155c941b4b7ad4d64c7431536: stopping tablet replica
I20260810 02:00:39.966742 26389 raft_consensus.cc:2243] T c53fc4008faf445fa05e436b9c8e0282 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:39.967044 26389 raft_consensus.cc:2272] T c53fc4008faf445fa05e436b9c8e0282 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:39.968016 26389 ts_tablet_manager.cc:1916] T c53fc4008faf445fa05e436b9c8e0282 P 4dd4cba155c941b4b7ad4d64c7431536: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 02:00:39.977618 26389 ts_tablet_manager.cc:1929] T c53fc4008faf445fa05e436b9c8e0282 P 4dd4cba155c941b4b7ad4d64c7431536: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20260810 02:00:39.980126 3756 raft_consensus.cc:1217] T 4a4350cf2ece4769b8547620ac5bedcb P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.15->[1.16-1.16] Dedup: 1.16->[]
I20260810 02:00:39.983832 26389 log.cc:1199] T c53fc4008faf445fa05e436b9c8e0282 P 4dd4cba155c941b4b7ad4d64c7431536: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-4/wal/wals/c53fc4008faf445fa05e436b9c8e0282
I20260810 02:00:39.986023 3551 catalog_manager.cc:5050] TS 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197:38787): tablet c53fc4008faf445fa05e436b9c8e0282 (table rebalance_test_table_2 [id=5e8751d351ba4b7da7861e02b0c3c634]) successfully deleted
I20260810 02:00:40.050074 3756 consensus_queue.cc:237] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 1.19, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
W20260810 02:00:40.054441 3670 consensus_peers.cc:597] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f -> Peer 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197:38787): Couldn't send request to peer 4dd4cba155c941b4b7ad4d64c7431536. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 02:00:40.055156 6567 raft_consensus.cc:1275] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 19. Preceding OpId from leader: term: 1 index: 20. (index mismatch)
I20260810 02:00:40.055770 25940 consensus_queue.cc:1048] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260810 02:00:40.066568 6907 raft_consensus.cc:1275] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 19. Preceding OpId from leader: term: 1 index: 20. (index mismatch)
I20260810 02:00:40.067301 25940 consensus_queue.cc:1048] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260810 02:00:40.078990 6394 raft_consensus.cc:1217] T 8308d63e9002418b876c3d3ae0095d9f P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.11->[1.12-1.12] Dedup: 1.12->[]
I20260810 02:00:40.079370 25940 raft_consensus.cc:2955] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.20: config changed from index 19 to 20, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:40.085198 6563 raft_consensus.cc:2955] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.20: config changed from index 19 to 20, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:40.091728 6907 raft_consensus.cc:2955] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.20: config changed from index 19 to 20, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:40.101176 3563 catalog_manager.cc:5719] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683 reported cstate change: config changed from index 19 to 20, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:40.206001 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:40.234490 6369 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:40.242980 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:40.267858 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:40.273228 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:40.294344 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:40.305154 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:40.314641 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:40.322839 6369 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:40.332109 3917 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:40.341490 3735 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 02:00:40.342494 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:40.380414 6884 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:40.394930 3917 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:40.435045 6884 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:40.443768 3735 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 02:00:40.564049 26515 ts_tablet_manager.cc:933] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536: Initiating tablet copy from peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
I20260810 02:00:40.581840 26515 tablet_copy_client.cc:323] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.193:36797
I20260810 02:00:40.582741 3787 tablet_copy_service.cc:140] P dc85be7d460a404f997177f57680850f: Received BeginTabletCopySession request for tablet 252899385eaa45b392974d2768e3cf01 from peer 4dd4cba155c941b4b7ad4d64c7431536 ({username='slave'} at 127.21.64.197:44713)
I20260810 02:00:40.582934 3787 tablet_copy_service.cc:161] P dc85be7d460a404f997177f57680850f: Beginning new tablet copy session on tablet 252899385eaa45b392974d2768e3cf01 from peer 4dd4cba155c941b4b7ad4d64c7431536 at {username='slave'} at 127.21.64.197:44713: session id = 4dd4cba155c941b4b7ad4d64c7431536-252899385eaa45b392974d2768e3cf01
I20260810 02:00:40.586759 3787 tablet_copy_source_session.cc:215] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 02:00:40.588102 26515 ts_tablet_manager.cc:1916] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260810 02:00:40.607753 26515 ts_tablet_manager.cc:1929] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.18
I20260810 02:00:40.608101 26515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 252899385eaa45b392974d2768e3cf01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 02:00:40.613560 26515 tablet_copy_client.cc:806] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Starting download of 0 data blocks...
I20260810 02:00:40.613850 26515 tablet_copy_client.cc:670] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Starting download of 1 WAL segments...
I20260810 02:00:40.624107 26515 tablet_copy_client.cc:538] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 02:00:40.628486 26515 tablet_bootstrap.cc:492] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap starting.
I20260810 02:00:40.715728 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:40.753878 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:40.764930 6884 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:40.788951 26515 tablet_bootstrap.cc:492] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap replayed 1/1 log segments. Stats: ops{read=20 overwritten=0 applied=20 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 02:00:40.789718 26515 tablet_bootstrap.cc:492] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap complete.
I20260810 02:00:40.792301 26515 ts_tablet_manager.cc:1403] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536: Time spent bootstrapping tablet: real 0.164s user 0.067s sys 0.014s
I20260810 02:00:40.793431 26515 raft_consensus.cc:359] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 02:00:40.796933 26515 raft_consensus.cc:740] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dd4cba155c941b4b7ad4d64c7431536, State: Initialized, Role: FOLLOWER
I20260810 02:00:40.797377 26515 consensus_queue.cc:260] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 20, Last appended: 1.20, Last appended by leader: 20, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 02:00:40.798219 26515 ts_tablet_manager.cc:1434] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260810 02:00:40.799257 3787 tablet_copy_service.cc:342] P dc85be7d460a404f997177f57680850f: Request end of tablet copy session 4dd4cba155c941b4b7ad4d64c7431536-252899385eaa45b392974d2768e3cf01 received from {username='slave'} at 127.21.64.197:44713
I20260810 02:00:40.799431 3787 tablet_copy_service.cc:434] P dc85be7d460a404f997177f57680850f: ending tablet copy session 4dd4cba155c941b4b7ad4d64c7431536-252899385eaa45b392974d2768e3cf01 on tablet 252899385eaa45b392974d2768e3cf01 with peer 4dd4cba155c941b4b7ad4d64c7431536
I20260810 02:00:40.834121 6369 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:40.840471 3917 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:40.896375 6397 raft_consensus.cc:1217] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.19->[1.20-1.20] Dedup: 1.20->[]
I20260810 02:00:40.937565 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:40.953960 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:40.956712 4313 consensus_queue.cc:237] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 02:00:41.001135 3735 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 02:00:41.057523 6397 raft_consensus.cc:1275] T 8308d63e9002418b876c3d3ae0095d9f P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20260810 02:00:41.058284 26374 consensus_queue.cc:1048] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260810 02:00:41.070248 6563 raft_consensus.cc:1275] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20260810 02:00:41.071386 26374 consensus_queue.cc:1048] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260810 02:00:41.079561 26207 raft_consensus.cc:2955] T 8308d63e9002418b876c3d3ae0095d9f P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:41.088274 6394 raft_consensus.cc:2955] T 8308d63e9002418b876c3d3ae0095d9f P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:41.098006 3572 catalog_manager.cc:5719] T 8308d63e9002418b876c3d3ae0095d9f P 4dd4cba155c941b4b7ad4d64c7431536 reported cstate change: config changed from index 12 to 13, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) evicted. New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:41.171195 6563 raft_consensus.cc:2955] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:41.270262 6715 tablet_service.cc:1558] Processing DeleteTablet for tablet 8308d63e9002418b876c3d3ae0095d9f with delete_type TABLET_DATA_TOMBSTONED (TS c5ed5317da9c464b93f979c405f0f6e4 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:58550
I20260810 02:00:41.291117 26637 tablet_replica.cc:333] T 8308d63e9002418b876c3d3ae0095d9f P c5ed5317da9c464b93f979c405f0f6e4: stopping tablet replica
I20260810 02:00:41.291515 26637 raft_consensus.cc:2243] T 8308d63e9002418b876c3d3ae0095d9f P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:41.292104 26637 raft_consensus.cc:2272] T 8308d63e9002418b876c3d3ae0095d9f P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:41.292979 26637 ts_tablet_manager.cc:1916] T 8308d63e9002418b876c3d3ae0095d9f P c5ed5317da9c464b93f979c405f0f6e4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 02:00:41.319993 26637 ts_tablet_manager.cc:1929] T 8308d63e9002418b876c3d3ae0095d9f P c5ed5317da9c464b93f979c405f0f6e4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.12
I20260810 02:00:41.320227 26637 log.cc:1199] T 8308d63e9002418b876c3d3ae0095d9f P c5ed5317da9c464b93f979c405f0f6e4: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/wal/wals/8308d63e9002418b876c3d3ae0095d9f
I20260810 02:00:41.321192 3554 catalog_manager.cc:5050] TS c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199:41689): tablet 8308d63e9002418b876c3d3ae0095d9f (table rebalance_test_table_6 [id=5b2df46262b142169af9a32c47535432]) successfully deleted
I20260810 02:00:41.373054 3945 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e8d13caf8054b1daf09b2b114843766"
dest_uuid: "82f93d1d11364ceeb485585b4ae78871"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:58032
I20260810 02:00:41.373301 3945 raft_consensus.cc:606] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Received request to transfer leadership
I20260810 02:00:41.376792 6884 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:41.381428 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:41.397697 6369 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:41.405113 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:41.421748 3917 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:41.424934 26596 raft_consensus.cc:993] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871: : Instructing follower 4dd4cba155c941b4b7ad4d64c7431536 to start an election
I20260810 02:00:41.425113 26593 raft_consensus.cc:1081] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Signalling peer 4dd4cba155c941b4b7ad4d64c7431536 to start an election
I20260810 02:00:41.425923 6394 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8e8d13caf8054b1daf09b2b114843766"
dest_uuid: "4dd4cba155c941b4b7ad4d64c7431536"
from {username='slave'} at 127.21.64.194:40151
I20260810 02:00:41.426148 6394 raft_consensus.cc:493] T 8e8d13caf8054b1daf09b2b114843766 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260810 02:00:41.426265 6394 raft_consensus.cc:3060] T 8e8d13caf8054b1daf09b2b114843766 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Advancing to term 2
I20260810 02:00:41.434571 6394 raft_consensus.cc:515] T 8e8d13caf8054b1daf09b2b114843766 P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 02:00:41.463410 6907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8d13caf8054b1daf09b2b114843766" candidate_uuid: "4dd4cba155c941b4b7ad4d64c7431536" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: true dest_uuid: "3136daf7101445beadc1aa19bc01c227"
I20260810 02:00:41.463681 6907 raft_consensus.cc:3060] T 8e8d13caf8054b1daf09b2b114843766 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Advancing to term 2
I20260810 02:00:41.466926 6907 raft_consensus.cc:2468] T 8e8d13caf8054b1daf09b2b114843766 P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dd4cba155c941b4b7ad4d64c7431536 in term 2.
I20260810 02:00:41.469260 3945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8d13caf8054b1daf09b2b114843766" candidate_uuid: "4dd4cba155c941b4b7ad4d64c7431536" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: true dest_uuid: "82f93d1d11364ceeb485585b4ae78871"
I20260810 02:00:41.469599 3945 raft_consensus.cc:3055] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Stepping down as leader of term 1
I20260810 02:00:41.469678 3945 raft_consensus.cc:740] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 82f93d1d11364ceeb485585b4ae78871, State: Running, Role: LEADER
I20260810 02:00:41.469978 3945 consensus_queue.cc:260] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 02:00:41.470461 3945 raft_consensus.cc:3060] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Advancing to term 2
I20260810 02:00:41.475349 6567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8d13caf8054b1daf09b2b114843766" candidate_uuid: "4dd4cba155c941b4b7ad4d64c7431536" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: true dest_uuid: "22ce0e487f0341fd9bf853393d6e7683"
I20260810 02:00:41.475580 6567 raft_consensus.cc:3060] T 8e8d13caf8054b1daf09b2b114843766 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Advancing to term 2
I20260810 02:00:41.478786 6567 raft_consensus.cc:2468] T 8e8d13caf8054b1daf09b2b114843766 P 22ce0e487f0341fd9bf853393d6e7683 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dd4cba155c941b4b7ad4d64c7431536 in term 2.
I20260810 02:00:41.479883 6311 leader_election.cc:304] T 8e8d13caf8054b1daf09b2b114843766 P 4dd4cba155c941b4b7ad4d64c7431536 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 22ce0e487f0341fd9bf853393d6e7683, 3136daf7101445beadc1aa19bc01c227, 4dd4cba155c941b4b7ad4d64c7431536; no voters:
I20260810 02:00:41.480289 26366 raft_consensus.cc:2804] T 8e8d13caf8054b1daf09b2b114843766 P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 02:00:41.486127 6394 leader_election.cc:290] T 8e8d13caf8054b1daf09b2b114843766 P 4dd4cba155c941b4b7ad4d64c7431536 [CANDIDATE]: Term 2 election: Requested vote from peers 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893), 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995), 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317)
I20260810 02:00:41.491345 3945 raft_consensus.cc:2468] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dd4cba155c941b4b7ad4d64c7431536 in term 2.
I20260810 02:00:41.554942 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:41.560092 26366 raft_consensus.cc:697] T 8e8d13caf8054b1daf09b2b114843766 P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 LEADER]: Becoming Leader. State: Replica: 4dd4cba155c941b4b7ad4d64c7431536, State: Running, Role: LEADER
I20260810 02:00:41.560508 26366 consensus_queue.cc:237] T 8e8d13caf8054b1daf09b2b114843766 P 4dd4cba155c941b4b7ad4d64c7431536 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 02:00:41.578814 3735 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 02:00:41.596580 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:41.598771 3572 catalog_manager.cc:5719] T 8e8d13caf8054b1daf09b2b114843766 P 4dd4cba155c941b4b7ad4d64c7431536 reported cstate change: term changed from 1 to 2, leader changed from 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) to 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197). New cstate: current_term: 2 leader_uuid: "4dd4cba155c941b4b7ad4d64c7431536" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:41.877095 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:41.892611 6369 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:41.901222 6884 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:41.912356 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:41.962541 6907 raft_consensus.cc:1275] T 8e8d13caf8054b1daf09b2b114843766 P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Refusing update from remote peer 4dd4cba155c941b4b7ad4d64c7431536: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20260810 02:00:41.964654 26366 consensus_queue.cc:1048] T 8e8d13caf8054b1daf09b2b114843766 P 4dd4cba155c941b4b7ad4d64c7431536 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 02:00:41.971179 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:41.974440 3917 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:41.995210 3735 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 02:00:42.022804 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:42.092239 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:42.105377 6567 raft_consensus.cc:1275] T 8e8d13caf8054b1daf09b2b114843766 P 22ce0e487f0341fd9bf853393d6e7683 [term 2 FOLLOWER]: Refusing update from remote peer 4dd4cba155c941b4b7ad4d64c7431536: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20260810 02:00:42.106470 26366 consensus_queue.cc:1048] T 8e8d13caf8054b1daf09b2b114843766 P 4dd4cba155c941b4b7ad4d64c7431536 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 02:00:42.133119 6884 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:42.172648 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:42.179405 3917 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:42.203679 3945 raft_consensus.cc:1275] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 [term 2 FOLLOWER]: Refusing update from remote peer 4dd4cba155c941b4b7ad4d64c7431536: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20260810 02:00:42.206585 26801 consensus_queue.cc:1048] T 8e8d13caf8054b1daf09b2b114843766 P 4dd4cba155c941b4b7ad4d64c7431536 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 02:00:42.233014 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:42.281531 6369 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:42.307580 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:42.312109 3735 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 02:00:42.402796 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:42.422645 3756 consensus_queue.cc:237] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 1.20, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 02:00:42.426015 6394 raft_consensus.cc:1275] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 20. Preceding OpId from leader: term: 1 index: 21. (index mismatch)
I20260810 02:00:42.428264 6907 raft_consensus.cc:1275] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 20. Preceding OpId from leader: term: 1 index: 21. (index mismatch)
I20260810 02:00:42.429075 26757 consensus_queue.cc:1048] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260810 02:00:42.429502 25940 consensus_queue.cc:1048] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260810 02:00:42.446058 25940 raft_consensus.cc:2955] T 252899385eaa45b392974d2768e3cf01 P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.21: config changed from index 20 to 21, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) evicted. New config: { opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:42.448818 6907 raft_consensus.cc:2955] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.21: config changed from index 20 to 21, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) evicted. New config: { opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:42.462131 3563 catalog_manager.cc:5719] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227 reported cstate change: config changed from index 20 to 21, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) evicted. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:42.463631 6884 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:42.467407 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:42.481088 3735 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 02:00:42.494285 6394 raft_consensus.cc:2955] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Committing config change with OpId 1.21: config changed from index 20 to 21, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) evicted. New config: { opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:42.504879 6369 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:42.532711 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:42.555680 3917 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:42.628357 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:42.650417 6541 tablet_service.cc:1558] Processing DeleteTablet for tablet 252899385eaa45b392974d2768e3cf01 with delete_type TABLET_DATA_TOMBSTONED (TS 22ce0e487f0341fd9bf853393d6e7683 not found in new config with opid_index 21) from {username='slave'} at 127.0.0.1:37902
I20260810 02:00:42.663846 26849 tablet_replica.cc:333] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683: stopping tablet replica
I20260810 02:00:42.664218 26849 raft_consensus.cc:2243] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:42.664546 26849 raft_consensus.cc:2272] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:42.665413 26849 ts_tablet_manager.cc:1916] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 02:00:42.693604 26849 ts_tablet_manager.cc:1929] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.20
I20260810 02:00:42.693840 26849 log.cc:1199] T 252899385eaa45b392974d2768e3cf01 P 22ce0e487f0341fd9bf853393d6e7683: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/wal/wals/252899385eaa45b392974d2768e3cf01
I20260810 02:00:42.694741 3553 catalog_manager.cc:5050] TS 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317): tablet 252899385eaa45b392974d2768e3cf01 (table rebalance_test_table_8 [id=afa71147917d44a585bcbaa37497a2b1]) successfully deleted
I20260810 02:00:42.771905 3945 consensus_queue.cc:237] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 1.16, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 02:00:42.783600 3759 raft_consensus.cc:1275] T 4a4350cf2ece4769b8547620ac5bedcb P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 16. Preceding OpId from leader: term: 1 index: 17. (index mismatch)
I20260810 02:00:42.785754 6734 raft_consensus.cc:1275] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 16. Preceding OpId from leader: term: 1 index: 17. (index mismatch)
I20260810 02:00:42.786801 26760 consensus_queue.cc:1048] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260810 02:00:42.791383 26760 consensus_queue.cc:1048] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260810 02:00:42.818636 26891 raft_consensus.cc:2955] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.17: config changed from index 16 to 17, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } }
I20260810 02:00:42.830024 3574 catalog_manager.cc:5719] T 4a4350cf2ece4769b8547620ac5bedcb P 82f93d1d11364ceeb485585b4ae78871 reported cstate change: config changed from index 16 to 17, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) evicted. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } }
I20260810 02:00:42.832302 6734 raft_consensus.cc:2955] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.17: config changed from index 16 to 17, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } }
I20260810 02:00:42.835842 6541 tablet_service.cc:1558] Processing DeleteTablet for tablet 4a4350cf2ece4769b8547620ac5bedcb with delete_type TABLET_DATA_TOMBSTONED (TS 22ce0e487f0341fd9bf853393d6e7683 not found in new config with opid_index 17) from {username='slave'} at 127.0.0.1:37902
I20260810 02:00:42.836526 26849 tablet_replica.cc:333] T 4a4350cf2ece4769b8547620ac5bedcb P 22ce0e487f0341fd9bf853393d6e7683: stopping tablet replica
I20260810 02:00:42.836795 26849 raft_consensus.cc:2243] T 4a4350cf2ece4769b8547620ac5bedcb P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:42.837146 26849 raft_consensus.cc:2272] T 4a4350cf2ece4769b8547620ac5bedcb P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:42.839319 26849 ts_tablet_manager.cc:1916] T 4a4350cf2ece4769b8547620ac5bedcb P 22ce0e487f0341fd9bf853393d6e7683: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 02:00:42.849607 26849 ts_tablet_manager.cc:1929] T 4a4350cf2ece4769b8547620ac5bedcb P 22ce0e487f0341fd9bf853393d6e7683: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.16
I20260810 02:00:42.849838 26849 log.cc:1199] T 4a4350cf2ece4769b8547620ac5bedcb P 22ce0e487f0341fd9bf853393d6e7683: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-5/wal/wals/4a4350cf2ece4769b8547620ac5bedcb
I20260810 02:00:42.850618 3553 catalog_manager.cc:5050] TS 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317): tablet 4a4350cf2ece4769b8547620ac5bedcb (table rebalance_test_table_8 [id=afa71147917d44a585bcbaa37497a2b1]) successfully deleted
I20260810 02:00:42.851795 3759 raft_consensus.cc:2955] T 4a4350cf2ece4769b8547620ac5bedcb P dc85be7d460a404f997177f57680850f [term 1 FOLLOWER]: Committing config change with OpId 1.17: config changed from index 16 to 17, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } }
I20260810 02:00:42.974920 6394 consensus_queue.cc:237] T 8e8d13caf8054b1daf09b2b114843766 P 4dd4cba155c941b4b7ad4d64c7431536 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 2.9, Last appended by leader: 8, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 02:00:42.977363 6563 raft_consensus.cc:1275] T 8e8d13caf8054b1daf09b2b114843766 P 22ce0e487f0341fd9bf853393d6e7683 [term 2 FOLLOWER]: Refusing update from remote peer 4dd4cba155c941b4b7ad4d64c7431536: Log matching property violated. Preceding OpId in replica: term: 2 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20260810 02:00:42.977576 6907 raft_consensus.cc:1275] T 8e8d13caf8054b1daf09b2b114843766 P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Refusing update from remote peer 4dd4cba155c941b4b7ad4d64c7431536: Log matching property violated. Preceding OpId in replica: term: 2 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20260810 02:00:42.978982 26792 consensus_queue.cc:1048] T 8e8d13caf8054b1daf09b2b114843766 P 4dd4cba155c941b4b7ad4d64c7431536 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260810 02:00:42.979614 26792 consensus_queue.cc:1048] T 8e8d13caf8054b1daf09b2b114843766 P 4dd4cba155c941b4b7ad4d64c7431536 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260810 02:00:42.986142 26947 raft_consensus.cc:2955] T 8e8d13caf8054b1daf09b2b114843766 P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 LEADER]: Committing config change with OpId 2.10: config changed from index 8 to 10, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:42.986586 6907 raft_consensus.cc:2955] T 8e8d13caf8054b1daf09b2b114843766 P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Committing config change with OpId 2.10: config changed from index 8 to 10, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:42.993270 3574 catalog_manager.cc:5719] T 8e8d13caf8054b1daf09b2b114843766 P 3136daf7101445beadc1aa19bc01c227 reported cstate change: config changed from index 8 to 10, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New cstate: current_term: 2 leader_uuid: "4dd4cba155c941b4b7ad4d64c7431536" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:42.999728 6563 raft_consensus.cc:2955] T 8e8d13caf8054b1daf09b2b114843766 P 22ce0e487f0341fd9bf853393d6e7683 [term 2 FOLLOWER]: Committing config change with OpId 2.10: config changed from index 8 to 10, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:43.000671 3917 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e8d13caf8054b1daf09b2b114843766 with delete_type TABLET_DATA_TOMBSTONED (TS 82f93d1d11364ceeb485585b4ae78871 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:51288
I20260810 02:00:43.013155 26951 tablet_replica.cc:333] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871: stopping tablet replica
I20260810 02:00:43.013434 26951 raft_consensus.cc:2243] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:43.013666 26951 raft_consensus.cc:2272] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:43.019799 26951 ts_tablet_manager.cc:1916] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 02:00:43.030694 26951 ts_tablet_manager.cc:1929] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.9
I20260810 02:00:43.038993 26951 log.cc:1199] T 8e8d13caf8054b1daf09b2b114843766 P 82f93d1d11364ceeb485585b4ae78871: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/wal/wals/8e8d13caf8054b1daf09b2b114843766
I20260810 02:00:43.039966 3553 catalog_manager.cc:5050] TS 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): tablet 8e8d13caf8054b1daf09b2b114843766 (table rebalance_test_table_9 [id=372310cb713644ada1071e8eb628b0c9]) successfully deleted
I20260810 02:00:43.309013 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:43.312040 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:43.329284 3917 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:43.332995 6884 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:43.336174 3735 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 02:00:43.361847 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:43.380478 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:43.380630 6369 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:43.784555 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:43.841717 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:43.853355 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:43.881814 3917 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:43.886615 6884 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:43.895088 3735 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 02:00:43.907068 6369 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:43.933902 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:44.048784 3759 consensus_queue.cc:237] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
W20260810 02:00:44.063946 3672 consensus_peers.cc:597] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f -> Peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): Couldn't send request to peer 82f93d1d11364ceeb485585b4ae78871. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 02:00:44.065125 4313 raft_consensus.cc:1275] T 389d3abfeadd4fe6a4efa74427d71c4d P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260810 02:00:44.065868 27156 consensus_queue.cc:1048] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260810 02:00:44.072949 6734 raft_consensus.cc:1275] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260810 02:00:44.073547 27156 consensus_queue.cc:1048] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260810 02:00:44.092135 27156 raft_consensus.cc:2955] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:44.099614 6734 raft_consensus.cc:2955] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:44.106640 3572 catalog_manager.cc:5719] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4 reported cstate change: config changed from index 9 to 10, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) added. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:44.124743 4313 raft_consensus.cc:2955] T 389d3abfeadd4fe6a4efa74427d71c4d P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:44.257089 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
W20260810 02:00:44.285863 3857 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.198:45317, user_credentials={real_user=slave}} blocked reactor thread for 68020.2us
I20260810 02:00:44.296972 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:44.364692 3917 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:44.365835 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:44.371855 6884 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:44.372380 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:44.372949 6369 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:44.373754 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:44.374549 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:44.384115 6884 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:44.421684 3917 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:44.451644 6369 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:44.455969 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:44.471156 3735 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 02:00:44.472159 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:44.503816 3735 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 02:00:44.554214 27286 ts_tablet_manager.cc:933] T 389d3abfeadd4fe6a4efa74427d71c4d P 82f93d1d11364ceeb485585b4ae78871: Initiating tablet copy from peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
I20260810 02:00:44.574030 27286 tablet_copy_client.cc:323] T 389d3abfeadd4fe6a4efa74427d71c4d P 82f93d1d11364ceeb485585b4ae78871: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.193:36797
I20260810 02:00:44.575034 3787 tablet_copy_service.cc:140] P dc85be7d460a404f997177f57680850f: Received BeginTabletCopySession request for tablet 389d3abfeadd4fe6a4efa74427d71c4d from peer 82f93d1d11364ceeb485585b4ae78871 ({username='slave'} at 127.21.64.194:46195)
I20260810 02:00:44.575255 3787 tablet_copy_service.cc:161] P dc85be7d460a404f997177f57680850f: Beginning new tablet copy session on tablet 389d3abfeadd4fe6a4efa74427d71c4d from peer 82f93d1d11364ceeb485585b4ae78871 at {username='slave'} at 127.21.64.194:46195: session id = 82f93d1d11364ceeb485585b4ae78871-389d3abfeadd4fe6a4efa74427d71c4d
I20260810 02:00:44.578672 3787 tablet_copy_source_session.cc:215] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 02:00:44.592563 27286 ts_tablet_manager.cc:1916] T 389d3abfeadd4fe6a4efa74427d71c4d P 82f93d1d11364ceeb485585b4ae78871: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260810 02:00:44.599421 3943 consensus_queue.cc:237] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
W20260810 02:00:44.613385 3858 consensus_peers.cc:597] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 -> Peer c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199:41689): Couldn't send request to peer c5ed5317da9c464b93f979c405f0f6e4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f7a36f7ebd5d4342a259b093e45d4c32. This is attempt 1: this message will repeat every 5th retry.
I20260810 02:00:44.616148 6907 raft_consensus.cc:1275] T f7a36f7ebd5d4342a259b093e45d4c32 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260810 02:00:44.617823 26890 consensus_queue.cc:1048] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260810 02:00:44.618920 6394 raft_consensus.cc:1275] T f7a36f7ebd5d4342a259b093e45d4c32 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260810 02:00:44.619876 26890 consensus_queue.cc:1048] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260810 02:00:44.647080 3759 consensus_queue.cc:237] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
W20260810 02:00:44.681201 3673 consensus_peers.cc:597] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f -> Peer c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199:41689): Couldn't send request to peer c5ed5317da9c464b93f979c405f0f6e4. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 02:00:44.681221 6908 raft_consensus.cc:1275] T abf302f27a12414a8647dab82ab8101f P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260810 02:00:44.682415 4129 raft_consensus.cc:1275] T abf302f27a12414a8647dab82ab8101f P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260810 02:00:44.683573 25940 consensus_queue.cc:1048] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260810 02:00:44.684249 25940 consensus_queue.cc:1048] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260810 02:00:44.686167 27286 ts_tablet_manager.cc:1929] T 389d3abfeadd4fe6a4efa74427d71c4d P 82f93d1d11364ceeb485585b4ae78871: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.4
I20260810 02:00:44.689998 27286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 389d3abfeadd4fe6a4efa74427d71c4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 02:00:44.692340 26890 raft_consensus.cc:2955] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 02:00:44.694191 6909 raft_consensus.cc:2955] T f7a36f7ebd5d4342a259b093e45d4c32 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 02:00:44.701988 27286 tablet_copy_client.cc:806] T 389d3abfeadd4fe6a4efa74427d71c4d P 82f93d1d11364ceeb485585b4ae78871: tablet copy: Starting download of 0 data blocks...
I20260810 02:00:44.702214 27286 tablet_copy_client.cc:670] T 389d3abfeadd4fe6a4efa74427d71c4d P 82f93d1d11364ceeb485585b4ae78871: tablet copy: Starting download of 1 WAL segments...
I20260810 02:00:44.707029 27286 tablet_copy_client.cc:538] T 389d3abfeadd4fe6a4efa74427d71c4d P 82f93d1d11364ceeb485585b4ae78871: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 02:00:44.715139 27286 tablet_bootstrap.cc:492] T 389d3abfeadd4fe6a4efa74427d71c4d P 82f93d1d11364ceeb485585b4ae78871: Bootstrap starting.
I20260810 02:00:44.715111 3565 catalog_manager.cc:5719] T f7a36f7ebd5d4342a259b093e45d4c32 P 3136daf7101445beadc1aa19bc01c227 reported cstate change: config changed from index 9 to 10, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 02:00:44.724689 6397 raft_consensus.cc:2955] T f7a36f7ebd5d4342a259b093e45d4c32 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 02:00:44.753525 27311 raft_consensus.cc:2955] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 02:00:44.759104 4131 raft_consensus.cc:2955] T abf302f27a12414a8647dab82ab8101f P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 02:00:44.767642 6907 raft_consensus.cc:2955] T abf302f27a12414a8647dab82ab8101f P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
I20260810 02:00:44.823596 3563 catalog_manager.cc:5719] T abf302f27a12414a8647dab82ab8101f P 17b49c694faf479ea2e5083470fc0302 reported cstate change: config changed from index 9 to 10, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) added. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
W20260810 02:00:44.833684 4220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.195:39189, user_credentials={real_user=slave}} blocked reactor thread for 71460.1us
I20260810 02:00:44.858417 27286 tablet_bootstrap.cc:492] T 389d3abfeadd4fe6a4efa74427d71c4d P 82f93d1d11364ceeb485585b4ae78871: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 02:00:44.859089 27286 tablet_bootstrap.cc:492] T 389d3abfeadd4fe6a4efa74427d71c4d P 82f93d1d11364ceeb485585b4ae78871: Bootstrap complete.
I20260810 02:00:44.859543 27286 ts_tablet_manager.cc:1403] T 389d3abfeadd4fe6a4efa74427d71c4d P 82f93d1d11364ceeb485585b4ae78871: Time spent bootstrapping tablet: real 0.144s user 0.066s sys 0.022s
I20260810 02:00:44.860698 27286 raft_consensus.cc:359] T 389d3abfeadd4fe6a4efa74427d71c4d P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 02:00:44.861295 27286 raft_consensus.cc:740] T 389d3abfeadd4fe6a4efa74427d71c4d P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f93d1d11364ceeb485585b4ae78871, State: Initialized, Role: FOLLOWER
I20260810 02:00:44.861732 27286 consensus_queue.cc:260] T 389d3abfeadd4fe6a4efa74427d71c4d P 82f93d1d11364ceeb485585b4ae78871 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 1.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 02:00:44.864848 27286 ts_tablet_manager.cc:1434] T 389d3abfeadd4fe6a4efa74427d71c4d P 82f93d1d11364ceeb485585b4ae78871: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260810 02:00:44.865761 3787 tablet_copy_service.cc:342] P dc85be7d460a404f997177f57680850f: Request end of tablet copy session 82f93d1d11364ceeb485585b4ae78871-389d3abfeadd4fe6a4efa74427d71c4d received from {username='slave'} at 127.21.64.194:46195
I20260810 02:00:44.865931 3787 tablet_copy_service.cc:434] P dc85be7d460a404f997177f57680850f: ending tablet copy session 82f93d1d11364ceeb485585b4ae78871-389d3abfeadd4fe6a4efa74427d71c4d on tablet 389d3abfeadd4fe6a4efa74427d71c4d with peer 82f93d1d11364ceeb485585b4ae78871
I20260810 02:00:44.999411 4313 consensus_queue.cc:237] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 02:00:45.021361 4131 raft_consensus.cc:1275] T 5528e3ba51a640eaa614f141440bb90b P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260810 02:00:45.021938 6563 raft_consensus.cc:1275] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260810 02:00:45.022073 27331 consensus_queue.cc:1048] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260810 02:00:45.023078 4222 consensus_peers.cc:597] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e -> Peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): Couldn't send request to peer 82f93d1d11364ceeb485585b4ae78871. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 02:00:45.023627 27331 consensus_queue.cc:1048] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260810 02:00:45.044518 27333 raft_consensus.cc:2955] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:45.045272 6567 raft_consensus.cc:2955] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:45.050469 4131 raft_consensus.cc:2955] T 5528e3ba51a640eaa614f141440bb90b P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:45.057276 3562 catalog_manager.cc:5719] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e reported cstate change: config changed from index 9 to 10, VOTER 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) added. New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:45.122331 3943 raft_consensus.cc:1217] T 389d3abfeadd4fe6a4efa74427d71c4d P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.9->[1.10-1.10] Dedup: 1.10->[]
I20260810 02:00:45.170953 27458 ts_tablet_manager.cc:933] T abf302f27a12414a8647dab82ab8101f P c5ed5317da9c464b93f979c405f0f6e4: Initiating tablet copy from peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
I20260810 02:00:45.212704 27458 tablet_copy_client.cc:323] T abf302f27a12414a8647dab82ab8101f P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.193:36797
I20260810 02:00:45.213799 3787 tablet_copy_service.cc:140] P dc85be7d460a404f997177f57680850f: Received BeginTabletCopySession request for tablet abf302f27a12414a8647dab82ab8101f from peer c5ed5317da9c464b93f979c405f0f6e4 ({username='slave'} at 127.21.64.199:59819)
I20260810 02:00:45.213999 3787 tablet_copy_service.cc:161] P dc85be7d460a404f997177f57680850f: Beginning new tablet copy session on tablet abf302f27a12414a8647dab82ab8101f from peer c5ed5317da9c464b93f979c405f0f6e4 at {username='slave'} at 127.21.64.199:59819: session id = c5ed5317da9c464b93f979c405f0f6e4-abf302f27a12414a8647dab82ab8101f
I20260810 02:00:45.217913 3787 tablet_copy_source_session.cc:215] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 02:00:45.219312 27458 ts_tablet_manager.cc:1916] T abf302f27a12414a8647dab82ab8101f P c5ed5317da9c464b93f979c405f0f6e4: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260810 02:00:45.242944 27476 ts_tablet_manager.cc:933] T f7a36f7ebd5d4342a259b093e45d4c32 P c5ed5317da9c464b93f979c405f0f6e4: Initiating tablet copy from peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 02:00:45.271525 27476 tablet_copy_client.cc:323] T f7a36f7ebd5d4342a259b093e45d4c32 P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.194:43893
I20260810 02:00:45.261271 27458 ts_tablet_manager.cc:1929] T abf302f27a12414a8647dab82ab8101f P c5ed5317da9c464b93f979c405f0f6e4: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.8
I20260810 02:00:45.272331 27458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abf302f27a12414a8647dab82ab8101f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 02:00:45.273216 3973 tablet_copy_service.cc:140] P 82f93d1d11364ceeb485585b4ae78871: Received BeginTabletCopySession request for tablet f7a36f7ebd5d4342a259b093e45d4c32 from peer c5ed5317da9c464b93f979c405f0f6e4 ({username='slave'} at 127.21.64.199:41929)
I20260810 02:00:45.273435 3973 tablet_copy_service.cc:161] P 82f93d1d11364ceeb485585b4ae78871: Beginning new tablet copy session on tablet f7a36f7ebd5d4342a259b093e45d4c32 from peer c5ed5317da9c464b93f979c405f0f6e4 at {username='slave'} at 127.21.64.199:41929: session id = c5ed5317da9c464b93f979c405f0f6e4-f7a36f7ebd5d4342a259b093e45d4c32
I20260810 02:00:45.278780 3973 tablet_copy_source_session.cc:215] T f7a36f7ebd5d4342a259b093e45d4c32 P 82f93d1d11364ceeb485585b4ae78871: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 02:00:45.280607 27476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7a36f7ebd5d4342a259b093e45d4c32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 02:00:45.290382 27476 tablet_copy_client.cc:806] T f7a36f7ebd5d4342a259b093e45d4c32 P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Starting download of 0 data blocks...
I20260810 02:00:45.292689 27476 tablet_copy_client.cc:670] T f7a36f7ebd5d4342a259b093e45d4c32 P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Starting download of 1 WAL segments...
I20260810 02:00:45.293993 27458 tablet_copy_client.cc:806] T abf302f27a12414a8647dab82ab8101f P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Starting download of 0 data blocks...
I20260810 02:00:45.294333 27458 tablet_copy_client.cc:670] T abf302f27a12414a8647dab82ab8101f P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Starting download of 1 WAL segments...
I20260810 02:00:45.297089 27476 tablet_copy_client.cc:538] T f7a36f7ebd5d4342a259b093e45d4c32 P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 02:00:45.297262 27458 tablet_copy_client.cc:538] T abf302f27a12414a8647dab82ab8101f P c5ed5317da9c464b93f979c405f0f6e4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 02:00:45.312348 27476 tablet_bootstrap.cc:492] T f7a36f7ebd5d4342a259b093e45d4c32 P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap starting.
I20260810 02:00:45.318971 27458 tablet_bootstrap.cc:492] T abf302f27a12414a8647dab82ab8101f P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap starting.
I20260810 02:00:45.523260 3917 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:45.542771 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:45.544710 6884 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:45.571246 27552 ts_tablet_manager.cc:933] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871: Initiating tablet copy from peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943)
I20260810 02:00:45.583333 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:45.588847 27552 tablet_copy_client.cc:323] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.196:41943
I20260810 02:00:45.595968 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:45.601320 4337 tablet_copy_service.cc:140] P ca4469fc2dbc48488bc7ad7f482f129e: Received BeginTabletCopySession request for tablet 5528e3ba51a640eaa614f141440bb90b from peer 82f93d1d11364ceeb485585b4ae78871 ({username='slave'} at 127.21.64.194:37889)
I20260810 02:00:45.601543 4337 tablet_copy_service.cc:161] P ca4469fc2dbc48488bc7ad7f482f129e: Beginning new tablet copy session on tablet 5528e3ba51a640eaa614f141440bb90b from peer 82f93d1d11364ceeb485585b4ae78871 at {username='slave'} at 127.21.64.194:37889: session id = 82f93d1d11364ceeb485585b4ae78871-5528e3ba51a640eaa614f141440bb90b
I20260810 02:00:45.604696 4337 tablet_copy_source_session.cc:215] T 5528e3ba51a640eaa614f141440bb90b P ca4469fc2dbc48488bc7ad7f482f129e: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 02:00:45.607771 27552 ts_tablet_manager.cc:1916] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260810 02:00:45.616992 27552 ts_tablet_manager.cc:1929] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.8
I20260810 02:00:45.622404 27552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5528e3ba51a640eaa614f141440bb90b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 02:00:45.625622 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:45.652911 27552 tablet_copy_client.cc:806] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871: tablet copy: Starting download of 0 data blocks...
I20260810 02:00:45.657577 27552 tablet_copy_client.cc:670] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871: tablet copy: Starting download of 1 WAL segments...
I20260810 02:00:45.660917 27552 tablet_copy_client.cc:538] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 02:00:45.665736 27552 tablet_bootstrap.cc:492] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871: Bootstrap starting.
I20260810 02:00:45.668617 6369 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:45.705735 27458 tablet_bootstrap.cc:492] T abf302f27a12414a8647dab82ab8101f P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 02:00:45.706736 27458 tablet_bootstrap.cc:492] T abf302f27a12414a8647dab82ab8101f P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap complete.
I20260810 02:00:45.710073 27458 ts_tablet_manager.cc:1403] T abf302f27a12414a8647dab82ab8101f P c5ed5317da9c464b93f979c405f0f6e4: Time spent bootstrapping tablet: real 0.391s user 0.061s sys 0.015s
I20260810 02:00:45.711535 27458 raft_consensus.cc:359] T abf302f27a12414a8647dab82ab8101f P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 02:00:45.711802 27458 raft_consensus.cc:740] T abf302f27a12414a8647dab82ab8101f P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ed5317da9c464b93f979c405f0f6e4, State: Initialized, Role: FOLLOWER
I20260810 02:00:45.712472 27458 consensus_queue.cc:260] T abf302f27a12414a8647dab82ab8101f P c5ed5317da9c464b93f979c405f0f6e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 1.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 02:00:45.722476 3735 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 02:00:45.723132 27458 ts_tablet_manager.cc:1434] T abf302f27a12414a8647dab82ab8101f P c5ed5317da9c464b93f979c405f0f6e4: Time spent starting tablet: real 0.013s user 0.001s sys 0.000s
I20260810 02:00:45.724535 3787 tablet_copy_service.cc:342] P dc85be7d460a404f997177f57680850f: Request end of tablet copy session c5ed5317da9c464b93f979c405f0f6e4-abf302f27a12414a8647dab82ab8101f received from {username='slave'} at 127.21.64.199:59819
I20260810 02:00:45.724699 3787 tablet_copy_service.cc:434] P dc85be7d460a404f997177f57680850f: ending tablet copy session c5ed5317da9c464b93f979c405f0f6e4-abf302f27a12414a8647dab82ab8101f on tablet abf302f27a12414a8647dab82ab8101f with peer c5ed5317da9c464b93f979c405f0f6e4
I20260810 02:00:45.751084 6734 raft_consensus.cc:1217] T abf302f27a12414a8647dab82ab8101f P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.9->[1.10-1.10] Dedup: 1.10->[]
I20260810 02:00:45.803866 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:45.805672 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:45.812106 6884 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:45.839048 6369 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:45.853606 3917 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:45.865733 27552 tablet_bootstrap.cc:492] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 02:00:45.866212 27552 tablet_bootstrap.cc:492] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871: Bootstrap complete.
I20260810 02:00:45.866531 27552 ts_tablet_manager.cc:1403] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871: Time spent bootstrapping tablet: real 0.201s user 0.050s sys 0.004s
I20260810 02:00:45.867298 27552 raft_consensus.cc:359] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 02:00:45.867530 27552 raft_consensus.cc:740] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f93d1d11364ceeb485585b4ae78871, State: Initialized, Role: FOLLOWER
I20260810 02:00:45.867794 27552 consensus_queue.cc:260] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 1.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 02:00:45.868393 27552 ts_tablet_manager.cc:1434] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 02:00:45.874492 4337 tablet_copy_service.cc:342] P ca4469fc2dbc48488bc7ad7f482f129e: Request end of tablet copy session 82f93d1d11364ceeb485585b4ae78871-5528e3ba51a640eaa614f141440bb90b received from {username='slave'} at 127.21.64.194:37889
I20260810 02:00:45.874608 4337 tablet_copy_service.cc:434] P ca4469fc2dbc48488bc7ad7f482f129e: ending tablet copy session 82f93d1d11364ceeb485585b4ae78871-5528e3ba51a640eaa614f141440bb90b on tablet 5528e3ba51a640eaa614f141440bb90b with peer 82f93d1d11364ceeb485585b4ae78871
I20260810 02:00:45.877503 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:45.909188 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:45.919306 3735 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 02:00:45.977757 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:45.994705 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:46.065018 3917 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:46.087527 6884 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:46.112160 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
W20260810 02:00:46.115154 4220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.195:39189, user_credentials={real_user=slave}} blocked reactor thread for 77219.8us
I20260810 02:00:46.120726 3943 raft_consensus.cc:1217] T 5528e3ba51a640eaa614f141440bb90b P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.9->[1.10-1.10] Dedup: 1.10->[]
I20260810 02:00:46.128563 6369 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:46.133240 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
W20260810 02:00:46.150173 27476 log.cc:927] Time spent T f7a36f7ebd5d4342a259b093e45d4c32 P c5ed5317da9c464b93f979c405f0f6e4: Append to log took a long time: real 0.056s user 0.000s sys 0.000s
I20260810 02:00:46.166052 27476 tablet_bootstrap.cc:492] T f7a36f7ebd5d4342a259b093e45d4c32 P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 02:00:46.178023 27476 tablet_bootstrap.cc:492] T f7a36f7ebd5d4342a259b093e45d4c32 P c5ed5317da9c464b93f979c405f0f6e4: Bootstrap complete.
I20260810 02:00:46.178046 3735 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 02:00:46.178795 27476 ts_tablet_manager.cc:1403] T f7a36f7ebd5d4342a259b093e45d4c32 P c5ed5317da9c464b93f979c405f0f6e4: Time spent bootstrapping tablet: real 0.867s user 0.060s sys 0.027s
I20260810 02:00:46.179780 27476 raft_consensus.cc:359] T f7a36f7ebd5d4342a259b093e45d4c32 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 02:00:46.180085 27476 raft_consensus.cc:740] T f7a36f7ebd5d4342a259b093e45d4c32 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ed5317da9c464b93f979c405f0f6e4, State: Initialized, Role: FOLLOWER
I20260810 02:00:46.185829 27476 consensus_queue.cc:260] T f7a36f7ebd5d4342a259b093e45d4c32 P c5ed5317da9c464b93f979c405f0f6e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 1.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 02:00:46.190305 27476 ts_tablet_manager.cc:1434] T f7a36f7ebd5d4342a259b093e45d4c32 P c5ed5317da9c464b93f979c405f0f6e4: Time spent starting tablet: real 0.011s user 0.001s sys 0.000s
I20260810 02:00:46.198904 3973 tablet_copy_service.cc:342] P 82f93d1d11364ceeb485585b4ae78871: Request end of tablet copy session c5ed5317da9c464b93f979c405f0f6e4-f7a36f7ebd5d4342a259b093e45d4c32 received from {username='slave'} at 127.21.64.199:41929
I20260810 02:00:46.199064 3973 tablet_copy_service.cc:434] P 82f93d1d11364ceeb485585b4ae78871: ending tablet copy session c5ed5317da9c464b93f979c405f0f6e4-f7a36f7ebd5d4342a259b093e45d4c32 on tablet f7a36f7ebd5d4342a259b093e45d4c32 with peer c5ed5317da9c464b93f979c405f0f6e4
I20260810 02:00:46.299909 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:46.335019 6735 raft_consensus.cc:1217] T f7a36f7ebd5d4342a259b093e45d4c32 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.9->[1.10-1.10] Dedup: 1.10->[]
I20260810 02:00:46.359838 6884 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:46.372988 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:46.392501 3917 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:46.401261 3735 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 02:00:46.420403 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:46.424188 6369 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:46.454499 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
W20260810 02:00:46.552891 3670 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.200:32995, user_credentials={real_user=slave}} blocked reactor thread for 59682.4us
I20260810 02:00:46.669195 4311 consensus_queue.cc:237] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
W20260810 02:00:46.702014 4219 consensus_peers.cc:597] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e -> Peer 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197:38787): Couldn't send request to peer 4dd4cba155c941b4b7ad4d64c7431536. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7207ea155ba44c0a9ba216acd22dc1b4. This is attempt 1: this message will repeat every 5th retry.
I20260810 02:00:46.704244 3943 raft_consensus.cc:1275] T 7207ea155ba44c0a9ba216acd22dc1b4 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260810 02:00:46.706395 27333 consensus_queue.cc:1048] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 02:00:46.746387 6735 raft_consensus.cc:1275] T 7207ea155ba44c0a9ba216acd22dc1b4 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260810 02:00:46.747329 27333 consensus_queue.cc:1048] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 02:00:46.752707 27333 raft_consensus.cc:2955] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:46.759169 6735 raft_consensus.cc:2955] T 7207ea155ba44c0a9ba216acd22dc1b4 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:46.771474 3572 catalog_manager.cc:5719] T 7207ea155ba44c0a9ba216acd22dc1b4 P c5ed5317da9c464b93f979c405f0f6e4 reported cstate change: config changed from index 7 to 8, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:46.780534 3943 raft_consensus.cc:2955] T 7207ea155ba44c0a9ba216acd22dc1b4 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:46.837636 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:46.858210 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:46.879300 3917 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:46.902139 6369 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:46.929664 6884 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:47.009621 3735 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 02:00:47.018119 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:47.114385 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:47.131948 27789 ts_tablet_manager.cc:933] T 7207ea155ba44c0a9ba216acd22dc1b4 P 4dd4cba155c941b4b7ad4d64c7431536: Initiating tablet copy from peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943)
I20260810 02:00:47.166426 27789 tablet_copy_client.cc:323] T 7207ea155ba44c0a9ba216acd22dc1b4 P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Beginning tablet copy session from remote peer at address 127.21.64.196:41943
I20260810 02:00:47.168377 4337 tablet_copy_service.cc:140] P ca4469fc2dbc48488bc7ad7f482f129e: Received BeginTabletCopySession request for tablet 7207ea155ba44c0a9ba216acd22dc1b4 from peer 4dd4cba155c941b4b7ad4d64c7431536 ({username='slave'} at 127.21.64.197:55001)
I20260810 02:00:47.168587 4337 tablet_copy_service.cc:161] P ca4469fc2dbc48488bc7ad7f482f129e: Beginning new tablet copy session on tablet 7207ea155ba44c0a9ba216acd22dc1b4 from peer 4dd4cba155c941b4b7ad4d64c7431536 at {username='slave'} at 127.21.64.197:55001: session id = 4dd4cba155c941b4b7ad4d64c7431536-7207ea155ba44c0a9ba216acd22dc1b4
I20260810 02:00:47.171754 4337 tablet_copy_source_session.cc:215] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 02:00:47.173383 27789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7207ea155ba44c0a9ba216acd22dc1b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 02:00:47.187870 27789 tablet_copy_client.cc:806] T 7207ea155ba44c0a9ba216acd22dc1b4 P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Starting download of 0 data blocks...
I20260810 02:00:47.188203 27789 tablet_copy_client.cc:670] T 7207ea155ba44c0a9ba216acd22dc1b4 P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Starting download of 1 WAL segments...
I20260810 02:00:47.190012 27789 tablet_copy_client.cc:538] T 7207ea155ba44c0a9ba216acd22dc1b4 P 4dd4cba155c941b4b7ad4d64c7431536: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 02:00:47.198993 27789 tablet_bootstrap.cc:492] T 7207ea155ba44c0a9ba216acd22dc1b4 P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap starting.
I20260810 02:00:47.316084 27789 tablet_bootstrap.cc:492] T 7207ea155ba44c0a9ba216acd22dc1b4 P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 02:00:47.316653 27789 tablet_bootstrap.cc:492] T 7207ea155ba44c0a9ba216acd22dc1b4 P 4dd4cba155c941b4b7ad4d64c7431536: Bootstrap complete.
I20260810 02:00:47.316993 27789 ts_tablet_manager.cc:1403] T 7207ea155ba44c0a9ba216acd22dc1b4 P 4dd4cba155c941b4b7ad4d64c7431536: Time spent bootstrapping tablet: real 0.118s user 0.071s sys 0.032s
I20260810 02:00:47.317876 27789 raft_consensus.cc:359] T 7207ea155ba44c0a9ba216acd22dc1b4 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 02:00:47.318126 27789 raft_consensus.cc:740] T 7207ea155ba44c0a9ba216acd22dc1b4 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dd4cba155c941b4b7ad4d64c7431536, State: Initialized, Role: FOLLOWER
I20260810 02:00:47.318399 27789 consensus_queue.cc:260] T 7207ea155ba44c0a9ba216acd22dc1b4 P 4dd4cba155c941b4b7ad4d64c7431536 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 02:00:47.319036 27789 ts_tablet_manager.cc:1434] T 7207ea155ba44c0a9ba216acd22dc1b4 P 4dd4cba155c941b4b7ad4d64c7431536: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 02:00:47.320328 4337 tablet_copy_service.cc:342] P ca4469fc2dbc48488bc7ad7f482f129e: Request end of tablet copy session 4dd4cba155c941b4b7ad4d64c7431536-7207ea155ba44c0a9ba216acd22dc1b4 received from {username='slave'} at 127.21.64.197:55001
I20260810 02:00:47.320474 4337 tablet_copy_service.cc:434] P ca4469fc2dbc48488bc7ad7f482f129e: ending tablet copy session 4dd4cba155c941b4b7ad4d64c7431536-7207ea155ba44c0a9ba216acd22dc1b4 on tablet 7207ea155ba44c0a9ba216acd22dc1b4 with peer 4dd4cba155c941b4b7ad4d64c7431536
I20260810 02:00:47.553556 6397 raft_consensus.cc:1217] T 7207ea155ba44c0a9ba216acd22dc1b4 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20260810 02:00:47.593132 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:47.613065 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:47.647265 3756 consensus_queue.cc:237] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 02:00:47.652058 3943 raft_consensus.cc:1275] T 389d3abfeadd4fe6a4efa74427d71c4d P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260810 02:00:47.653156 6735 raft_consensus.cc:1275] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260810 02:00:47.653960 27313 consensus_queue.cc:1048] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260810 02:00:47.655234 27313 consensus_queue.cc:1048] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260810 02:00:47.670410 6884 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:47.702064 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:47.713451 27914 raft_consensus.cc:2955] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:47.739461 6884 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:47.740127 3943 raft_consensus.cc:2955] T 389d3abfeadd4fe6a4efa74427d71c4d P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:47.754479 3568 catalog_manager.cc:5719] T 389d3abfeadd4fe6a4efa74427d71c4d P dc85be7d460a404f997177f57680850f reported cstate change: config changed from index 10 to 11, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:47.755209 6735 raft_consensus.cc:2955] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } }
I20260810 02:00:47.774667 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:47.783267 3917 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:47.797555 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:47.810036 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:47.827242 3917 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:47.842190 6369 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:47.862058 3735 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 02:00:47.873939 3735 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 02:00:47.893729 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:47.902269 6369 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:47.925601 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:48.012068 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:48.057579 4284 tablet_service.cc:1558] Processing DeleteTablet for tablet 389d3abfeadd4fe6a4efa74427d71c4d with delete_type TABLET_DATA_TOMBSTONED (TS ca4469fc2dbc48488bc7ad7f482f129e not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:40788
I20260810 02:00:48.066334 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:48.075902 27965 tablet_replica.cc:333] T 389d3abfeadd4fe6a4efa74427d71c4d P ca4469fc2dbc48488bc7ad7f482f129e: stopping tablet replica
I20260810 02:00:48.077049 6369 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:48.077553 27965 raft_consensus.cc:2243] T 389d3abfeadd4fe6a4efa74427d71c4d P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:48.101293 27965 raft_consensus.cc:2272] T 389d3abfeadd4fe6a4efa74427d71c4d P ca4469fc2dbc48488bc7ad7f482f129e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:48.106359 27965 ts_tablet_manager.cc:1916] T 389d3abfeadd4fe6a4efa74427d71c4d P ca4469fc2dbc48488bc7ad7f482f129e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 02:00:48.125252 6884 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:48.136091 27965 ts_tablet_manager.cc:1929] T 389d3abfeadd4fe6a4efa74427d71c4d P ca4469fc2dbc48488bc7ad7f482f129e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.10
I20260810 02:00:48.144483 27965 log.cc:1199] T 389d3abfeadd4fe6a4efa74427d71c4d P ca4469fc2dbc48488bc7ad7f482f129e: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/wal/wals/389d3abfeadd4fe6a4efa74427d71c4d
I20260810 02:00:48.148233 3917 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260810 02:00:48.149482 3553 catalog_manager.cc:5050] TS ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): tablet 389d3abfeadd4fe6a4efa74427d71c4d (table rebalance_test_table_9 [id=372310cb713644ada1071e8eb628b0c9]) successfully deleted
I20260810 02:00:48.155279 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:48.162580 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:48.243183 3735 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 02:00:48.244153 3827 maintenance_manager.cc:419] P dc85be7d460a404f997177f57680850f: Scheduling FlushMRSOp(b63d0798e1ae4aea9b0272716d53d46d): perf score=0.033345
I20260810 02:00:48.253132 4012 maintenance_manager.cc:419] P 82f93d1d11364ceeb485585b4ae78871: Scheduling FlushMRSOp(b63d0798e1ae4aea9b0272716d53d46d): perf score=0.033352
I20260810 02:00:48.275792 4370 maintenance_manager.cc:419] P ca4469fc2dbc48488bc7ad7f482f129e: Scheduling FlushMRSOp(be4737d169be4419b5a0a0b656a3930f): perf score=0.033356
I20260810 02:00:48.338861 4195 maintenance_manager.cc:419] P 17b49c694faf479ea2e5083470fc0302: Scheduling FlushMRSOp(be4737d169be4419b5a0a0b656a3930f): perf score=0.033379
W20260810 02:00:48.495520 4038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.198:45317, user_credentials={real_user=slave}} blocked reactor thread for 45095.9us
I20260810 02:00:48.555316 4043 maintenance_manager.cc:643] P 17b49c694faf479ea2e5083470fc0302: FlushMRSOp(be4737d169be4419b5a0a0b656a3930f) complete. Timing: real 0.216s user 0.074s sys 0.046s Metrics: {"bytes_written":6144,"cfile_init":1,"compiler_manager_pool.queue_time_us":7088,"dirs.queue_time_us":22193,"dirs.run_cpu_time_us":235,"dirs.run_wall_time_us":2144,"drs_written":1,"lbm_read_time_us":114,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1069,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":689,"thread_start_us":32506,"threads_started":3,"wal-append.queue_time_us":3033}
I20260810 02:00:48.564121 4195 maintenance_manager.cc:419] P 17b49c694faf479ea2e5083470fc0302: Scheduling UndoDeltaBlockGCOp(be4737d169be4419b5a0a0b656a3930f): 4919 bytes on disk
I20260810 02:00:48.570662 4043 maintenance_manager.cc:643] P 17b49c694faf479ea2e5083470fc0302: UndoDeltaBlockGCOp(be4737d169be4419b5a0a0b656a3930f) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":102,"lbm_reads_lt_1ms":4}
W20260810 02:00:48.652779 3674 dir_manager.cc:275] Insufficient disk space under path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/data/data: will retry after 10 seconds: IO error: Insufficient disk space to allocate 0 bytes under path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-0/data/data (513806336 bytes available vs 518351011 bytes reserved) (error 28)
W20260810 02:00:48.699489 3859 dir_manager.cc:275] Insufficient disk space under path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/data/data: will retry after 10 seconds: IO error: Insufficient disk space to allocate 0 bytes under path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-1/data/data (513789952 bytes available vs 518351011 bytes reserved) (error 28)
W20260810 02:00:48.705619 4225 dir_manager.cc:275] Insufficient disk space under path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/data/data: will retry after 10 seconds: IO error: Insufficient disk space to allocate 0 bytes under path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/data/data (513789952 bytes available vs 518351011 bytes reserved) (error 28)
W20260810 02:00:48.746795 3674 tablet_replica_mm_ops.cc:214] T b63d0798e1ae4aea9b0272716d53d46d P dc85be7d460a404f997177f57680850f: failed to flush MRS: IO error: Failed to open DiskRowSet for flush: No directories could be added (1 dirs total, 0 failed, 1 full): IO error: No directories available in b63d0798e1ae4aea9b0272716d53d46d's directory group (1 dirs total, 0 failed, 1 full) (error 28) (error 19)
I20260810 02:00:48.747617 4311 consensus_queue.cc:237] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
F20260810 02:00:48.748231 3674 tablet_replica_mm_ops.cc:215] Check failed: tablet->HasBeenStopped() Unrecoverable flush failure caused by error: IO error: Failed to open DiskRowSet for flush: No directories could be added (1 dirs total, 0 failed, 1 full): IO error: No directories available in b63d0798e1ae4aea9b0272716d53d46d's directory group (1 dirs total, 0 failed, 1 full) (error 28) (error 19)
*** Check failure stack trace: ***
I20260810 02:00:48.758334 6397 raft_consensus.cc:1275] T 7207ea155ba44c0a9ba216acd22dc1b4 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260810 02:00:48.759158 3945 raft_consensus.cc:1275] T 7207ea155ba44c0a9ba216acd22dc1b4 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Refusing update from remote peer ca4469fc2dbc48488bc7ad7f482f129e: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260810 02:00:48.759270 27333 consensus_queue.cc:1048] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 02:00:48.760102 27333 consensus_queue.cc:1048] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 02:00:48.771010 3756 consensus_queue.cc:237] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
@ 0x7f556fb85d5d google::LogMessage::Fail() at ??:0
I20260810 02:00:48.789031 3945 raft_consensus.cc:2955] T 7207ea155ba44c0a9ba216acd22dc1b4 P 82f93d1d11364ceeb485585b4ae78871 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:48.790498 6909 raft_consensus.cc:1275] T abf302f27a12414a8647dab82ab8101f P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260810 02:00:48.791112 27914 consensus_queue.cc:1048] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260810 02:00:48.792099 3859 tablet_replica_mm_ops.cc:214] T b63d0798e1ae4aea9b0272716d53d46d P 82f93d1d11364ceeb485585b4ae78871: failed to flush MRS: IO error: Failed to open DiskRowSet for flush: No directories could be added (1 dirs total, 0 failed, 1 full): IO error: No directories available in b63d0798e1ae4aea9b0272716d53d46d's directory group (1 dirs total, 0 failed, 1 full) (error 28) (error 19)
F20260810 02:00:48.792202 3859 tablet_replica_mm_ops.cc:215] Check failed: tablet->HasBeenStopped() Unrecoverable flush failure caused by error: IO error: Failed to open DiskRowSet for flush: No directories could be added (1 dirs total, 0 failed, 1 full): IO error: No directories available in b63d0798e1ae4aea9b0272716d53d46d's directory group (1 dirs total, 0 failed, 1 full) (error 28) (error 19)
*** Check failure stack trace: ***
I20260810 02:00:48.787770 28060 raft_consensus.cc:2955] T 7207ea155ba44c0a9ba216acd22dc1b4 P ca4469fc2dbc48488bc7ad7f482f129e [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:48.796027 3572 catalog_manager.cc:5719] T 7207ea155ba44c0a9ba216acd22dc1b4 P 82f93d1d11364ceeb485585b4ae78871 reported cstate change: config changed from index 8 to 9, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) evicted. New cstate: current_term: 1 leader_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:48.798462 4131 raft_consensus.cc:1275] T abf302f27a12414a8647dab82ab8101f P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Refusing update from remote peer dc85be7d460a404f997177f57680850f: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260810 02:00:48.799201 27914 consensus_queue.cc:1048] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260810 02:00:48.826486 6397 raft_consensus.cc:2955] T 7207ea155ba44c0a9ba216acd22dc1b4 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:48.834674 28068 raft_consensus.cc:2955] T abf302f27a12414a8647dab82ab8101f P dc85be7d460a404f997177f57680850f [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:48.839069 4131 raft_consensus.cc:2955] T abf302f27a12414a8647dab82ab8101f P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
@ 0x7fc69ca53d5d google::LogMessage::Fail() at ??:0
I20260810 02:00:48.859436 3563 catalog_manager.cc:5719] T abf302f27a12414a8647dab82ab8101f P 17b49c694faf479ea2e5083470fc0302 reported cstate change: config changed from index 10 to 11, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) evicted. New cstate: current_term: 1 leader_uuid: "dc85be7d460a404f997177f57680850f" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
@ 0x7f556fb89b23 google::LogMessage::SendToLog() at ??:0
I20260810 02:00:48.871687 6715 tablet_service.cc:1558] Processing DeleteTablet for tablet 7207ea155ba44c0a9ba216acd22dc1b4 with delete_type TABLET_DATA_TOMBSTONED (TS c5ed5317da9c464b93f979c405f0f6e4 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:58550
I20260810 02:00:48.873502 6909 raft_consensus.cc:2955] T abf302f27a12414a8647dab82ab8101f P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:48.880424 6714 tablet_service.cc:1558] Processing DeleteTablet for tablet abf302f27a12414a8647dab82ab8101f with delete_type TABLET_DATA_TOMBSTONED (TS c5ed5317da9c464b93f979c405f0f6e4 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:58550
@ 0x7fc69ca57b23 google::LogMessage::SendToLog() at ??:0
@ 0x7fc69ca5375c google::LogMessage::Flush() at ??:0
@ 0x7f556fb8575c google::LogMessage::Flush() at ??:0
W20260810 02:00:48.895766 4225 dir_manager.cc:275] Insufficient disk space under path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/data/data: will retry after 10 seconds: IO error: Insufficient disk space to allocate 0 bytes under path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-3/data/data (480186368 bytes available vs 518351011 bytes reserved) (error 28)
@ 0x7f556fb86ee9 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fc69ca54ee9 google::LogMessageFatal::~LogMessageFatal() at ??:0
I20260810 02:00:48.911739 28080 tablet_replica.cc:333] T 7207ea155ba44c0a9ba216acd22dc1b4 P c5ed5317da9c464b93f979c405f0f6e4: stopping tablet replica
I20260810 02:00:48.911981 28080 raft_consensus.cc:2243] T 7207ea155ba44c0a9ba216acd22dc1b4 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:48.912249 28080 raft_consensus.cc:2272] T 7207ea155ba44c0a9ba216acd22dc1b4 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:48.913092 28080 ts_tablet_manager.cc:1916] T 7207ea155ba44c0a9ba216acd22dc1b4 P c5ed5317da9c464b93f979c405f0f6e4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260810 02:00:48.939741 28080 ts_tablet_manager.cc:1929] T 7207ea155ba44c0a9ba216acd22dc1b4 P c5ed5317da9c464b93f979c405f0f6e4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20260810 02:00:48.939884 28080 log.cc:1199] T 7207ea155ba44c0a9ba216acd22dc1b4 P c5ed5317da9c464b93f979c405f0f6e4: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/wal/wals/7207ea155ba44c0a9ba216acd22dc1b4
I20260810 02:00:48.940809 3554 catalog_manager.cc:5050] TS c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199:41689): tablet 7207ea155ba44c0a9ba216acd22dc1b4 (table rebalance_test_table_2 [id=5e8751d351ba4b7da7861e02b0c3c634]) successfully deleted
I20260810 02:00:48.946343 28080 tablet_replica.cc:333] T abf302f27a12414a8647dab82ab8101f P c5ed5317da9c464b93f979c405f0f6e4: stopping tablet replica
I20260810 02:00:48.946594 28080 raft_consensus.cc:2243] T abf302f27a12414a8647dab82ab8101f P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 02:00:48.946772 28080 raft_consensus.cc:2272] T abf302f27a12414a8647dab82ab8101f P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 02:00:48.947695 28080 ts_tablet_manager.cc:1916] T abf302f27a12414a8647dab82ab8101f P c5ed5317da9c464b93f979c405f0f6e4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
@ 0x7fc6acbd18bd kudu::tablet::FlushMRSOp::Perform() at ??:0
@ 0x7f557fd038bd kudu::tablet::FlushMRSOp::Perform() at ??:0
@ 0x7fc69f825b09 kudu::MaintenanceManager::LaunchOp() at ??:0
@ 0x7f5572957b09 kudu::MaintenanceManager::LaunchOp() at ??:0
I20260810 02:00:48.991811 28080 ts_tablet_manager.cc:1929] T abf302f27a12414a8647dab82ab8101f P c5ed5317da9c464b93f979c405f0f6e4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.10
I20260810 02:00:48.994855 28080 log.cc:1199] T abf302f27a12414a8647dab82ab8101f P c5ed5317da9c464b93f979c405f0f6e4: Deleting WAL directory at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0/raft_consensus-itest-cluster/ts-6/wal/wals/abf302f27a12414a8647dab82ab8101f
I20260810 02:00:48.995784 3554 catalog_manager.cc:5050] TS c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199:41689): tablet abf302f27a12414a8647dab82ab8101f (table rebalance_test_table_6 [id=5b2df46262b142169af9a32c47535432]) successfully deleted
@ 0x7f557295aa43 kudu::MaintenanceManager::RunSchedulerThread()::$_3::operator()() at ??:0
@ 0x7fc69f828a43 kudu::MaintenanceManager::RunSchedulerThread()::$_3::operator()() at ??:0
@ 0x7f557295a8d9 std::_Function_handler<>::_M_invoke() at ??:0
I20260810 02:00:49.020596 3945 consensus_queue.cc:237] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 1.13, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
@ 0xaaf86d std::function<>::operator()() at ??:?
@ 0x7fc69f8288d9 std::_Function_handler<>::_M_invoke() at ??:0
W20260810 02:00:49.032213 3857 consensus_peers.cc:597] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 -> Peer 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317): Couldn't send request to peer 22ce0e487f0341fd9bf853393d6e7683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fe8e1f0908234e46881258cfe79835f8. This is attempt 1: this message will repeat every 5th retry.
@ 0xaaf86d std::function<>::operator()() at ??:?
I20260810 02:00:49.033474 6735 raft_consensus.cc:1275] T fe8e1f0908234e46881258cfe79835f8 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 13. Preceding OpId from leader: term: 1 index: 14. (index mismatch)
I20260810 02:00:49.034322 27966 consensus_queue.cc:1048] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
@ 0x7f55728ce850 kudu::ThreadPool::DispatchThread() at ??:0
I20260810 02:00:49.041414 6397 raft_consensus.cc:1275] T fe8e1f0908234e46881258cfe79835f8 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Refusing update from remote peer 82f93d1d11364ceeb485585b4ae78871: Log matching property violated. Preceding OpId in replica: term: 1 index: 13. Preceding OpId from leader: term: 1 index: 14. (index mismatch)
I20260810 02:00:49.042151 27966 consensus_queue.cc:1048] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
@ 0x7f55728d1b4c kudu::ThreadPool::CreateThread()::$_1::operator()() at ??:0
@ 0x7f55728d19c9 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7fc69f79c850 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fc69f79fb4c kudu::ThreadPool::CreateThread()::$_1::operator()() at ??:0
I20260810 02:00:49.094326 28136 raft_consensus.cc:2955] T fe8e1f0908234e46881258cfe79835f8 P 82f93d1d11364ceeb485585b4ae78871 [term 1 LEADER]: Committing config change with OpId 1.14: config changed from index 13 to 14, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
@ 0xaaf86d std::function<>::operator()() at ??:?
I20260810 02:00:49.098642 6735 raft_consensus.cc:2955] T fe8e1f0908234e46881258cfe79835f8 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Committing config change with OpId 1.14: config changed from index 13 to 14, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
@ 0x7fc69f79f9c9 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7f55728addd9 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f5575f7d6db start_thread at ??:0
@ 0x7f556ea3461f clone at ??:0
I20260810 02:00:49.132961 3563 catalog_manager.cc:5719] T fe8e1f0908234e46881258cfe79835f8 P c5ed5317da9c464b93f979c405f0f6e4 reported cstate change: config changed from index 13 to 14, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New cstate: current_term: 1 leader_uuid: "82f93d1d11364ceeb485585b4ae78871" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
@ 0xaaf86d std::function<>::operator()() at ??:?
@ 0x7fc69f77bdd9 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fc6a2e4b6db start_thread at ??:0
I20260810 02:00:49.224475 6397 raft_consensus.cc:2955] T fe8e1f0908234e46881258cfe79835f8 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Committing config change with OpId 1.14: config changed from index 13 to 14, VOTER 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
@ 0x7fc69b90261f clone at ??:0
I20260810 02:00:49.348482 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:49.359697 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:49.406908 6369 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:49.408891 6884 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:49.418809 4284 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260810 02:00:49.542490 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
W20260810 02:00:49.603590 4222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.198:45317, user_credentials={real_user=slave}} blocked reactor thread for 172302us
I20260810 02:00:49.604159 4225 maintenance_manager.cc:643] P ca4469fc2dbc48488bc7ad7f482f129e: FlushMRSOp(be4737d169be4419b5a0a0b656a3930f) complete. Timing: real 1.328s user 0.104s sys 0.163s Metrics: {"bytes_written":6144,"cfile_init":1,"compiler_manager_pool.queue_time_us":75938,"dirs.queue_time_us":104799,"dirs.run_cpu_time_us":350,"dirs.run_wall_time_us":12873,"drs_written":1,"lbm_read_time_us":166,"lbm_reads_lt_1ms":4,"lbm_write_time_us":37257,"lbm_writes_10-100_ms":1,"lbm_writes_lt_1ms":22,"peak_mem_usage":0,"rows_written":689,"thread_start_us":353569,"threads_started":3,"wal-append.queue_time_us":168799}
I20260810 02:00:49.612099 4370 maintenance_manager.cc:419] P ca4469fc2dbc48488bc7ad7f482f129e: Scheduling FlushMRSOp(a586b7d625bb4c27a6343ae7918c8cea): perf score=0.033359
W20260810 02:00:49.615831 4225 tablet_replica_mm_ops.cc:214] T a586b7d625bb4c27a6343ae7918c8cea P ca4469fc2dbc48488bc7ad7f482f129e: failed to flush MRS: IO error: Failed to open DiskRowSet for flush: tablet a586b7d625bb4c27a6343ae7918c8cea: unable to open output file for column key INT32 NOT NULL: No directories could be added (1 dirs total, 0 failed, 1 full): IO error: No directories available in a586b7d625bb4c27a6343ae7918c8cea's directory group (1 dirs total, 0 failed, 1 full) (error 28) (error 19)
F20260810 02:00:49.615928 4225 tablet_replica_mm_ops.cc:215] Check failed: tablet->HasBeenStopped() Unrecoverable flush failure caused by error: IO error: Failed to open DiskRowSet for flush: tablet a586b7d625bb4c27a6343ae7918c8cea: unable to open output file for column key INT32 NOT NULL: No directories could be added (1 dirs total, 0 failed, 1 full): IO error: No directories available in a586b7d625bb4c27a6343ae7918c8cea's directory group (1 dirs total, 0 failed, 1 full) (error 28) (error 19)
*** Check failure stack trace: ***
@ 0x7f630920fd5d google::LogMessage::Fail() at ??:0
@ 0x7f6309213b23 google::LogMessage::SendToLog() at ??:0
@ 0x7f630920f75c google::LogMessage::Flush() at ??:0
@ 0x7f6309210ee9 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f631938d8bd kudu::tablet::FlushMRSOp::Perform() at ??:0
@ 0x7f630bfe1b09 kudu::MaintenanceManager::LaunchOp() at ??:0
@ 0x7f630bfe4a43 kudu::MaintenanceManager::RunSchedulerThread()::$_3::operator()() at ??:0
@ 0x7f630bfe48d9 std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaaf86d std::function<>::operator()() at ??:?
@ 0x7f630bf58850 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f630bf5bb4c kudu::ThreadPool::CreateThread()::$_1::operator()() at ??:0
@ 0x7f630bf5b9c9 std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaaf86d std::function<>::operator()() at ??:?
@ 0x7f630bf37dd9 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f630f6076db start_thread at ??:0
@ 0x7f63080be61f clone at ??:0
I20260810 02:00:49.991405 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
W20260810 02:00:49.994089 6824 connection.cc:573] client connection to 127.21.64.193:36797 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 02:00:49.994333 6824 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 02:00:49.994419 4036 connection.cc:573] client connection to 127.21.64.193:36797 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 02:00:49.994596 4036 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 02:00:50.008949 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:50.028632 4105 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:50.068171 6369 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:50.075659 6884 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:50.091356 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
W20260810 02:00:50.092202 28279 negotiation.cc:336] Failed RPC negotiation. Trace:
0810 02:00:50.032099 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.21.64.193:36797 (local address 127.21.64.195:46827)
0810 02:00:50.036767 (+ 4668us) negotiation.cc:107] Waiting for socket to connect
0810 02:00:50.036787 (+ 20us) client_negotiation.cc:175] Beginning negotiation
0810 02:00:50.036912 (+ 125us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0810 02:00:50.091591 (+ 54679us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.64.193:36797: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":4559,"thread_start_us":4451,"threads_started":1}
W20260810 02:00:50.092403 4036 consensus_peers.cc:597] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 -> Peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797): Couldn't send request to peer dc85be7d460a404f997177f57680850f. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.193:36797: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
W20260810 02:00:50.092528 4036 consensus_peers.cc:597] T f3d04e9457c944a8a72861680bdf9b7c P 17b49c694faf479ea2e5083470fc0302 -> Peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797): Couldn't send request to peer dc85be7d460a404f997177f57680850f. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.193:36797: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
W20260810 02:00:50.094555 28277 negotiation.cc:336] Failed RPC negotiation. Trace:
0810 02:00:50.011238 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.21.64.193:36797 (local address 127.21.64.200:56593)
0810 02:00:50.072354 (+ 61116us) negotiation.cc:107] Waiting for socket to connect
0810 02:00:50.072373 (+ 19us) client_negotiation.cc:175] Beginning negotiation
0810 02:00:50.072490 (+ 117us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0810 02:00:50.082904 (+ 10414us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.64.193:36797: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":61019,"thread_start_us":62151,"threads_started":1}
W20260810 02:00:50.094803 6824 consensus_peers.cc:597] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227 -> Peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797): Couldn't send request to peer dc85be7d460a404f997177f57680850f. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.193:36797: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
I20260810 02:00:50.106323 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:50.129272 6884 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:50.144281 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:50.173446 6369 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:50.175019 28109 raft_consensus.cc:493] T e70193bd4055469d870a76542eaef524 P 22ce0e487f0341fd9bf853393d6e7683 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 82f93d1d11364ceeb485585b4ae78871)
I20260810 02:00:50.175184 28109 raft_consensus.cc:515] T e70193bd4055469d870a76542eaef524 P 22ce0e487f0341fd9bf853393d6e7683 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 02:00:50.195348 28109 leader_election.cc:290] T e70193bd4055469d870a76542eaef524 P 22ce0e487f0341fd9bf853393d6e7683 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893), ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943)
I20260810 02:00:50.270398 28109 raft_consensus.cc:493] T 57f6f22d97c14ed98960e27ce2c8f3fb P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dc85be7d460a404f997177f57680850f)
I20260810 02:00:50.270604 28109 raft_consensus.cc:515] T 57f6f22d97c14ed98960e27ce2c8f3fb P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 02:00:50.271602 28109 leader_election.cc:290] T 57f6f22d97c14ed98960e27ce2c8f3fb P 22ce0e487f0341fd9bf853393d6e7683 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dc85be7d460a404f997177f57680850f (127.21.64.193:36797), 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197:38787)
W20260810 02:00:50.272970 6655 connection.cc:573] client connection to 127.21.64.194:43893 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 02:00:50.273017 6311 connection.cc:573] server connection from 127.21.64.194:40151 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 02:00:50.273186 6655 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 02:00:50.273422 6479 connection.cc:573] client connection to 127.21.64.194:43893 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 02:00:50.273672 6479 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 02:00:50.298795 6479 leader_election.cc:336] T e70193bd4055469d870a76542eaef524 P 22ce0e487f0341fd9bf853393d6e7683 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): Network error: Client connection negotiation failed: client connection to 127.21.64.194:43893: connect: Connection refused (error 111)
I20260810 02:00:50.339438 26968 raft_consensus.cc:493] T abf302f27a12414a8647dab82ab8101f P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dc85be7d460a404f997177f57680850f)
I20260810 02:00:50.339625 26968 raft_consensus.cc:515] T abf302f27a12414a8647dab82ab8101f P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 02:00:50.340449 26968 leader_election.cc:290] T abf302f27a12414a8647dab82ab8101f P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dc85be7d460a404f997177f57680850f (127.21.64.193:36797), 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995)
I20260810 02:00:50.341753 6909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf302f27a12414a8647dab82ab8101f" candidate_uuid: "17b49c694faf479ea2e5083470fc0302" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "3136daf7101445beadc1aa19bc01c227" is_pre_election: true
W20260810 02:00:50.343611 4036 leader_election.cc:336] T abf302f27a12414a8647dab82ab8101f P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797): Network error: Client connection negotiation failed: client connection to 127.21.64.193:36797: connect: Connection refused (error 111)
I20260810 02:00:50.343740 4036 leader_election.cc:304] T abf302f27a12414a8647dab82ab8101f P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17b49c694faf479ea2e5083470fc0302; no voters: 3136daf7101445beadc1aa19bc01c227, dc85be7d460a404f997177f57680850f
I20260810 02:00:50.344189 26968 raft_consensus.cc:2749] T abf302f27a12414a8647dab82ab8101f P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 02:00:50.344493 28303 raft_consensus.cc:493] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dc85be7d460a404f997177f57680850f)
I20260810 02:00:50.344668 28303 raft_consensus.cc:515] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 02:00:50.355615 28303 leader_election.cc:290] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dc85be7d460a404f997177f57680850f (127.21.64.193:36797), 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
W20260810 02:00:50.358330 6477 leader_election.cc:336] T 57f6f22d97c14ed98960e27ce2c8f3fb P 22ce0e487f0341fd9bf853393d6e7683 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797): Network error: Client connection negotiation failed: client connection to 127.21.64.193:36797: connect: Connection refused (error 111)
I20260810 02:00:50.360853 6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6f22d97c14ed98960e27ce2c8f3fb" candidate_uuid: "22ce0e487f0341fd9bf853393d6e7683" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "4dd4cba155c941b4b7ad4d64c7431536" is_pre_election: true
I20260810 02:00:50.361788 6477 leader_election.cc:304] T 57f6f22d97c14ed98960e27ce2c8f3fb P 22ce0e487f0341fd9bf853393d6e7683 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22ce0e487f0341fd9bf853393d6e7683; no voters: 4dd4cba155c941b4b7ad4d64c7431536, dc85be7d460a404f997177f57680850f
I20260810 02:00:50.362144 28109 raft_consensus.cc:2749] T 57f6f22d97c14ed98960e27ce2c8f3fb P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 02:00:50.362818 6653 leader_election.cc:336] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797): Network error: Client connection negotiation failed: client connection to 127.21.64.193:36797: connect: Connection refused (error 111)
I20260810 02:00:50.374665 27470 raft_consensus.cc:493] T abf302f27a12414a8647dab82ab8101f P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dc85be7d460a404f997177f57680850f)
I20260810 02:00:50.374894 27470 raft_consensus.cc:515] T abf302f27a12414a8647dab82ab8101f P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 02:00:50.376051 27470 leader_election.cc:290] T abf302f27a12414a8647dab82ab8101f P 3136daf7101445beadc1aa19bc01c227 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dc85be7d460a404f997177f57680850f (127.21.64.193:36797), 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189)
I20260810 02:00:50.377810 4131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf302f27a12414a8647dab82ab8101f" candidate_uuid: "3136daf7101445beadc1aa19bc01c227" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "17b49c694faf479ea2e5083470fc0302" is_pre_election: true
I20260810 02:00:50.378077 4131 raft_consensus.cc:2468] T abf302f27a12414a8647dab82ab8101f P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3136daf7101445beadc1aa19bc01c227 in term 1.
W20260810 02:00:50.372634 6655 consensus_peers.cc:597] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4 -> Peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): Couldn't send request to peer 82f93d1d11364ceeb485585b4ae78871. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.194:43893: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 02:00:50.379117 6825 leader_election.cc:304] T abf302f27a12414a8647dab82ab8101f P 3136daf7101445beadc1aa19bc01c227 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17b49c694faf479ea2e5083470fc0302, 3136daf7101445beadc1aa19bc01c227; no voters:
W20260810 02:00:50.380738 6824 leader_election.cc:336] T abf302f27a12414a8647dab82ab8101f P 3136daf7101445beadc1aa19bc01c227 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797): Network error: Client connection negotiation failed: client connection to 127.21.64.193:36797: connect: Connection refused (error 111)
I20260810 02:00:50.381319 27470 raft_consensus.cc:2804] T abf302f27a12414a8647dab82ab8101f P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 02:00:50.381449 27470 raft_consensus.cc:493] T abf302f27a12414a8647dab82ab8101f P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dc85be7d460a404f997177f57680850f)
I20260810 02:00:50.381538 27470 raft_consensus.cc:3060] T abf302f27a12414a8647dab82ab8101f P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Advancing to term 2
I20260810 02:00:50.386699 27470 raft_consensus.cc:515] T abf302f27a12414a8647dab82ab8101f P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
W20260810 02:00:50.388782 6824 leader_election.cc:336] T abf302f27a12414a8647dab82ab8101f P 3136daf7101445beadc1aa19bc01c227 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797): Network error: Client connection negotiation failed: client connection to 127.21.64.193:36797: connect: Connection refused (error 111)
I20260810 02:00:50.389603 4131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf302f27a12414a8647dab82ab8101f" candidate_uuid: "3136daf7101445beadc1aa19bc01c227" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "17b49c694faf479ea2e5083470fc0302"
I20260810 02:00:50.389783 4131 raft_consensus.cc:3060] T abf302f27a12414a8647dab82ab8101f P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Advancing to term 2
I20260810 02:00:50.390450 28321 raft_consensus.cc:493] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dc85be7d460a404f997177f57680850f)
I20260810 02:00:50.390578 28321 raft_consensus.cc:515] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
W20260810 02:00:50.392432 6824 leader_election.cc:336] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797): Network error: Client connection negotiation failed: client connection to 127.21.64.193:36797: connect: Connection refused (error 111)
I20260810 02:00:50.393038 4131 raft_consensus.cc:2468] T abf302f27a12414a8647dab82ab8101f P 17b49c694faf479ea2e5083470fc0302 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3136daf7101445beadc1aa19bc01c227 in term 2.
I20260810 02:00:50.393570 6825 leader_election.cc:304] T abf302f27a12414a8647dab82ab8101f P 3136daf7101445beadc1aa19bc01c227 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17b49c694faf479ea2e5083470fc0302, 3136daf7101445beadc1aa19bc01c227; no voters: dc85be7d460a404f997177f57680850f
I20260810 02:00:50.394148 6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252899385eaa45b392974d2768e3cf01" candidate_uuid: "3136daf7101445beadc1aa19bc01c227" candidate_term: 2 candidate_status { last_received { term: 1 index: 21 } } ignore_live_leader: false dest_uuid: "4dd4cba155c941b4b7ad4d64c7431536" is_pre_election: true
I20260810 02:00:50.394459 28321 leader_election.cc:290] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dc85be7d460a404f997177f57680850f (127.21.64.193:36797), 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197:38787)
I20260810 02:00:50.394620 28321 raft_consensus.cc:2804] T abf302f27a12414a8647dab82ab8101f P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 02:00:50.394758 28321 raft_consensus.cc:697] T abf302f27a12414a8647dab82ab8101f P 3136daf7101445beadc1aa19bc01c227 [term 2 LEADER]: Becoming Leader. State: Replica: 3136daf7101445beadc1aa19bc01c227, State: Running, Role: LEADER
I20260810 02:00:50.394903 6824 leader_election.cc:304] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3136daf7101445beadc1aa19bc01c227; no voters: 4dd4cba155c941b4b7ad4d64c7431536, dc85be7d460a404f997177f57680850f
I20260810 02:00:50.395059 28321 consensus_queue.cc:237] T abf302f27a12414a8647dab82ab8101f P 3136daf7101445beadc1aa19bc01c227 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 11, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 02:00:50.401955 26947 raft_consensus.cc:493] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dc85be7d460a404f997177f57680850f)
I20260810 02:00:50.402151 26947 raft_consensus.cc:515] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 02:00:50.403203 26947 leader_election.cc:290] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dc85be7d460a404f997177f57680850f (127.21.64.193:36797), 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995)
I20260810 02:00:50.406661 27470 leader_election.cc:290] T abf302f27a12414a8647dab82ab8101f P 3136daf7101445beadc1aa19bc01c227 [CANDIDATE]: Term 2 election: Requested vote from peers dc85be7d460a404f997177f57680850f (127.21.64.193:36797), 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189)
I20260810 02:00:50.407387 27470 raft_consensus.cc:2749] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 02:00:50.407619 27470 raft_consensus.cc:493] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 82f93d1d11364ceeb485585b4ae78871)
I20260810 02:00:50.407773 27470 raft_consensus.cc:515] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 02:00:50.409183 27470 leader_election.cc:290] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 3136daf7101445beadc1aa19bc01c227 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893), 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189)
W20260810 02:00:50.410351 6826 leader_election.cc:336] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 3136daf7101445beadc1aa19bc01c227 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): Network error: Client connection negotiation failed: client connection to 127.21.64.194:43893: connect: Connection refused (error 111)
W20260810 02:00:50.411057 6655 leader_election.cc:336] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): Network error: Client connection negotiation failed: client connection to 127.21.64.194:43893: connect: Connection refused (error 111)
I20260810 02:00:50.411203 6655 leader_election.cc:304] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ed5317da9c464b93f979c405f0f6e4; no voters: 82f93d1d11364ceeb485585b4ae78871, dc85be7d460a404f997177f57680850f
I20260810 02:00:50.411837 28303 raft_consensus.cc:2749] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 02:00:50.424222 6308 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.64.193:36797: connect: Connection refused (error 111)
I20260810 02:00:50.432511 4131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a93b1a1ce1440b99bdd7a3bcf49064" candidate_uuid: "3136daf7101445beadc1aa19bc01c227" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "17b49c694faf479ea2e5083470fc0302" is_pre_election: true
I20260810 02:00:50.433645 6909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252899385eaa45b392974d2768e3cf01" candidate_uuid: "4dd4cba155c941b4b7ad4d64c7431536" candidate_term: 2 candidate_status { last_received { term: 1 index: 21 } } ignore_live_leader: false dest_uuid: "3136daf7101445beadc1aa19bc01c227" is_pre_election: true
I20260810 02:00:50.433871 6909 raft_consensus.cc:2468] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dd4cba155c941b4b7ad4d64c7431536 in term 1.
I20260810 02:00:50.434366 6825 leader_election.cc:304] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 3136daf7101445beadc1aa19bc01c227 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3136daf7101445beadc1aa19bc01c227; no voters: 17b49c694faf479ea2e5083470fc0302, 82f93d1d11364ceeb485585b4ae78871
I20260810 02:00:50.434583 6308 leader_election.cc:304] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3136daf7101445beadc1aa19bc01c227, 4dd4cba155c941b4b7ad4d64c7431536; no voters:
I20260810 02:00:50.434890 28324 raft_consensus.cc:2749] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 02:00:50.435140 26947 raft_consensus.cc:2804] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 02:00:50.435216 26947 raft_consensus.cc:493] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dc85be7d460a404f997177f57680850f)
I20260810 02:00:50.435277 26947 raft_consensus.cc:3060] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Advancing to term 2
W20260810 02:00:50.438747 4038 connection.cc:573] client connection to 127.21.64.196:41943 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 02:00:50.439556 6311 connection.cc:573] client connection to 127.21.64.196:41943 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 02:00:50.440518 28279 negotiation.cc:336] Failed RPC negotiation. Trace:
0810 02:00:50.439509 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.21.64.196:41943 (local address 127.21.64.195:42157)
0810 02:00:50.439760 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0810 02:00:50.439779 (+ 19us) client_negotiation.cc:175] Beginning negotiation
0810 02:00:50.439899 (+ 120us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0810 02:00:50.440328 (+ 429us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.64.196:41943: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":151}
W20260810 02:00:50.440671 6479 connection.cc:573] client connection to 127.21.64.196:41943 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 02:00:50.441095 4038 consensus_peers.cc:597] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 -> Peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): Couldn't send request to peer ca4469fc2dbc48488bc7ad7f482f129e. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.196:41943: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
I20260810 02:00:50.438370 26947 raft_consensus.cc:515] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 02:00:50.450160 26947 leader_election.cc:290] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536 [CANDIDATE]: Term 2 election: Requested vote from peers dc85be7d460a404f997177f57680850f (127.21.64.193:36797), 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995)
W20260810 02:00:50.454054 6479 leader_election.cc:336] T e70193bd4055469d870a76542eaef524 P 22ce0e487f0341fd9bf853393d6e7683 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): Network error: Client connection negotiation failed: client connection to 127.21.64.196:41943: connect: Connection refused (error 111)
I20260810 02:00:50.454180 6479 leader_election.cc:304] T e70193bd4055469d870a76542eaef524 P 22ce0e487f0341fd9bf853393d6e7683 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22ce0e487f0341fd9bf853393d6e7683; no voters: 82f93d1d11364ceeb485585b4ae78871, ca4469fc2dbc48488bc7ad7f482f129e
I20260810 02:00:50.454664 28109 raft_consensus.cc:2749] T e70193bd4055469d870a76542eaef524 P 22ce0e487f0341fd9bf853393d6e7683 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260810 02:00:50.455952 6308 leader_election.cc:336] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797): Network error: Client connection negotiation failed: client connection to 127.21.64.193:36797: connect: Connection refused (error 111)
I20260810 02:00:50.456693 3572 catalog_manager.cc:5719] T abf302f27a12414a8647dab82ab8101f P 3136daf7101445beadc1aa19bc01c227 reported cstate change: term changed from 1 to 2, leader changed from dc85be7d460a404f997177f57680850f (127.21.64.193) to 3136daf7101445beadc1aa19bc01c227 (127.21.64.200). New cstate: current_term: 2 leader_uuid: "3136daf7101445beadc1aa19bc01c227" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:50.456949 26947 raft_consensus.cc:493] T 57f6f22d97c14ed98960e27ce2c8f3fb P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dc85be7d460a404f997177f57680850f)
I20260810 02:00:50.457078 26947 raft_consensus.cc:515] T 57f6f22d97c14ed98960e27ce2c8f3fb P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 02:00:50.457914 26947 leader_election.cc:290] T 57f6f22d97c14ed98960e27ce2c8f3fb P 4dd4cba155c941b4b7ad4d64c7431536 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dc85be7d460a404f997177f57680850f (127.21.64.193:36797), 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317)
I20260810 02:00:50.458155 6567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6f22d97c14ed98960e27ce2c8f3fb" candidate_uuid: "4dd4cba155c941b4b7ad4d64c7431536" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "22ce0e487f0341fd9bf853393d6e7683" is_pre_election: true
I20260810 02:00:50.458392 6567 raft_consensus.cc:2468] T 57f6f22d97c14ed98960e27ce2c8f3fb P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dd4cba155c941b4b7ad4d64c7431536 in term 1.
I20260810 02:00:50.458806 6909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252899385eaa45b392974d2768e3cf01" candidate_uuid: "4dd4cba155c941b4b7ad4d64c7431536" candidate_term: 2 candidate_status { last_received { term: 1 index: 21 } } ignore_live_leader: false dest_uuid: "3136daf7101445beadc1aa19bc01c227"
I20260810 02:00:50.458994 6909 raft_consensus.cc:3060] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Advancing to term 2
W20260810 02:00:50.460690 6311 consensus_peers.cc:597] T 0afbd7afdd834537b15c727355724562 P 4dd4cba155c941b4b7ad4d64c7431536 -> Peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): Couldn't send request to peer ca4469fc2dbc48488bc7ad7f482f129e. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.196:41943: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 02:00:50.462025 6909 raft_consensus.cc:2468] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dd4cba155c941b4b7ad4d64c7431536 in term 2.
I20260810 02:00:50.462435 6308 leader_election.cc:304] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3136daf7101445beadc1aa19bc01c227, 4dd4cba155c941b4b7ad4d64c7431536; no voters:
I20260810 02:00:50.462803 6311 leader_election.cc:304] T 57f6f22d97c14ed98960e27ce2c8f3fb P 4dd4cba155c941b4b7ad4d64c7431536 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ce0e487f0341fd9bf853393d6e7683, 4dd4cba155c941b4b7ad4d64c7431536; no voters:
I20260810 02:00:50.463059 26947 raft_consensus.cc:2804] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 FOLLOWER]: Leader election won for term 2
W20260810 02:00:50.463560 6308 leader_election.cc:336] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797): Network error: Client connection negotiation failed: client connection to 127.21.64.193:36797: connect: Connection refused (error 111)
W20260810 02:00:50.465695 6308 leader_election.cc:336] T 57f6f22d97c14ed98960e27ce2c8f3fb P 4dd4cba155c941b4b7ad4d64c7431536 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797): Network error: Client connection negotiation failed: client connection to 127.21.64.193:36797: connect: Connection refused (error 111)
I20260810 02:00:50.466466 26968 raft_consensus.cc:493] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 82f93d1d11364ceeb485585b4ae78871)
I20260810 02:00:50.466624 26968 raft_consensus.cc:515] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 02:00:50.467402 26968 leader_election.cc:290] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893), 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995)
I20260810 02:00:50.468652 6909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a93b1a1ce1440b99bdd7a3bcf49064" candidate_uuid: "17b49c694faf479ea2e5083470fc0302" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "3136daf7101445beadc1aa19bc01c227" is_pre_election: true
I20260810 02:00:50.468870 6909 raft_consensus.cc:2468] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17b49c694faf479ea2e5083470fc0302 in term 1.
I20260810 02:00:50.469316 4036 leader_election.cc:304] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17b49c694faf479ea2e5083470fc0302, 3136daf7101445beadc1aa19bc01c227; no voters:
W20260810 02:00:50.469578 4038 leader_election.cc:336] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): Network error: Client connection negotiation failed: client connection to 127.21.64.194:43893: connect: Connection refused (error 111)
I20260810 02:00:50.469624 26968 raft_consensus.cc:2804] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 02:00:50.469687 26968 raft_consensus.cc:493] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 82f93d1d11364ceeb485585b4ae78871)
I20260810 02:00:50.469750 26968 raft_consensus.cc:3060] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Advancing to term 2
I20260810 02:00:50.472138 28340 raft_consensus.cc:2804] T 57f6f22d97c14ed98960e27ce2c8f3fb P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 02:00:50.472242 28340 raft_consensus.cc:493] T 57f6f22d97c14ed98960e27ce2c8f3fb P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dc85be7d460a404f997177f57680850f)
I20260810 02:00:50.472332 28340 raft_consensus.cc:3060] T 57f6f22d97c14ed98960e27ce2c8f3fb P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Advancing to term 2
I20260810 02:00:50.473444 26947 raft_consensus.cc:697] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 LEADER]: Becoming Leader. State: Replica: 4dd4cba155c941b4b7ad4d64c7431536, State: Running, Role: LEADER
I20260810 02:00:50.473814 26947 consensus_queue.cc:237] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 1.21, Last appended by leader: 21, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 02:00:50.479171 26968 raft_consensus.cc:515] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 02:00:50.479969 26968 leader_election.cc:290] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 2 election: Requested vote from peers 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893), 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995)
I20260810 02:00:50.481477 6909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a93b1a1ce1440b99bdd7a3bcf49064" candidate_uuid: "17b49c694faf479ea2e5083470fc0302" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "3136daf7101445beadc1aa19bc01c227"
W20260810 02:00:50.481642 4038 leader_election.cc:336] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): Network error: Client connection negotiation failed: client connection to 127.21.64.194:43893: connect: Connection refused (error 111)
I20260810 02:00:50.481726 6909 raft_consensus.cc:3060] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Advancing to term 2
I20260810 02:00:50.484800 6909 raft_consensus.cc:2468] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17b49c694faf479ea2e5083470fc0302 in term 2.
I20260810 02:00:50.485241 4036 leader_election.cc:304] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17b49c694faf479ea2e5083470fc0302, 3136daf7101445beadc1aa19bc01c227; no voters: 82f93d1d11364ceeb485585b4ae78871
I20260810 02:00:50.485735 26968 raft_consensus.cc:2804] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 02:00:50.485862 26968 raft_consensus.cc:697] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302 [term 2 LEADER]: Becoming Leader. State: Replica: 17b49c694faf479ea2e5083470fc0302, State: Running, Role: LEADER
I20260810 02:00:50.486114 26968 consensus_queue.cc:237] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 9, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 02:00:50.501852 3572 catalog_manager.cc:5719] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302 reported cstate change: term changed from 1 to 2, leader changed from 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) to 17b49c694faf479ea2e5083470fc0302 (127.21.64.195). New cstate: current_term: 2 leader_uuid: "17b49c694faf479ea2e5083470fc0302" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } }
I20260810 02:00:50.505676 28340 raft_consensus.cc:515] T 57f6f22d97c14ed98960e27ce2c8f3fb P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
W20260810 02:00:50.508116 6308 leader_election.cc:336] T 57f6f22d97c14ed98960e27ce2c8f3fb P 4dd4cba155c941b4b7ad4d64c7431536 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797): Network error: Client connection negotiation failed: client connection to 127.21.64.193:36797: connect: Connection refused (error 111)
I20260810 02:00:50.508193 3572 catalog_manager.cc:5719] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536 reported cstate change: term changed from 1 to 2, leader changed from dc85be7d460a404f997177f57680850f (127.21.64.193) to 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197). New cstate: current_term: 2 leader_uuid: "4dd4cba155c941b4b7ad4d64c7431536" committed_config { opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:50.508630 28340 leader_election.cc:290] T 57f6f22d97c14ed98960e27ce2c8f3fb P 4dd4cba155c941b4b7ad4d64c7431536 [CANDIDATE]: Term 2 election: Requested vote from peers dc85be7d460a404f997177f57680850f (127.21.64.193:36797), 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317)
I20260810 02:00:50.510391 6567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f6f22d97c14ed98960e27ce2c8f3fb" candidate_uuid: "4dd4cba155c941b4b7ad4d64c7431536" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "22ce0e487f0341fd9bf853393d6e7683"
I20260810 02:00:50.510689 6567 raft_consensus.cc:3060] T 57f6f22d97c14ed98960e27ce2c8f3fb P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Advancing to term 2
I20260810 02:00:50.518326 6567 raft_consensus.cc:2468] T 57f6f22d97c14ed98960e27ce2c8f3fb P 22ce0e487f0341fd9bf853393d6e7683 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dd4cba155c941b4b7ad4d64c7431536 in term 2.
I20260810 02:00:50.518836 6311 leader_election.cc:304] T 57f6f22d97c14ed98960e27ce2c8f3fb P 4dd4cba155c941b4b7ad4d64c7431536 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22ce0e487f0341fd9bf853393d6e7683, 4dd4cba155c941b4b7ad4d64c7431536; no voters: dc85be7d460a404f997177f57680850f
I20260810 02:00:50.519192 28340 raft_consensus.cc:2804] T 57f6f22d97c14ed98960e27ce2c8f3fb P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 02:00:50.519375 28340 raft_consensus.cc:697] T 57f6f22d97c14ed98960e27ce2c8f3fb P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 LEADER]: Becoming Leader. State: Replica: 4dd4cba155c941b4b7ad4d64c7431536, State: Running, Role: LEADER
I20260810 02:00:50.519717 28340 consensus_queue.cc:237] T 57f6f22d97c14ed98960e27ce2c8f3fb P 4dd4cba155c941b4b7ad4d64c7431536 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 02:00:50.533434 3572 catalog_manager.cc:5719] T 57f6f22d97c14ed98960e27ce2c8f3fb P 4dd4cba155c941b4b7ad4d64c7431536 reported cstate change: term changed from 1 to 2, leader changed from dc85be7d460a404f997177f57680850f (127.21.64.193) to 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197). New cstate: current_term: 2 leader_uuid: "4dd4cba155c941b4b7ad4d64c7431536" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } }
I20260810 02:00:50.545621 28109 raft_consensus.cc:493] T cf531b93380e43bfa103837bd6350834 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dc85be7d460a404f997177f57680850f)
I20260810 02:00:50.545888 28109 raft_consensus.cc:515] T cf531b93380e43bfa103837bd6350834 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 02:00:50.546381 28303 raft_consensus.cc:493] T b63d0798e1ae4aea9b0272716d53d46d P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 82f93d1d11364ceeb485585b4ae78871)
I20260810 02:00:50.546556 28303 raft_consensus.cc:515] T b63d0798e1ae4aea9b0272716d53d46d P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 02:00:50.546725 28109 leader_election.cc:290] T cf531b93380e43bfa103837bd6350834 P 22ce0e487f0341fd9bf853393d6e7683 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dc85be7d460a404f997177f57680850f (127.21.64.193:36797), 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 02:00:50.547308 28303 leader_election.cc:290] T b63d0798e1ae4aea9b0272716d53d46d P c5ed5317da9c464b93f979c405f0f6e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893), dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
W20260810 02:00:50.550976 6653 leader_election.cc:336] T b63d0798e1ae4aea9b0272716d53d46d P c5ed5317da9c464b93f979c405f0f6e4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797): Network error: Client connection negotiation failed: client connection to 127.21.64.193:36797: connect: Connection refused (error 111)
W20260810 02:00:50.552198 6479 leader_election.cc:336] T cf531b93380e43bfa103837bd6350834 P 22ce0e487f0341fd9bf853393d6e7683 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): Network error: Client connection negotiation failed: client connection to 127.21.64.194:43893: connect: Connection refused (error 111)
W20260810 02:00:50.552528 6655 leader_election.cc:336] T b63d0798e1ae4aea9b0272716d53d46d P c5ed5317da9c464b93f979c405f0f6e4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): Network error: Client connection negotiation failed: client connection to 127.21.64.194:43893: connect: Connection refused (error 111)
I20260810 02:00:50.552661 6655 leader_election.cc:304] T b63d0798e1ae4aea9b0272716d53d46d P c5ed5317da9c464b93f979c405f0f6e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ed5317da9c464b93f979c405f0f6e4; no voters: 82f93d1d11364ceeb485585b4ae78871, dc85be7d460a404f997177f57680850f
I20260810 02:00:50.553102 28303 raft_consensus.cc:2749] T b63d0798e1ae4aea9b0272716d53d46d P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 02:00:50.553419 6477 leader_election.cc:336] T cf531b93380e43bfa103837bd6350834 P 22ce0e487f0341fd9bf853393d6e7683 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797): Network error: Client connection negotiation failed: client connection to 127.21.64.193:36797: connect: Connection refused (error 111)
I20260810 02:00:50.553579 6477 leader_election.cc:304] T cf531b93380e43bfa103837bd6350834 P 22ce0e487f0341fd9bf853393d6e7683 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22ce0e487f0341fd9bf853393d6e7683; no voters: 82f93d1d11364ceeb485585b4ae78871, dc85be7d460a404f997177f57680850f
I20260810 02:00:50.554584 28109 raft_consensus.cc:2749] T cf531b93380e43bfa103837bd6350834 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 02:00:50.562263 28303 raft_consensus.cc:493] T f7a36f7ebd5d4342a259b093e45d4c32 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 82f93d1d11364ceeb485585b4ae78871)
I20260810 02:00:50.562520 28303 raft_consensus.cc:515] T f7a36f7ebd5d4342a259b093e45d4c32 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 02:00:50.563648 28303 leader_election.cc:290] T f7a36f7ebd5d4342a259b093e45d4c32 P c5ed5317da9c464b93f979c405f0f6e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893), 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197:38787), 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995)
I20260810 02:00:50.565045 6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a36f7ebd5d4342a259b093e45d4c32" candidate_uuid: "c5ed5317da9c464b93f979c405f0f6e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "4dd4cba155c941b4b7ad4d64c7431536" is_pre_election: true
I20260810 02:00:50.583673 6909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a36f7ebd5d4342a259b093e45d4c32" candidate_uuid: "c5ed5317da9c464b93f979c405f0f6e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "3136daf7101445beadc1aa19bc01c227" is_pre_election: true
I20260810 02:00:50.839455 26968 raft_consensus.cc:493] T eb90d508a0004daa8f10d562cefe5fd6 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca4469fc2dbc48488bc7ad7f482f129e)
I20260810 02:00:50.840531 4195 maintenance_manager.cc:419] P 17b49c694faf479ea2e5083470fc0302: Scheduling FlushMRSOp(c53fc4008faf445fa05e436b9c8e0282): perf score=0.033402
I20260810 02:00:50.628655 28340 raft_consensus.cc:493] T f7a36f7ebd5d4342a259b093e45d4c32 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 82f93d1d11364ceeb485585b4ae78871)
I20260810 02:00:51.267719 26968 raft_consensus.cc:515] T eb90d508a0004daa8f10d562cefe5fd6 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 02:00:51.267844 28340 raft_consensus.cc:515] T f7a36f7ebd5d4342a259b093e45d4c32 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 02:00:51.268518 26968 leader_election.cc:290] T eb90d508a0004daa8f10d562cefe5fd6 P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943), 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995)
I20260810 02:00:50.932380 4131 raft_consensus.cc:1275] T abf302f27a12414a8647dab82ab8101f P 17b49c694faf479ea2e5083470fc0302 [term 2 FOLLOWER]: Refusing update from remote peer 3136daf7101445beadc1aa19bc01c227: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 2 index: 12. (index mismatch)
I20260810 02:00:51.268900 28340 leader_election.cc:290] T f7a36f7ebd5d4342a259b093e45d4c32 P 4dd4cba155c941b4b7ad4d64c7431536 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893), 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995), c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199:41689)
I20260810 02:00:50.725329 28341 raft_consensus.cc:493] T fe8e1f0908234e46881258cfe79835f8 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 82f93d1d11364ceeb485585b4ae78871)
I20260810 02:00:51.020027 28344 raft_consensus.cc:493] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca4469fc2dbc48488bc7ad7f482f129e)
I20260810 02:00:50.895098 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:51.269133 28341 raft_consensus.cc:515] T fe8e1f0908234e46881258cfe79835f8 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 02:00:51.269181 28344 raft_consensus.cc:515] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
W20260810 02:00:50.578733 6655 leader_election.cc:336] T f7a36f7ebd5d4342a259b093e45d4c32 P c5ed5317da9c464b93f979c405f0f6e4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): Network error: Client connection negotiation failed: client connection to 127.21.64.194:43893: connect: Connection refused (error 111)
I20260810 02:00:51.269516 6655 leader_election.cc:304] T f7a36f7ebd5d4342a259b093e45d4c32 P c5ed5317da9c464b93f979c405f0f6e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c5ed5317da9c464b93f979c405f0f6e4; no voters: 4dd4cba155c941b4b7ad4d64c7431536, 82f93d1d11364ceeb485585b4ae78871
I20260810 02:00:50.697392 28328 raft_consensus.cc:493] T 2e72e04459b140cc9e20ad633b1ab5c4 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 82f93d1d11364ceeb485585b4ae78871)
I20260810 02:00:51.270052 28344 leader_election.cc:290] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943), c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199:41689)
I20260810 02:00:51.270009 28328 raft_consensus.cc:515] T 2e72e04459b140cc9e20ad633b1ab5c4 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 02:00:50.933960 28342 raft_consensus.cc:493] T 8308d63e9002418b876c3d3ae0095d9f P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca4469fc2dbc48488bc7ad7f482f129e)
I20260810 02:00:51.270339 28342 raft_consensus.cc:515] T 8308d63e9002418b876c3d3ae0095d9f P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 02:00:51.270752 28328 leader_election.cc:290] T 2e72e04459b140cc9e20ad633b1ab5c4 P 3136daf7101445beadc1aa19bc01c227 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893), dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
I20260810 02:00:51.271034 28342 leader_election.cc:290] T 8308d63e9002418b876c3d3ae0095d9f P 4dd4cba155c941b4b7ad4d64c7431536 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943), 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317)
I20260810 02:00:51.145016 28530 raft_consensus.cc:493] T be4737d169be4419b5a0a0b656a3930f P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca4469fc2dbc48488bc7ad7f482f129e)
I20260810 02:00:51.271296 28530 raft_consensus.cc:515] T be4737d169be4419b5a0a0b656a3930f P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 02:00:51.271953 28530 leader_election.cc:290] T be4737d169be4419b5a0a0b656a3930f P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943), 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995)
W20260810 02:00:50.861811 6308 consensus_peers.cc:597] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536 -> Peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797): Couldn't send request to peer dc85be7d460a404f997177f57680850f. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.193:36797: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260810 02:00:51.272172 6308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.193:36797, user_credentials={real_user=slave}} blocked reactor thread for 410350us
W20260810 02:00:50.968454 4038 consensus_peers.cc:597] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302 -> Peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): Couldn't send request to peer 82f93d1d11364ceeb485585b4ae78871. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.194:43893: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 02:00:50.933032 28376 raft_consensus.cc:493] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca4469fc2dbc48488bc7ad7f482f129e)
I20260810 02:00:51.273802 28376 raft_consensus.cc:515] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 02:00:51.260283 28525 raft_consensus.cc:493] T 606ad043ee3344c39c9eef7cd1920d7e P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca4469fc2dbc48488bc7ad7f482f129e)
I20260810 02:00:51.274493 6906 raft_consensus.cc:1275] T 252899385eaa45b392974d2768e3cf01 P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Refusing update from remote peer 4dd4cba155c941b4b7ad4d64c7431536: Log matching property violated. Preceding OpId in replica: term: 1 index: 21. Preceding OpId from leader: term: 2 index: 22. (index mismatch)
I20260810 02:00:51.274786 28376 leader_election.cc:290] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189), ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943), 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 02:00:50.674180 28303 raft_consensus.cc:493] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 82f93d1d11364ceeb485585b4ae78871)
I20260810 02:00:51.275041 28303 raft_consensus.cc:515] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 02:00:51.275322 6903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a36f7ebd5d4342a259b093e45d4c32" candidate_uuid: "4dd4cba155c941b4b7ad4d64c7431536" candidate_term: 2 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "3136daf7101445beadc1aa19bc01c227" is_pre_election: true
W20260810 02:00:51.273308 4038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.194:43893, user_credentials={real_user=slave}} blocked reactor thread for 304845us
I20260810 02:00:51.275673 28303 leader_election.cc:290] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893), dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
I20260810 02:00:51.275825 28303 raft_consensus.cc:2749] T f7a36f7ebd5d4342a259b093e45d4c32 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 02:00:51.276197 6653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.64.200:32995, user_credentials={real_user=slave}} blocked reactor thread for 691693us
I20260810 02:00:50.700148 28321 raft_consensus.cc:493] T f7a36f7ebd5d4342a259b093e45d4c32 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 82f93d1d11364ceeb485585b4ae78871)
I20260810 02:00:51.276842 28321 raft_consensus.cc:515] T f7a36f7ebd5d4342a259b093e45d4c32 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 02:00:51.277758 28344 raft_consensus.cc:493] T 5528e3ba51a640eaa614f141440bb90b P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca4469fc2dbc48488bc7ad7f482f129e)
I20260810 02:00:51.277928 28344 raft_consensus.cc:515] T 5528e3ba51a640eaa614f141440bb90b P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 02:00:51.278920 28344 leader_election.cc:290] T 5528e3ba51a640eaa614f141440bb90b P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943), 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317), 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 02:00:51.279225 6907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb90d508a0004daa8f10d562cefe5fd6" candidate_uuid: "17b49c694faf479ea2e5083470fc0302" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: false dest_uuid: "3136daf7101445beadc1aa19bc01c227" is_pre_election: true
I20260810 02:00:51.279511 6908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be4737d169be4419b5a0a0b656a3930f" candidate_uuid: "17b49c694faf479ea2e5083470fc0302" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: false dest_uuid: "3136daf7101445beadc1aa19bc01c227" is_pre_election: true
I20260810 02:00:51.102381 6567 raft_consensus.cc:1275] T 57f6f22d97c14ed98960e27ce2c8f3fb P 22ce0e487f0341fd9bf853393d6e7683 [term 2 FOLLOWER]: Refusing update from remote peer 4dd4cba155c941b4b7ad4d64c7431536: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
I20260810 02:00:51.274133 28525 raft_consensus.cc:515] T 606ad043ee3344c39c9eef7cd1920d7e P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
W20260810 02:00:50.814056 6639 kernel_stack_watchdog.cc:198] Thread 6655 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/rpc/outbound_call.cc:307 for 144ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f8b7362b980 (unknown) at ??:0
@ 0x7f8b6c0c6135 __write at ??:0
@ 0x7f8b6c04115d _IO_file_write at ??:0
@ 0x7f8b6c041acf _IO_file_xsputn at ??:0
@ 0x7f8b6c035927 fwrite at ??:0
@ 0x8c9a07 __interceptor_fwrite.part.56 at ??:?
@ 0x7f8b6d22c830 google::LogMessage::SendToLog() at ??:0
@ 0x7f8b6d22875c google::LogMessage::Flush() at ??:0
@ 0x7f8b6d2289a1 google::LogMessage::~LogMessage() at ??:0
@ 0x7f8b7bf7ca66 kudu::consensus::LeaderElection::VoteResponseRpcCallback() at ??:0
@ 0x7f8b7bf7f46a kudu::consensus::LeaderElection::Run()::$_0::operator()() at ??:0
@ 0x7f8b7bf7f22e std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaaf86d std::function<>::operator()() at ??:?
@ 0x7f8b76fbbbb0 kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f8b76fbc9e5 kudu::rpc::OutboundCall::SetFailed() at ??:0
@ 0x7f8b76f496e1 kudu::rpc::Connection::Shutdown() at ??:0
I20260810 02:00:51.116798 28523 raft_consensus.cc:493] T a586b7d625bb4c27a6343ae7918c8cea P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca4469fc2dbc48488bc7ad7f482f129e)
W20260810 02:00:50.815095 6824 consensus_peers.cc:597] T abf302f27a12414a8647dab82ab8101f P 3136daf7101445beadc1aa19bc01c227 -> Peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797): Couldn't send request to peer dc85be7d460a404f997177f57680850f. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.193:36797: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260810 02:00:51.280679 6824 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.193:36797, user_credentials={real_user=slave}} blocked reactor thread for 465585us
I20260810 02:00:51.280675 28523 raft_consensus.cc:515] T a586b7d625bb4c27a6343ae7918c8cea P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 02:00:51.281008 28525 leader_election.cc:290] T 606ad043ee3344c39c9eef7cd1920d7e P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943), dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
I20260810 02:00:51.109069 28324 raft_consensus.cc:493] T be4737d169be4419b5a0a0b656a3930f P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca4469fc2dbc48488bc7ad7f482f129e)
I20260810 02:00:51.281558 28523 leader_election.cc:290] T a586b7d625bb4c27a6343ae7918c8cea P c5ed5317da9c464b93f979c405f0f6e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943), 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189)
I20260810 02:00:51.173388 6909 raft_consensus.cc:1275] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20260810 02:00:51.212687 28529 raft_consensus.cc:493] T eb90d508a0004daa8f10d562cefe5fd6 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca4469fc2dbc48488bc7ad7f482f129e)
I20260810 02:00:51.282119 28529 raft_consensus.cc:515] T eb90d508a0004daa8f10d562cefe5fd6 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 02:00:51.283006 28529 leader_election.cc:290] T eb90d508a0004daa8f10d562cefe5fd6 P 3136daf7101445beadc1aa19bc01c227 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189), ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943)
W20260810 02:00:51.236915 6809 kernel_stack_watchdog.cc:198] Thread 6824 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/rpc/outbound_call.cc:307 for 216ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7fdb70925980 (unknown) at ??:0
@ 0x7fdb7091f9c6 __GI___pthread_rwlock_wrlock at ??:0
@ 0x7fdb6a522894 google::LogMessage::Flush() at ??:0
@ 0x7fdb6a5229a1 google::LogMessage::~LogMessage() at ??:0
@ 0x7fdb7920446e kudu::consensus::Peer::ProcessResponseErrorUnlocked() at ??:0
@ 0x7fdb792030ef kudu::consensus::Peer::ProcessResponse() at ??:0
@ 0x7fdb79203c65 kudu::consensus::Peer::ProcessSingleResponse() at ??:0
@ 0x7fdb7920b7f1 kudu::consensus::Peer::SendNextRequest()::$_6::operator()() at ??:0
@ 0x7fdb7920b5fe std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaaf86d std::function<>::operator()() at ??:?
@ 0x7fdb742b5bb0 kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7fdb742b69e5 kudu::rpc::OutboundCall::SetFailed() at ??:0
@ 0x7fdb742436e1 kudu::rpc::Connection::Shutdown() at ??:0
@ 0x7fdb742d6511 kudu::rpc::ReactorThread::DestroyConnection() at ??:0
@ 0x7fdb742db52b kudu::rpc::ReactorThread::CompleteConnectionNegotiation() at ??:0
@ 0x7fdb74251fc4 kudu::rpc::Connection::CompleteNegotiation()::$_3::operator()() at ??:0
I20260810 02:00:51.155143 28526 raft_consensus.cc:493] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca4469fc2dbc48488bc7ad7f482f129e)
I20260810 02:00:51.283583 28526 raft_consensus.cc:515] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 02:00:51.281265 28324 raft_consensus.cc:515] T be4737d169be4419b5a0a0b656a3930f P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 02:00:51.284368 28526 leader_election.cc:290] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943), 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197:38787)
I20260810 02:00:51.284379 28324 leader_election.cc:290] T be4737d169be4419b5a0a0b656a3930f P 3136daf7101445beadc1aa19bc01c227 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943), 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189)
I20260810 02:00:51.286084 6908 raft_consensus.cc:2468] T be4737d169be4419b5a0a0b656a3930f P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17b49c694faf479ea2e5083470fc0302 in term 1.
I20260810 02:00:51.286201 28341 leader_election.cc:290] T fe8e1f0908234e46881258cfe79835f8 P 4dd4cba155c941b4b7ad4d64c7431536 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893), c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199:41689), 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317)
I20260810 02:00:51.286608 6907 raft_consensus.cc:2468] T eb90d508a0004daa8f10d562cefe5fd6 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17b49c694faf479ea2e5083470fc0302 in term 1.
I20260810 02:00:51.286652 28341 raft_consensus.cc:493] T 7207ea155ba44c0a9ba216acd22dc1b4 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca4469fc2dbc48488bc7ad7f482f129e)
I20260810 02:00:51.286800 28341 raft_consensus.cc:515] T 7207ea155ba44c0a9ba216acd22dc1b4 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 02:00:51.287338 28341 leader_election.cc:290] T 7207ea155ba44c0a9ba216acd22dc1b4 P 4dd4cba155c941b4b7ad4d64c7431536 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943), 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 02:00:51.287515 6903 raft_consensus.cc:2468] T f7a36f7ebd5d4342a259b093e45d4c32 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dd4cba155c941b4b7ad4d64c7431536 in term 1.
I20260810 02:00:51.288955 6394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8308d63e9002418b876c3d3ae0095d9f" candidate_uuid: "22ce0e487f0341fd9bf853393d6e7683" candidate_term: 2 candidate_status { last_received { term: 1 index: 13 } } ignore_live_leader: false dest_uuid: "4dd4cba155c941b4b7ad4d64c7431536" is_pre_election: true
I20260810 02:00:51.289191 6394 raft_consensus.cc:2468] T 8308d63e9002418b876c3d3ae0095d9f P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ce0e487f0341fd9bf853393d6e7683 in term 1.
I20260810 02:00:51.289834 6541 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:51.291682 4036 leader_election.cc:304] T be4737d169be4419b5a0a0b656a3930f P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17b49c694faf479ea2e5083470fc0302, 3136daf7101445beadc1aa19bc01c227; no voters:
I20260810 02:00:51.291965 26968 raft_consensus.cc:493] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca4469fc2dbc48488bc7ad7f482f129e)
I20260810 02:00:51.292032 4036 leader_election.cc:304] T eb90d508a0004daa8f10d562cefe5fd6 P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17b49c694faf479ea2e5083470fc0302, 3136daf7101445beadc1aa19bc01c227; no voters:
I20260810 02:00:51.292167 26968 raft_consensus.cc:515] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 02:00:51.292799 26968 leader_election.cc:290] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943), c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199:41689)
I20260810 02:00:51.292936 28321 leader_election.cc:290] T f7a36f7ebd5d4342a259b093e45d4c32 P 3136daf7101445beadc1aa19bc01c227 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893), 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197:38787), c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199:41689)
I20260810 02:00:51.292958 26968 consensus_queue.cc:1048] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260810 02:00:51.293068 28321 consensus_queue.cc:1048] T abf302f27a12414a8647dab82ab8101f P 3136daf7101445beadc1aa19bc01c227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260810 02:00:51.293392 26968 raft_consensus.cc:2804] T be4737d169be4419b5a0a0b656a3930f P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 02:00:51.293488 26968 raft_consensus.cc:493] T be4737d169be4419b5a0a0b656a3930f P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca4469fc2dbc48488bc7ad7f482f129e)
I20260810 02:00:51.293594 26968 raft_consensus.cc:3060] T be4737d169be4419b5a0a0b656a3930f P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Advancing to term 2
I20260810 02:00:51.295048 28525 raft_consensus.cc:2804] T eb90d508a0004daa8f10d562cefe5fd6 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 02:00:51.295149 28525 raft_consensus.cc:493] T eb90d508a0004daa8f10d562cefe5fd6 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca4469fc2dbc48488bc7ad7f482f129e)
I20260810 02:00:51.295243 28525 raft_consensus.cc:3060] T eb90d508a0004daa8f10d562cefe5fd6 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Advancing to term 2
I20260810 02:00:51.296792 6477 leader_election.cc:304] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ce0e487f0341fd9bf853393d6e7683, 4dd4cba155c941b4b7ad4d64c7431536; no voters:
I20260810 02:00:51.296816 26968 raft_consensus.cc:515] T be4737d169be4419b5a0a0b656a3930f P 17b49c694faf479ea2e5083470fc0302 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 02:00:51.298027 26968 leader_election.cc:290] T be4737d169be4419b5a0a0b656a3930f P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 2 election: Requested vote from peers ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943), 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995)
I20260810 02:00:51.298416 28526 raft_consensus.cc:2804] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 02:00:51.298561 28526 raft_consensus.cc:493] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca4469fc2dbc48488bc7ad7f482f129e)
I20260810 02:00:51.298650 28526 raft_consensus.cc:3060] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Advancing to term 2
I20260810 02:00:51.299459 28342 consensus_queue.cc:1048] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.000s
I20260810 02:00:51.302057 6563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5528e3ba51a640eaa614f141440bb90b" candidate_uuid: "17b49c694faf479ea2e5083470fc0302" candidate_term: 2 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "22ce0e487f0341fd9bf853393d6e7683" is_pre_election: true
I20260810 02:00:51.302289 6563 raft_consensus.cc:2468] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17b49c694faf479ea2e5083470fc0302 in term 1.
W20260810 02:00:51.303100 4036 leader_election.cc:336] T 606ad043ee3344c39c9eef7cd1920d7e P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797): Network error: Client connection negotiation failed: client connection to 127.21.64.193:36797: connect: Connection refused (error 111)
I20260810 02:00:51.303171 6884 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:51.304343 6908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be4737d169be4419b5a0a0b656a3930f" candidate_uuid: "17b49c694faf479ea2e5083470fc0302" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: false dest_uuid: "3136daf7101445beadc1aa19bc01c227"
I20260810 02:00:51.304515 6908 raft_consensus.cc:3060] T be4737d169be4419b5a0a0b656a3930f P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Advancing to term 2
W20260810 02:00:51.304741 6308 consensus_peers.cc:597] T 57f6f22d97c14ed98960e27ce2c8f3fb P 4dd4cba155c941b4b7ad4d64c7431536 -> Peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797): Couldn't send request to peer dc85be7d460a404f997177f57680850f. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.193:36797: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 02:00:51.312501 28525 raft_consensus.cc:515] T eb90d508a0004daa8f10d562cefe5fd6 P 17b49c694faf479ea2e5083470fc0302 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 02:00:51.313740 6909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb90d508a0004daa8f10d562cefe5fd6" candidate_uuid: "17b49c694faf479ea2e5083470fc0302" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: false dest_uuid: "3136daf7101445beadc1aa19bc01c227"
I20260810 02:00:51.313913 6909 raft_consensus.cc:3060] T eb90d508a0004daa8f10d562cefe5fd6 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Advancing to term 2
I20260810 02:00:51.316852 6909 raft_consensus.cc:2468] T eb90d508a0004daa8f10d562cefe5fd6 P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17b49c694faf479ea2e5083470fc0302 in term 2.
I20260810 02:00:51.317387 4036 leader_election.cc:304] T eb90d508a0004daa8f10d562cefe5fd6 P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17b49c694faf479ea2e5083470fc0302, 3136daf7101445beadc1aa19bc01c227; no voters:
I20260810 02:00:51.317715 28344 raft_consensus.cc:2804] T eb90d508a0004daa8f10d562cefe5fd6 P 17b49c694faf479ea2e5083470fc0302 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 02:00:51.317873 28344 raft_consensus.cc:697] T eb90d508a0004daa8f10d562cefe5fd6 P 17b49c694faf479ea2e5083470fc0302 [term 2 LEADER]: Becoming Leader. State: Replica: 17b49c694faf479ea2e5083470fc0302, State: Running, Role: LEADER
I20260810 02:00:51.318164 28344 consensus_queue.cc:237] T eb90d508a0004daa8f10d562cefe5fd6 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 02:00:51.319262 28525 leader_election.cc:290] T eb90d508a0004daa8f10d562cefe5fd6 P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 2 election: Requested vote from peers ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943), 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995)
I20260810 02:00:51.325290 6884 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:51.332891 6369 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 02:00:51.339365 6567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8308d63e9002418b876c3d3ae0095d9f" candidate_uuid: "4dd4cba155c941b4b7ad4d64c7431536" candidate_term: 2 candidate_status { last_received { term: 1 index: 13 } } ignore_live_leader: false dest_uuid: "22ce0e487f0341fd9bf853393d6e7683" is_pre_election: true
I20260810 02:00:51.339581 6908 raft_consensus.cc:2468] T be4737d169be4419b5a0a0b656a3930f P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17b49c694faf479ea2e5083470fc0302 in term 2.
I20260810 02:00:51.340090 4036 leader_election.cc:304] T be4737d169be4419b5a0a0b656a3930f P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17b49c694faf479ea2e5083470fc0302, 3136daf7101445beadc1aa19bc01c227; no voters:
I20260810 02:00:51.341172 28341 consensus_queue.cc:1048] T 57f6f22d97c14ed98960e27ce2c8f3fb P 4dd4cba155c941b4b7ad4d64c7431536 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 02:00:51.342283 28525 raft_consensus.cc:2804] T be4737d169be4419b5a0a0b656a3930f P 17b49c694faf479ea2e5083470fc0302 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 02:00:51.342506 28525 raft_consensus.cc:697] T be4737d169be4419b5a0a0b656a3930f P 17b49c694faf479ea2e5083470fc0302 [term 2 LEADER]: Becoming Leader. State: Replica: 17b49c694faf479ea2e5083470fc0302, State: Running, Role: LEADER
I20260810 02:00:51.342762 28525 consensus_queue.cc:237] T be4737d169be4419b5a0a0b656a3930f P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 02:00:51.345556 4131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb90d508a0004daa8f10d562cefe5fd6" candidate_uuid: "3136daf7101445beadc1aa19bc01c227" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: false dest_uuid: "17b49c694faf479ea2e5083470fc0302" is_pre_election: true
I20260810 02:00:51.346284 4131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be4737d169be4419b5a0a0b656a3930f" candidate_uuid: "3136daf7101445beadc1aa19bc01c227" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: false dest_uuid: "17b49c694faf479ea2e5083470fc0302" is_pre_election: true
W20260810 02:00:51.350063 4038 leader_election.cc:336] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): Network error: Client connection negotiation failed: client connection to 127.21.64.196:41943: connect: Connection refused (error 111)
W20260810 02:00:51.350235 4038 leader_election.cc:336] T eb90d508a0004daa8f10d562cefe5fd6 P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): Network error: Client connection negotiation failed: client connection to 127.21.64.196:41943: connect: Connection refused (error 111)
I20260810 02:00:51.350817 4129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5528e3ba51a640eaa614f141440bb90b" candidate_uuid: "22ce0e487f0341fd9bf853393d6e7683" candidate_term: 2 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "17b49c694faf479ea2e5083470fc0302" is_pre_election: true
I20260810 02:00:51.351054 4129 raft_consensus.cc:2468] T 5528e3ba51a640eaa614f141440bb90b P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ce0e487f0341fd9bf853393d6e7683 in term 1.
W20260810 02:00:51.351619 4038 leader_election.cc:336] T be4737d169be4419b5a0a0b656a3930f P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): Network error: Client connection negotiation failed: client connection to 127.21.64.196:41943: connect: Connection refused (error 111)
W20260810 02:00:51.352432 6311 leader_election.cc:343] T fe8e1f0908234e46881258cfe79835f8 P 4dd4cba155c941b4b7ad4d64c7431536 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317): Not found: Tablet not found: fe8e1f0908234e46881258cfe79835f8
I20260810 02:00:51.367259 6369 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
W20260810 02:00:51.402911 6311 leader_election.cc:336] T fe8e1f0908234e46881258cfe79835f8 P 4dd4cba155c941b4b7ad4d64c7431536 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): Network error: Client connection negotiation failed: client connection to 127.21.64.194:43893: connect: Connection refused (error 111)
I20260810 02:00:51.403120 6311 leader_election.cc:304] T fe8e1f0908234e46881258cfe79835f8 P 4dd4cba155c941b4b7ad4d64c7431536 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4dd4cba155c941b4b7ad4d64c7431536; no voters: 22ce0e487f0341fd9bf853393d6e7683, 82f93d1d11364ceeb485585b4ae78871
I20260810 02:00:51.403427 28341 raft_consensus.cc:2749] T fe8e1f0908234e46881258cfe79835f8 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 02:00:51.403755 6311 leader_election.cc:336] T 7207ea155ba44c0a9ba216acd22dc1b4 P 4dd4cba155c941b4b7ad4d64c7431536 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): Network error: Client connection negotiation failed: client connection to 127.21.64.194:43893: connect: Connection refused (error 111)
W20260810 02:00:51.403949 6311 leader_election.cc:336] T f7a36f7ebd5d4342a259b093e45d4c32 P 4dd4cba155c941b4b7ad4d64c7431536 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): Network error: Client connection negotiation failed: client connection to 127.21.64.194:43893: connect: Connection refused (error 111)
W20260810 02:00:51.404196 6311 leader_election.cc:336] T 8308d63e9002418b876c3d3ae0095d9f P 4dd4cba155c941b4b7ad4d64c7431536 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): Network error: Client connection negotiation failed: client connection to 127.21.64.196:41943: connect: Connection refused (error 111)
W20260810 02:00:51.404354 6311 leader_election.cc:336] T 7207ea155ba44c0a9ba216acd22dc1b4 P 4dd4cba155c941b4b7ad4d64c7431536 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): Network error: Client connection negotiation failed: client connection to 127.21.64.196:41943: connect: Connection refused (error 111)
I20260810 02:00:51.404465 6311 leader_election.cc:304] T 7207ea155ba44c0a9ba216acd22dc1b4 P 4dd4cba155c941b4b7ad4d64c7431536 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dd4cba155c941b4b7ad4d64c7431536; no voters: 82f93d1d11364ceeb485585b4ae78871, ca4469fc2dbc48488bc7ad7f482f129e
I20260810 02:00:51.404768 28341 raft_consensus.cc:2749] T 7207ea155ba44c0a9ba216acd22dc1b4 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 02:00:51.407204 4038 leader_election.cc:336] T be4737d169be4419b5a0a0b656a3930f P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): Network error: Client connection negotiation failed: client connection to 127.21.64.196:41943: connect: Connection refused (error 111)
W20260810 02:00:51.407526 4038 leader_election.cc:336] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): Network error: Client connection negotiation failed: client connection to 127.21.64.196:41943: connect: Connection refused (error 111)
W20260810 02:00:51.407698 4038 leader_election.cc:336] T 606ad043ee3344c39c9eef7cd1920d7e P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): Network error: Client connection negotiation failed: client connection to 127.21.64.196:41943: connect: Connection refused (error 111)
I20260810 02:00:51.407804 4038 leader_election.cc:304] T 606ad043ee3344c39c9eef7cd1920d7e P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17b49c694faf479ea2e5083470fc0302; no voters: ca4469fc2dbc48488bc7ad7f482f129e, dc85be7d460a404f997177f57680850f
I20260810 02:00:51.408164 28344 raft_consensus.cc:2749] T 606ad043ee3344c39c9eef7cd1920d7e P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 02:00:51.408959 4038 leader_election.cc:336] T 5528e3ba51a640eaa614f141440bb90b P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): Network error: Client connection negotiation failed: client connection to 127.21.64.196:41943: connect: Connection refused (error 111)
W20260810 02:00:51.410642 4038 leader_election.cc:336] T 5528e3ba51a640eaa614f141440bb90b P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): Network error: Client connection negotiation failed: client connection to 127.21.64.194:43893: connect: Connection refused (error 111)
I20260810 02:00:51.410813 4038 leader_election.cc:304] T 5528e3ba51a640eaa614f141440bb90b P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 17b49c694faf479ea2e5083470fc0302, 22ce0e487f0341fd9bf853393d6e7683; no voters: 82f93d1d11364ceeb485585b4ae78871, ca4469fc2dbc48488bc7ad7f482f129e
I20260810 02:00:51.432592 28344 raft_consensus.cc:2749] T 5528e3ba51a640eaa614f141440bb90b P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 02:00:51.440521 4038 leader_election.cc:336] T eb90d508a0004daa8f10d562cefe5fd6 P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): Network error: Client connection negotiation failed: client connection to 127.21.64.196:41943: connect: Connection refused (error 111)
I20260810 02:00:51.440583 4105 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260810 02:00:51.451305 3574 catalog_manager.cc:5719] T eb90d508a0004daa8f10d562cefe5fd6 P 17b49c694faf479ea2e5083470fc0302 reported cstate change: term changed from 1 to 2, leader changed from ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) to 17b49c694faf479ea2e5083470fc0302 (127.21.64.195). New cstate: current_term: 2 leader_uuid: "17b49c694faf479ea2e5083470fc0302" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
I20260810 02:00:51.451925 3574 catalog_manager.cc:5719] T be4737d169be4419b5a0a0b656a3930f P 17b49c694faf479ea2e5083470fc0302 reported cstate change: term changed from 1 to 2, leader changed from ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) to 17b49c694faf479ea2e5083470fc0302 (127.21.64.195). New cstate: current_term: 2 leader_uuid: "17b49c694faf479ea2e5083470fc0302" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } }
W20260810 02:00:51.453608 6655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.64.194:43893, user_credentials={real_user=slave}} blocked reactor thread for 874806us
W20260810 02:00:51.454787 6826 leader_election.cc:336] T 2e72e04459b140cc9e20ad633b1ab5c4 P 3136daf7101445beadc1aa19bc01c227 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): Network error: Client connection negotiation failed: client connection to 127.21.64.194:43893: connect: Connection refused (error 111)
W20260810 02:00:51.455065 6826 leader_election.cc:336] T eb90d508a0004daa8f10d562cefe5fd6 P 3136daf7101445beadc1aa19bc01c227 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): Network error: Client connection negotiation failed: client connection to 127.21.64.196:41943: connect: Connection refused (error 111)
I20260810 02:00:51.455163 6826 leader_election.cc:304] T eb90d508a0004daa8f10d562cefe5fd6 P 3136daf7101445beadc1aa19bc01c227 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3136daf7101445beadc1aa19bc01c227; no voters: 17b49c694faf479ea2e5083470fc0302, ca4469fc2dbc48488bc7ad7f482f129e
I20260810 02:00:51.365209 28526 raft_consensus.cc:515] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 02:00:51.471097 6394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a36f7ebd5d4342a259b093e45d4c32" candidate_uuid: "3136daf7101445beadc1aa19bc01c227" candidate_term: 2 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "4dd4cba155c941b4b7ad4d64c7431536" is_pre_election: true
I20260810 02:00:51.471355 6394 raft_consensus.cc:2468] T f7a36f7ebd5d4342a259b093e45d4c32 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3136daf7101445beadc1aa19bc01c227 in term 1.
I20260810 02:00:51.471503 6567 raft_consensus.cc:2393] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dd4cba155c941b4b7ad4d64c7431536 in current term 2: Already voted for candidate 22ce0e487f0341fd9bf853393d6e7683 in this term.
I20260810 02:00:51.475157 6735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a36f7ebd5d4342a259b093e45d4c32" candidate_uuid: "4dd4cba155c941b4b7ad4d64c7431536" candidate_term: 2 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "c5ed5317da9c464b93f979c405f0f6e4" is_pre_election: true
I20260810 02:00:51.475448 6735 raft_consensus.cc:2468] T f7a36f7ebd5d4342a259b093e45d4c32 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dd4cba155c941b4b7ad4d64c7431536 in term 1.
I20260810 02:00:51.476017 6735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe8e1f0908234e46881258cfe79835f8" candidate_uuid: "4dd4cba155c941b4b7ad4d64c7431536" candidate_term: 2 candidate_status { last_received { term: 1 index: 14 } } ignore_live_leader: false dest_uuid: "c5ed5317da9c464b93f979c405f0f6e4" is_pre_election: true
I20260810 02:00:51.476218 6735 raft_consensus.cc:2468] T fe8e1f0908234e46881258cfe79835f8 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dd4cba155c941b4b7ad4d64c7431536 in term 1.
I20260810 02:00:51.477164 6735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d377b919f4748c88efb249dfc964f17" candidate_uuid: "17b49c694faf479ea2e5083470fc0302" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "c5ed5317da9c464b93f979c405f0f6e4" is_pre_election: true
I20260810 02:00:51.477381 6735 raft_consensus.cc:2468] T 1d377b919f4748c88efb249dfc964f17 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17b49c694faf479ea2e5083470fc0302 in term 1.
I20260810 02:00:51.477839 6735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a586b7d625bb4c27a6343ae7918c8cea" candidate_uuid: "17b49c694faf479ea2e5083470fc0302" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "c5ed5317da9c464b93f979c405f0f6e4" is_pre_election: true
I20260810 02:00:51.478026 6735 raft_consensus.cc:2468] T a586b7d625bb4c27a6343ae7918c8cea P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17b49c694faf479ea2e5083470fc0302 in term 1.
I20260810 02:00:51.482739 28324 raft_consensus.cc:2749] T eb90d508a0004daa8f10d562cefe5fd6 P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 02:00:51.483855 6826 leader_election.cc:336] T be4737d169be4419b5a0a0b656a3930f P 3136daf7101445beadc1aa19bc01c227 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): Network error: Client connection negotiation failed: client connection to 127.21.64.196:41943: connect: Connection refused (error 111)
I20260810 02:00:51.483980 6826 leader_election.cc:304] T be4737d169be4419b5a0a0b656a3930f P 3136daf7101445beadc1aa19bc01c227 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3136daf7101445beadc1aa19bc01c227; no voters: 17b49c694faf479ea2e5083470fc0302, ca4469fc2dbc48488bc7ad7f482f129e
I20260810 02:00:51.484200 28324 raft_consensus.cc:2749] T be4737d169be4419b5a0a0b656a3930f P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 02:00:51.498225 6824 leader_election.cc:336] T 2e72e04459b140cc9e20ad633b1ab5c4 P 3136daf7101445beadc1aa19bc01c227 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797): Network error: Client connection negotiation failed: client connection to 127.21.64.193:36797: connect: Connection refused (error 111)
I20260810 02:00:51.498450 6824 leader_election.cc:304] T 2e72e04459b140cc9e20ad633b1ab5c4 P 3136daf7101445beadc1aa19bc01c227 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3136daf7101445beadc1aa19bc01c227; no voters: 82f93d1d11364ceeb485585b4ae78871, dc85be7d460a404f997177f57680850f
I20260810 02:00:51.498713 28324 raft_consensus.cc:2749] T 2e72e04459b140cc9e20ad633b1ab5c4 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 02:00:51.500010 6312 leader_election.cc:304] T f7a36f7ebd5d4342a259b093e45d4c32 P 4dd4cba155c941b4b7ad4d64c7431536 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3136daf7101445beadc1aa19bc01c227, 4dd4cba155c941b4b7ad4d64c7431536, c5ed5317da9c464b93f979c405f0f6e4; no voters: 82f93d1d11364ceeb485585b4ae78871
I20260810 02:00:51.500249 4041 leader_election.cc:304] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17b49c694faf479ea2e5083470fc0302, c5ed5317da9c464b93f979c405f0f6e4; no voters: ca4469fc2dbc48488bc7ad7f482f129e
I20260810 02:00:51.500847 4041 leader_election.cc:304] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17b49c694faf479ea2e5083470fc0302, c5ed5317da9c464b93f979c405f0f6e4; no voters: ca4469fc2dbc48488bc7ad7f482f129e
I20260810 02:00:51.501130 28342 raft_consensus.cc:2804] T f7a36f7ebd5d4342a259b093e45d4c32 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 02:00:51.501300 28342 raft_consensus.cc:493] T f7a36f7ebd5d4342a259b093e45d4c32 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 82f93d1d11364ceeb485585b4ae78871)
I20260810 02:00:51.501461 28342 raft_consensus.cc:3060] T f7a36f7ebd5d4342a259b093e45d4c32 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Advancing to term 2
I20260810 02:00:51.501633 26968 raft_consensus.cc:2804] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 02:00:51.501720 26968 raft_consensus.cc:493] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca4469fc2dbc48488bc7ad7f482f129e)
I20260810 02:00:51.501796 26968 raft_consensus.cc:3060] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Advancing to term 2
I20260810 02:00:51.504769 26968 raft_consensus.cc:515] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 02:00:51.504940 28342 raft_consensus.cc:515] T f7a36f7ebd5d4342a259b093e45d4c32 P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 02:00:51.505457 28530 raft_consensus.cc:2804] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 02:00:51.505575 28530 raft_consensus.cc:493] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca4469fc2dbc48488bc7ad7f482f129e)
I20260810 02:00:51.505873 28530 raft_consensus.cc:3060] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Advancing to term 2
I20260810 02:00:51.507140 28342 leader_election.cc:290] T f7a36f7ebd5d4342a259b093e45d4c32 P 4dd4cba155c941b4b7ad4d64c7431536 [CANDIDATE]: Term 2 election: Requested vote from peers 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893), 3136daf7101445beadc1aa19bc01c227 (127.21.64.200:32995), c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199:41689)
I20260810 02:00:51.507475 6904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a36f7ebd5d4342a259b093e45d4c32" candidate_uuid: "4dd4cba155c941b4b7ad4d64c7431536" candidate_term: 2 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "3136daf7101445beadc1aa19bc01c227"
I20260810 02:00:51.507678 6904 raft_consensus.cc:3060] T f7a36f7ebd5d4342a259b093e45d4c32 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Advancing to term 2
W20260810 02:00:51.508389 6655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.194:43893, user_credentials={real_user=slave}} blocked reactor thread for 54576us
I20260810 02:00:51.508886 28530 raft_consensus.cc:515] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
W20260810 02:00:51.509310 6826 leader_election.cc:336] T f7a36f7ebd5d4342a259b093e45d4c32 P 3136daf7101445beadc1aa19bc01c227 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): Network error: Client connection negotiation failed: client connection to 127.21.64.194:43893: connect: Connection refused (error 111)
I20260810 02:00:51.511560 6904 raft_consensus.cc:2468] T f7a36f7ebd5d4342a259b093e45d4c32 P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dd4cba155c941b4b7ad4d64c7431536 in term 2.
I20260810 02:00:51.512478 28530 leader_election.cc:290] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 2 election: Requested vote from peers ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943), c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199:41689)
I20260810 02:00:51.512919 26968 leader_election.cc:290] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 2 election: Requested vote from peers ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943), c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199:41689)
I20260810 02:00:51.515496 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:51.515558 6311 leader_election.cc:304] T 8308d63e9002418b876c3d3ae0095d9f P 4dd4cba155c941b4b7ad4d64c7431536 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dd4cba155c941b4b7ad4d64c7431536; no voters: 22ce0e487f0341fd9bf853393d6e7683, ca4469fc2dbc48488bc7ad7f482f129e
I20260810 02:00:51.516849 28342 raft_consensus.cc:3060] T 8308d63e9002418b876c3d3ae0095d9f P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Advancing to term 2
I20260810 02:00:51.519835 28342 raft_consensus.cc:2749] T 8308d63e9002418b876c3d3ae0095d9f P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 02:00:51.525322 6311 leader_election.cc:336] T f7a36f7ebd5d4342a259b093e45d4c32 P 4dd4cba155c941b4b7ad4d64c7431536 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): Network error: Client connection negotiation failed: client connection to 127.21.64.194:43893: connect: Connection refused (error 111)
W20260810 02:00:51.541515 4038 leader_election.cc:336] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): Network error: Client connection negotiation failed: client connection to 127.21.64.196:41943: connect: Connection refused (error 111)
W20260810 02:00:51.541669 4038 leader_election.cc:336] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): Network error: Client connection negotiation failed: client connection to 127.21.64.196:41943: connect: Connection refused (error 111)
I20260810 02:00:51.548233 6735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a586b7d625bb4c27a6343ae7918c8cea" candidate_uuid: "17b49c694faf479ea2e5083470fc0302" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "c5ed5317da9c464b93f979c405f0f6e4"
I20260810 02:00:51.548511 6735 raft_consensus.cc:3060] T a586b7d625bb4c27a6343ae7918c8cea P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Advancing to term 2
I20260810 02:00:51.552744 6735 raft_consensus.cc:2468] T a586b7d625bb4c27a6343ae7918c8cea P c5ed5317da9c464b93f979c405f0f6e4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17b49c694faf479ea2e5083470fc0302 in term 2.
I20260810 02:00:51.553486 6735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d377b919f4748c88efb249dfc964f17" candidate_uuid: "17b49c694faf479ea2e5083470fc0302" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "c5ed5317da9c464b93f979c405f0f6e4"
I20260810 02:00:51.553702 6735 raft_consensus.cc:3060] T 1d377b919f4748c88efb249dfc964f17 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Advancing to term 2
I20260810 02:00:51.558588 4131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a586b7d625bb4c27a6343ae7918c8cea" candidate_uuid: "c5ed5317da9c464b93f979c405f0f6e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "17b49c694faf479ea2e5083470fc0302" is_pre_election: true
I20260810 02:00:51.558902 4131 raft_consensus.cc:2393] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ed5317da9c464b93f979c405f0f6e4 in current term 2: Already voted for candidate 17b49c694faf479ea2e5083470fc0302 in this term.
I20260810 02:00:51.567294 6394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8308d63e9002418b876c3d3ae0095d9f" candidate_uuid: "22ce0e487f0341fd9bf853393d6e7683" candidate_term: 2 candidate_status { last_received { term: 1 index: 13 } } ignore_live_leader: false dest_uuid: "4dd4cba155c941b4b7ad4d64c7431536"
I20260810 02:00:51.571027 6394 raft_consensus.cc:2468] T 8308d63e9002418b876c3d3ae0095d9f P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ce0e487f0341fd9bf853393d6e7683 in term 2.
I20260810 02:00:51.579665 6477 leader_election.cc:304] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ce0e487f0341fd9bf853393d6e7683, 4dd4cba155c941b4b7ad4d64c7431536; no voters:
I20260810 02:00:51.579999 28376 raft_consensus.cc:2804] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 02:00:51.580566 28376 raft_consensus.cc:697] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683 [term 2 LEADER]: Becoming Leader. State: Replica: 22ce0e487f0341fd9bf853393d6e7683, State: Running, Role: LEADER
I20260810 02:00:51.580936 28376 consensus_queue.cc:237] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 1.13, Last appended by leader: 13, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 02:00:51.583412 28526 leader_election.cc:290] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683 [CANDIDATE]: Term 2 election: Requested vote from peers ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943), 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197:38787)
I20260810 02:00:51.557660 6734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a36f7ebd5d4342a259b093e45d4c32" candidate_uuid: "3136daf7101445beadc1aa19bc01c227" candidate_term: 2 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "c5ed5317da9c464b93f979c405f0f6e4" is_pre_election: true
I20260810 02:00:51.586135 6734 raft_consensus.cc:2468] T f7a36f7ebd5d4342a259b093e45d4c32 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3136daf7101445beadc1aa19bc01c227 in term 1.
I20260810 02:00:51.584787 6739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a36f7ebd5d4342a259b093e45d4c32" candidate_uuid: "4dd4cba155c941b4b7ad4d64c7431536" candidate_term: 2 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "c5ed5317da9c464b93f979c405f0f6e4"
I20260810 02:00:51.586628 6739 raft_consensus.cc:3060] T f7a36f7ebd5d4342a259b093e45d4c32 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Advancing to term 2
I20260810 02:00:51.591419 6739 raft_consensus.cc:2468] T f7a36f7ebd5d4342a259b093e45d4c32 P c5ed5317da9c464b93f979c405f0f6e4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dd4cba155c941b4b7ad4d64c7431536 in term 2.
W20260810 02:00:51.557914 6655 leader_election.cc:336] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): Network error: Client connection negotiation failed: client connection to 127.21.64.194:43893: connect: Connection refused (error 111)
W20260810 02:00:51.592345 6655 leader_election.cc:336] T a586b7d625bb4c27a6343ae7918c8cea P c5ed5317da9c464b93f979c405f0f6e4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): Network error: Client connection negotiation failed: client connection to 127.21.64.196:41943: connect: Connection refused (error 111)
I20260810 02:00:51.592487 6655 leader_election.cc:304] T a586b7d625bb4c27a6343ae7918c8cea P c5ed5317da9c464b93f979c405f0f6e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ed5317da9c464b93f979c405f0f6e4; no voters: 17b49c694faf479ea2e5083470fc0302, ca4469fc2dbc48488bc7ad7f482f129e
I20260810 02:00:51.676229 3564 catalog_manager.cc:5719] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683 reported cstate change: term changed from 1 to 2, leader changed from ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) to 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198). New cstate: current_term: 2 leader_uuid: "22ce0e487f0341fd9bf853393d6e7683" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } }
I20260810 02:00:51.593835 6827 leader_election.cc:304] T f7a36f7ebd5d4342a259b093e45d4c32 P 3136daf7101445beadc1aa19bc01c227 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3136daf7101445beadc1aa19bc01c227, 4dd4cba155c941b4b7ad4d64c7431536, c5ed5317da9c464b93f979c405f0f6e4; no voters: 82f93d1d11364ceeb485585b4ae78871
W20260810 02:00:51.919062 6827 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.64.199:41689, user_credentials={real_user=slave}} blocked reactor thread for 325261us
I20260810 02:00:51.624603 6884 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:51.919731 28324 raft_consensus.cc:2764] T f7a36f7ebd5d4342a259b093e45d4c32 P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260810 02:00:51.920178 6909 raft_consensus.cc:1275] T eb90d508a0004daa8f10d562cefe5fd6 P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 2 index: 6. (index mismatch)
I20260810 02:00:51.920301 6904 raft_consensus.cc:1275] T be4737d169be4419b5a0a0b656a3930f P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 2 index: 6. (index mismatch)
I20260810 02:00:51.934999 6884 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:51.704654 6541 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:51.680616 6369 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 02:00:51.926510 6368 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260810 02:00:51.895411 6537 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
W20260810 02:00:51.741719 6479 leader_election.cc:336] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): Network error: Client connection negotiation failed: client connection to 127.21.64.196:41943: connect: Connection refused (error 111)
I20260810 02:00:52.050896 6394 raft_consensus.cc:1275] T 8308d63e9002418b876c3d3ae0095d9f P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 FOLLOWER]: Refusing update from remote peer 22ce0e487f0341fd9bf853393d6e7683: Log matching property violated. Preceding OpId in replica: term: 1 index: 13. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
W20260810 02:00:52.119066 6479 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.64.196:41943, user_credentials={real_user=slave}} blocked reactor thread for 377307us
W20260810 02:00:52.119282 6479 leader_election.cc:336] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): Network error: Client connection negotiation failed: client connection to 127.21.64.196:41943: connect: Connection refused (error 111)
W20260810 02:00:52.119576 6479 leader_election.cc:336] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): Network error: Client connection negotiation failed: client connection to 127.21.64.196:41943: connect: Connection refused (error 111)
W20260810 02:00:52.119822 6479 leader_election.cc:336] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): Network error: Client connection negotiation failed: client connection to 127.21.64.194:43893: connect: Connection refused (error 111)
I20260810 02:00:52.119982 6479 leader_election.cc:304] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 17b49c694faf479ea2e5083470fc0302, 22ce0e487f0341fd9bf853393d6e7683; no voters: 82f93d1d11364ceeb485585b4ae78871, ca4469fc2dbc48488bc7ad7f482f129e
I20260810 02:00:51.640741 4105 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260810 02:00:51.641402 4103 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
W20260810 02:00:52.018440 6464 kernel_stack_watchdog.cc:198] Thread 6479 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/rpc/outbound_call.cc:307 for 213ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7fe518c16980 (unknown) at ??:0
@ 0x7fe518c109c6 __GI___pthread_rwlock_wrlock at ??:0
@ 0x7fe512813894 google::LogMessage::Flush() at ??:0
@ 0x7fe5128139a1 google::LogMessage::~LogMessage() at ??:0
@ 0x7fe521567a66 kudu::consensus::LeaderElection::VoteResponseRpcCallback() at ??:0
@ 0x7fe52156a46a kudu::consensus::LeaderElection::Run()::$_0::operator()() at ??:0
@ 0x7fe52156a22e std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaaf86d std::function<>::operator()() at ??:?
@ 0x7fe51c5a6bb0 kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7fe51c5a79e5 kudu::rpc::OutboundCall::SetFailed() at ??:0
@ 0x7fe51c5346e1 kudu::rpc::Connection::Shutdown() at ??:0
@ 0x7fe51c5c7511 kudu::rpc::ReactorThread::DestroyConnection() at ??:0
@ 0x7fe51c5cc52b kudu::rpc::ReactorThread::CompleteConnectionNegotiation() at ??:0
@ 0x7fe51c542fc4 kudu::rpc::Connection::CompleteNegotiation()::$_3::operator()() at ??:0
@ 0x7fe51c542a11 boost::detail::function::void_function_obj_invoker<>::invoke() at ??:0
@ 0x7fe51c5d8f9e boost::function_n<>::operator()() at ??:0
I20260810 02:00:51.700121 4043 maintenance_manager.cc:643] P 17b49c694faf479ea2e5083470fc0302: FlushMRSOp(c53fc4008faf445fa05e436b9c8e0282) complete. Timing: real 0.429s user 0.068s sys 0.035s Metrics: {"bytes_written":6062,"cfile_init":1,"dirs.queue_time_us":11091,"dirs.run_cpu_time_us":279,"dirs.run_wall_time_us":5074,"drs_written":1,"lbm_read_time_us":112,"lbm_reads_lt_1ms":4,"lbm_write_time_us":884,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":635,"thread_start_us":31051,"threads_started":2,"wal-append.queue_time_us":19611}
I20260810 02:00:51.869961 4102 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260810 02:00:51.928623 28344 consensus_queue.cc:1048] T eb90d508a0004daa8f10d562cefe5fd6 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 02:00:51.592832 28553 raft_consensus.cc:2749] T a586b7d625bb4c27a6343ae7918c8cea P c5ed5317da9c464b93f979c405f0f6e4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 02:00:51.928755 28530 consensus_queue.cc:1048] T be4737d169be4419b5a0a0b656a3930f P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 02:00:51.557307 6735 raft_consensus.cc:2468] T 1d377b919f4748c88efb249dfc964f17 P c5ed5317da9c464b93f979c405f0f6e4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17b49c694faf479ea2e5083470fc0302 in term 2.
W20260810 02:00:51.605583 6653 leader_election.cc:336] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797): Network error: Client connection negotiation failed: client connection to 127.21.64.193:36797: connect: Connection refused (error 111)
W20260810 02:00:51.818300 4038 consensus_peers.cc:597] T eb90d508a0004daa8f10d562cefe5fd6 P 17b49c694faf479ea2e5083470fc0302 -> Peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): Couldn't send request to peer ca4469fc2dbc48488bc7ad7f482f129e. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.196:41943: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260810 02:00:52.121833 4038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.64.196:41943, user_credentials={real_user=slave}} blocked reactor thread for 303494us
I20260810 02:00:52.121865 6653 leader_election.cc:304] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ed5317da9c464b93f979c405f0f6e4; no voters: 82f93d1d11364ceeb485585b4ae78871, dc85be7d460a404f997177f57680850f
W20260810 02:00:52.122259 6653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.64.193:36797, user_credentials={real_user=slave}} blocked reactor thread for 537301us
W20260810 02:00:52.070125 4022 kernel_stack_watchdog.cc:198] Thread 4038 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/rpc/outbound_call.cc:307 for 161ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f0edcef3980 (unknown) at ??:0
@ 0x7f0edceed9c6 __GI___pthread_rwlock_wrlock at ??:0
@ 0x7f0ed6af0894 google::LogMessage::Flush() at ??:0
@ 0x7f0ed6af09a1 google::LogMessage::~LogMessage() at ??:0
@ 0x7f0ee57d246e kudu::consensus::Peer::ProcessResponseErrorUnlocked() at ??:0
@ 0x7f0ee57d10ef kudu::consensus::Peer::ProcessResponse() at ??:0
@ 0x7f0ee57d1c65 kudu::consensus::Peer::ProcessSingleResponse() at ??:0
@ 0x7f0ee57d97f1 kudu::consensus::Peer::SendNextRequest()::$_6::operator()() at ??:0
@ 0x7f0ee57d95fe std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaaf86d std::function<>::operator()() at ??:?
@ 0x7f0ee0883bb0 kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f0ee08849e5 kudu::rpc::OutboundCall::SetFailed() at ??:0
@ 0x7f0ee08116e1 kudu::rpc::Connection::Shutdown() at ??:0
@ 0x7f0ee08a4511 kudu::rpc::ReactorThread::DestroyConnection() at ??:0
@ 0x7f0ee08a952b kudu::rpc::ReactorThread::CompleteConnectionNegotiation() at ??:0
@ 0x7f0ee081ffc4 kudu::rpc::Connection::CompleteNegotiation()::$_3::operator()() at ??:0
I20260810 02:00:52.122711 4041 leader_election.cc:304] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17b49c694faf479ea2e5083470fc0302, c5ed5317da9c464b93f979c405f0f6e4; no voters: ca4469fc2dbc48488bc7ad7f482f129e
I20260810 02:00:52.123204 4041 leader_election.cc:304] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17b49c694faf479ea2e5083470fc0302, c5ed5317da9c464b93f979c405f0f6e4; no voters: ca4469fc2dbc48488bc7ad7f482f129e
W20260810 02:00:51.966152 6639 kernel_stack_watchdog.cc:198] Thread 6653 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/rpc/outbound_call.cc:307 for 297ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f8b7362b980 (unknown) at ??:0
@ 0x7f8b736259c6 __GI___pthread_rwlock_wrlock at ??:0
@ 0x7f8b6d228894 google::LogMessage::Flush() at ??:0
@ 0x7f8b6d2289a1 google::LogMessage::~LogMessage() at ??:0
@ 0x7f8b7bf7ca66 kudu::consensus::LeaderElection::VoteResponseRpcCallback() at ??:0
@ 0x7f8b7bf7f46a kudu::consensus::LeaderElection::Run()::$_0::operator()() at ??:0
@ 0x7f8b7bf7f22e std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaaf86d std::function<>::operator()() at ??:?
@ 0x7f8b76fbbbb0 kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f8b76fbc9e5 kudu::rpc::OutboundCall::SetFailed() at ??:0
@ 0x7f8b76f496e1 kudu::rpc::Connection::Shutdown() at ??:0
@ 0x7f8b76fdc511 kudu::rpc::ReactorThread::DestroyConnection() at ??:0
@ 0x7f8b76fe152b kudu::rpc::ReactorThread::CompleteConnectionNegotiation() at ??:0
@ 0x7f8b76f57fc4 kudu::rpc::Connection::CompleteNegotiation()::$_3::operator()() at ??:0
@ 0x7f8b76f57a11 boost::detail::function::void_function_obj_invoker<>::invoke() at ??:0
@ 0x7f8b76fedf9e boost::function_n<>::operator()() at ??:0
I20260810 02:00:52.124125 26968 raft_consensus.cc:2804] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 02:00:52.124277 26968 raft_consensus.cc:697] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302 [term 2 LEADER]: Becoming Leader. State: Replica: 17b49c694faf479ea2e5083470fc0302, State: Running, Role: LEADER
I20260810 02:00:52.124571 26968 consensus_queue.cc:237] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 9, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 02:00:52.103950 28677 raft_consensus.cc:493] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dc85be7d460a404f997177f57680850f)
I20260810 02:00:52.125490 28677 raft_consensus.cc:515] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 02:00:52.126194 28677 leader_election.cc:290] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dc85be7d460a404f997177f57680850f (127.21.64.193:36797), 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 02:00:52.126353 28677 raft_consensus.cc:2749] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 02:00:52.126888 28530 raft_consensus.cc:2804] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 02:00:52.127393 6312 leader_election.cc:304] T f7a36f7ebd5d4342a259b093e45d4c32 P 4dd4cba155c941b4b7ad4d64c7431536 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3136daf7101445beadc1aa19bc01c227, 4dd4cba155c941b4b7ad4d64c7431536, c5ed5317da9c464b93f979c405f0f6e4; no voters: 82f93d1d11364ceeb485585b4ae78871
I20260810 02:00:52.127704 28340 raft_consensus.cc:2804] T f7a36f7ebd5d4342a259b093e45d4c32 P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 02:00:52.127878 28340 raft_consensus.cc:697] T f7a36f7ebd5d4342a259b093e45d4c32 P 4dd4cba155c941b4b7ad4d64c7431536 [term 2 LEADER]: Becoming Leader. State: Replica: 4dd4cba155c941b4b7ad4d64c7431536, State: Running, Role: LEADER
I20260810 02:00:52.128171 28340 consensus_queue.cc:237] T f7a36f7ebd5d4342a259b093e45d4c32 P 4dd4cba155c941b4b7ad4d64c7431536 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 10, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 02:00:52.120662 28376 raft_consensus.cc:2749] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 02:00:52.128901 28376 consensus_queue.cc:1048] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260810 02:00:52.130228 4195 maintenance_manager.cc:419] P 17b49c694faf479ea2e5083470fc0302: Scheduling UndoDeltaBlockGCOp(c53fc4008faf445fa05e436b9c8e0282): 4579 bytes on disk
I20260810 02:00:52.130987 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
W20260810 02:00:52.137198 6655 leader_election.cc:336] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): Network error: Client connection negotiation failed: client connection to 127.21.64.194:43893: connect: Connection refused (error 111)
I20260810 02:00:52.131855 4043 maintenance_manager.cc:643] P 17b49c694faf479ea2e5083470fc0302: UndoDeltaBlockGCOp(c53fc4008faf445fa05e436b9c8e0282) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":120,"lbm_reads_lt_1ms":4}
W20260810 02:00:52.156989 6653 leader_election.cc:336] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797): Network error: Client connection negotiation failed: client connection to 127.21.64.193:36797: connect: Connection refused (error 111)
I20260810 02:00:52.157142 6714 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:52.157325 6653 leader_election.cc:304] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ed5317da9c464b93f979c405f0f6e4; no voters: 82f93d1d11364ceeb485585b4ae78871, dc85be7d460a404f997177f57680850f
I20260810 02:00:52.157877 28553 raft_consensus.cc:2749] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 02:00:52.159698 4195 maintenance_manager.cc:419] P 17b49c694faf479ea2e5083470fc0302: Scheduling FlushMRSOp(eb90d508a0004daa8f10d562cefe5fd6): perf score=0.033415
I20260810 02:00:52.145789 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:52.162113 28698 raft_consensus.cc:493] T e70193bd4055469d870a76542eaef524 P 22ce0e487f0341fd9bf853393d6e7683 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 82f93d1d11364ceeb485585b4ae78871)
I20260810 02:00:52.162273 28698 raft_consensus.cc:515] T e70193bd4055469d870a76542eaef524 P 22ce0e487f0341fd9bf853393d6e7683 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } }
I20260810 02:00:52.163327 28698 leader_election.cc:290] T e70193bd4055469d870a76542eaef524 P 22ce0e487f0341fd9bf853393d6e7683 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893), ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943)
W20260810 02:00:52.149598 4038 consensus_peers.cc:597] T be4737d169be4419b5a0a0b656a3930f P 17b49c694faf479ea2e5083470fc0302 -> Peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): Couldn't send request to peer ca4469fc2dbc48488bc7ad7f482f129e. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.196:41943: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 02:00:52.165208 28530 raft_consensus.cc:697] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302 [term 2 LEADER]: Becoming Leader. State: Replica: 17b49c694faf479ea2e5083470fc0302, State: Running, Role: LEADER
I20260810 02:00:52.165642 28530 consensus_queue.cc:237] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 9, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 02:00:52.189888 3564 catalog_manager.cc:5719] T f7a36f7ebd5d4342a259b093e45d4c32 P 4dd4cba155c941b4b7ad4d64c7431536 reported cstate change: term changed from 1 to 2, leader changed from 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194) to 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197). New cstate: current_term: 2 leader_uuid: "4dd4cba155c941b4b7ad4d64c7431536" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } }
W20260810 02:00:52.226979 6479 leader_election.cc:336] T e70193bd4055469d870a76542eaef524 P 22ce0e487f0341fd9bf853393d6e7683 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): Network error: Client connection negotiation failed: client connection to 127.21.64.194:43893: connect: Connection refused (error 111)
W20260810 02:00:52.229522 6479 leader_election.cc:336] T e70193bd4055469d870a76542eaef524 P 22ce0e487f0341fd9bf853393d6e7683 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): Network error: Client connection negotiation failed: client connection to 127.21.64.196:41943: connect: Connection refused (error 111)
I20260810 02:00:52.229683 6479 leader_election.cc:304] T e70193bd4055469d870a76542eaef524 P 22ce0e487f0341fd9bf853393d6e7683 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22ce0e487f0341fd9bf853393d6e7683; no voters: 82f93d1d11364ceeb485585b4ae78871, ca4469fc2dbc48488bc7ad7f482f129e
I20260810 02:00:52.229933 28698 raft_consensus.cc:2749] T e70193bd4055469d870a76542eaef524 P 22ce0e487f0341fd9bf853393d6e7683 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260810 02:00:52.230259 6479 consensus_peers.cc:597] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683 -> Peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): Couldn't send request to peer ca4469fc2dbc48488bc7ad7f482f129e. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.196:41943: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260810 02:00:52.243319 4041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.64.199:41689, user_credentials={real_user=slave}} blocked reactor thread for 120112us
I20260810 02:00:52.270157 3564 catalog_manager.cc:5719] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302 reported cstate change: term changed from 1 to 2, leader changed from ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) to 17b49c694faf479ea2e5083470fc0302 (127.21.64.195). New cstate: current_term: 2 leader_uuid: "17b49c694faf479ea2e5083470fc0302" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } }
I20260810 02:00:52.270695 3564 catalog_manager.cc:5719] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302 reported cstate change: term changed from 1 to 2, leader changed from ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196) to 17b49c694faf479ea2e5083470fc0302 (127.21.64.195). New cstate: current_term: 2 leader_uuid: "17b49c694faf479ea2e5083470fc0302" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } }
I20260810 02:00:52.387099 4043 maintenance_manager.cc:643] P 17b49c694faf479ea2e5083470fc0302: FlushMRSOp(eb90d508a0004daa8f10d562cefe5fd6) complete. Timing: real 0.227s user 0.038s sys 0.017s Metrics: {"bytes_written":6152,"cfile_init":1,"dirs.queue_time_us":25435,"dirs.run_cpu_time_us":243,"dirs.run_wall_time_us":5601,"drs_written":1,"lbm_read_time_us":79,"lbm_reads_lt_1ms":4,"lbm_write_time_us":895,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":676,"thread_start_us":31118,"threads_started":1}
I20260810 02:00:52.388717 4195 maintenance_manager.cc:419] P 17b49c694faf479ea2e5083470fc0302: Scheduling UndoDeltaBlockGCOp(eb90d508a0004daa8f10d562cefe5fd6): 4834 bytes on disk
I20260810 02:00:52.393888 4043 maintenance_manager.cc:643] P 17b49c694faf479ea2e5083470fc0302: UndoDeltaBlockGCOp(eb90d508a0004daa8f10d562cefe5fd6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":131,"lbm_reads_lt_1ms":4}
W20260810 02:00:52.551961 4038 consensus_peers.cc:597] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302 -> Peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): Couldn't send request to peer ca4469fc2dbc48488bc7ad7f482f129e. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.196:41943: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260810 02:00:52.571960 4036 consensus_peers.cc:597] T c53fc4008faf445fa05e436b9c8e0282 P 17b49c694faf479ea2e5083470fc0302 -> Peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797): Couldn't send request to peer dc85be7d460a404f997177f57680850f. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.193:36797: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260810 02:00:52.602980 4038 consensus_peers.cc:597] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302 -> Peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): Couldn't send request to peer ca4469fc2dbc48488bc7ad7f482f129e. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.196:41943: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 02:00:52.603102 28376 raft_consensus.cc:493] T cf531b93380e43bfa103837bd6350834 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dc85be7d460a404f997177f57680850f)
I20260810 02:00:52.603307 28376 raft_consensus.cc:515] T cf531b93380e43bfa103837bd6350834 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 02:00:52.604318 28376 leader_election.cc:290] T cf531b93380e43bfa103837bd6350834 P 22ce0e487f0341fd9bf853393d6e7683 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dc85be7d460a404f997177f57680850f (127.21.64.193:36797), 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
W20260810 02:00:52.607398 6477 leader_election.cc:336] T cf531b93380e43bfa103837bd6350834 P 22ce0e487f0341fd9bf853393d6e7683 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797): Network error: Client connection negotiation failed: client connection to 127.21.64.193:36797: connect: Connection refused (error 111)
W20260810 02:00:52.614421 4036 consensus_peers.cc:597] T f3d04e9457c944a8a72861680bdf9b7c P 17b49c694faf479ea2e5083470fc0302 -> Peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797): Couldn't send request to peer dc85be7d460a404f997177f57680850f. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.193:36797: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260810 02:00:52.618206 6311 consensus_peers.cc:597] T 0afbd7afdd834537b15c727355724562 P 4dd4cba155c941b4b7ad4d64c7431536 -> Peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): Couldn't send request to peer ca4469fc2dbc48488bc7ad7f482f129e. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.196:41943: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260810 02:00:52.620810 6311 consensus_peers.cc:597] T f7a36f7ebd5d4342a259b093e45d4c32 P 4dd4cba155c941b4b7ad4d64c7431536 -> Peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): Couldn't send request to peer 82f93d1d11364ceeb485585b4ae78871. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.194:43893: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260810 02:00:52.624243 6479 leader_election.cc:336] T cf531b93380e43bfa103837bd6350834 P 22ce0e487f0341fd9bf853393d6e7683 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): Network error: Client connection negotiation failed: client connection to 127.21.64.194:43893: connect: Connection refused (error 111)
I20260810 02:00:52.624387 6479 leader_election.cc:304] T cf531b93380e43bfa103837bd6350834 P 22ce0e487f0341fd9bf853393d6e7683 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22ce0e487f0341fd9bf853393d6e7683; no voters: 82f93d1d11364ceeb485585b4ae78871, dc85be7d460a404f997177f57680850f
I20260810 02:00:52.624663 28376 raft_consensus.cc:2749] T cf531b93380e43bfa103837bd6350834 P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 02:00:52.630923 28553 raft_consensus.cc:493] T b63d0798e1ae4aea9b0272716d53d46d P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 82f93d1d11364ceeb485585b4ae78871)
I20260810 02:00:52.631111 28553 raft_consensus.cc:515] T b63d0798e1ae4aea9b0272716d53d46d P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 02:00:52.631783 28553 leader_election.cc:290] T b63d0798e1ae4aea9b0272716d53d46d P c5ed5317da9c464b93f979c405f0f6e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893), dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
W20260810 02:00:52.634122 6655 leader_election.cc:336] T b63d0798e1ae4aea9b0272716d53d46d P c5ed5317da9c464b93f979c405f0f6e4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): Network error: Client connection negotiation failed: client connection to 127.21.64.194:43893: connect: Connection refused (error 111)
I20260810 02:00:52.651391 6735 raft_consensus.cc:1275] T 1d377b919f4748c88efb249dfc964f17 P c5ed5317da9c464b93f979c405f0f6e4 [term 2 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20260810 02:00:52.651964 6735 raft_consensus.cc:1275] T f7a36f7ebd5d4342a259b093e45d4c32 P c5ed5317da9c464b93f979c405f0f6e4 [term 2 FOLLOWER]: Refusing update from remote peer 4dd4cba155c941b4b7ad4d64c7431536: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 2 index: 11. (index mismatch)
I20260810 02:00:52.652750 28696 consensus_queue.cc:1048] T 1d377b919f4748c88efb249dfc964f17 P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260810 02:00:52.653807 28340 consensus_queue.cc:1048] T f7a36f7ebd5d4342a259b093e45d4c32 P 4dd4cba155c941b4b7ad4d64c7431536 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260810 02:00:52.662580 6653 leader_election.cc:336] T b63d0798e1ae4aea9b0272716d53d46d P c5ed5317da9c464b93f979c405f0f6e4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797): Network error: Client connection negotiation failed: client connection to 127.21.64.193:36797: connect: Connection refused (error 111)
I20260810 02:00:52.662799 6653 leader_election.cc:304] T b63d0798e1ae4aea9b0272716d53d46d P c5ed5317da9c464b93f979c405f0f6e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ed5317da9c464b93f979c405f0f6e4; no voters: 82f93d1d11364ceeb485585b4ae78871, dc85be7d460a404f997177f57680850f
I20260810 02:00:52.663153 28553 raft_consensus.cc:2749] T b63d0798e1ae4aea9b0272716d53d46d P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 02:00:52.689966 6739 raft_consensus.cc:1275] T a586b7d625bb4c27a6343ae7918c8cea P c5ed5317da9c464b93f979c405f0f6e4 [term 2 FOLLOWER]: Refusing update from remote peer 17b49c694faf479ea2e5083470fc0302: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20260810 02:00:52.690588 28530 consensus_queue.cc:1048] T a586b7d625bb4c27a6343ae7918c8cea P 17b49c694faf479ea2e5083470fc0302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260810 02:00:52.716648 6909 raft_consensus.cc:1275] T f7a36f7ebd5d4342a259b093e45d4c32 P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Refusing update from remote peer 4dd4cba155c941b4b7ad4d64c7431536: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 2 index: 11. (index mismatch)
I20260810 02:00:52.717358 28340 consensus_queue.cc:1048] T f7a36f7ebd5d4342a259b093e45d4c32 P 4dd4cba155c941b4b7ad4d64c7431536 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260810 02:00:53.038993 6824 consensus_peers.cc:597] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227 -> Peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797): Couldn't send request to peer dc85be7d460a404f997177f57680850f. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.193:36797: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260810 02:00:53.047292 6655 consensus_peers.cc:597] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4 -> Peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): Couldn't send request to peer 82f93d1d11364ceeb485585b4ae78871. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.194:43893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260810 02:00:53.098435 28696 raft_consensus.cc:493] T 606ad043ee3344c39c9eef7cd1920d7e P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca4469fc2dbc48488bc7ad7f482f129e)
I20260810 02:00:53.098644 28696 raft_consensus.cc:515] T 606ad043ee3344c39c9eef7cd1920d7e P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 02:00:53.113912 28696 leader_election.cc:290] T 606ad043ee3344c39c9eef7cd1920d7e P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943), dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
W20260810 02:00:53.122583 4038 leader_election.cc:336] T 606ad043ee3344c39c9eef7cd1920d7e P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): Network error: Client connection negotiation failed: client connection to 127.21.64.196:41943: connect: Connection refused (error 111)
W20260810 02:00:53.123019 4036 leader_election.cc:336] T 606ad043ee3344c39c9eef7cd1920d7e P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797): Network error: Client connection negotiation failed: client connection to 127.21.64.193:36797: connect: Connection refused (error 111)
I20260810 02:00:53.123157 4036 leader_election.cc:304] T 606ad043ee3344c39c9eef7cd1920d7e P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17b49c694faf479ea2e5083470fc0302; no voters: ca4469fc2dbc48488bc7ad7f482f129e, dc85be7d460a404f997177f57680850f
I20260810 02:00:53.123639 28696 raft_consensus.cc:2749] T 606ad043ee3344c39c9eef7cd1920d7e P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 02:00:53.149154 4195 maintenance_manager.cc:419] P 17b49c694faf479ea2e5083470fc0302: Scheduling FlushMRSOp(606ad043ee3344c39c9eef7cd1920d7e): perf score=0.033384
I20260810 02:00:53.247872 4043 maintenance_manager.cc:643] P 17b49c694faf479ea2e5083470fc0302: FlushMRSOp(606ad043ee3344c39c9eef7cd1920d7e) complete. Timing: real 0.098s user 0.037s sys 0.029s Metrics: {"bytes_written":6152,"cfile_init":1,"dirs.queue_time_us":2842,"dirs.run_cpu_time_us":195,"dirs.run_wall_time_us":1414,"drs_written":1,"lbm_read_time_us":118,"lbm_reads_lt_1ms":4,"lbm_write_time_us":923,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":676,"thread_start_us":18060,"threads_started":2,"wal-append.queue_time_us":15144}
I20260810 02:00:53.249454 4195 maintenance_manager.cc:419] P 17b49c694faf479ea2e5083470fc0302: Scheduling UndoDeltaBlockGCOp(606ad043ee3344c39c9eef7cd1920d7e): 4834 bytes on disk
I20260810 02:00:53.254122 4043 maintenance_manager.cc:643] P 17b49c694faf479ea2e5083470fc0302: UndoDeltaBlockGCOp(606ad043ee3344c39c9eef7cd1920d7e) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":142,"lbm_reads_lt_1ms":4}
W20260810 02:00:53.287765 4038 consensus_peers.cc:597] T 4fc45932b9634d6d98d8a0204d4b121a P 17b49c694faf479ea2e5083470fc0302 -> Peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): Couldn't send request to peer ca4469fc2dbc48488bc7ad7f482f129e. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.196:41943: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260810 02:00:53.296988 6970 rebalancer_tool-test.cc:1258] rebalancer run info: Runtime error: /tmp/dist-test-taskNubV1X/build/asan/bin/kudu: process exited with non-zero status 1
stdout: Per-server replica distribution summary:
Statistic | Value
-----------------------+-----------
Minimum Replica Count | 0
Maximum Replica Count | 23
Average Replica Count | 11.250000
Per-table replica distribution summary:
Replica Skew | Value
--------------+----------
Minimum | 3
Maximum | 3
Average | 3.000000
stderr: W20260810 01:59:04.239279 6981 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:59:04.239814 6981 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260810 01:59:08.970996 6981 rebalancer_tool.cc:215] running whole-cluster rebalancing
W20260810 01:59:10.942045 6981 rebalancer_tool.cc:1212] table b572363d270a4bfda571d46e96d0bfda: no follower replicas available on 17b49c694faf479ea2e5083470fc0302, falling back to leader replicas
W20260810 01:59:10.942414 6981 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 372310cb713644ada1071e8eb628b0c9: could not find any suitable replica to move from server ca4469fc2dbc48488bc7ad7f482f129e to server 3136daf7101445beadc1aa19bc01c227
W20260810 01:59:10.949529 6981 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 945a223441a04ba2bf938b104bc91cf8: could not find any suitable replica to move from server ca4469fc2dbc48488bc7ad7f482f129e to server 22ce0e487f0341fd9bf853393d6e7683
W20260810 01:59:10.950016 6981 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table afa71147917d44a585bcbaa37497a2b1: could not find any suitable replica to move from server 82f93d1d11364ceeb485585b4ae78871 to server c5ed5317da9c464b93f979c405f0f6e4
W20260810 01:59:10.950227 6981 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 5e8751d351ba4b7da7861e02b0c3c634: could not find any suitable replica to move from server 82f93d1d11364ceeb485585b4ae78871 to server 3136daf7101445beadc1aa19bc01c227
W20260810 01:59:10.950379 6981 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table b572363d270a4bfda571d46e96d0bfda: could not find any suitable replica to move from server ca4469fc2dbc48488bc7ad7f482f129e to server 22ce0e487f0341fd9bf853393d6e7683
W20260810 01:59:10.950657 6981 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 5b2df46262b142169af9a32c47535432: could not find any suitable replica to move from server ca4469fc2dbc48488bc7ad7f482f129e to server c5ed5317da9c464b93f979c405f0f6e4
W20260810 01:59:10.950831 6981 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table e211628d46b64734960dfd60d86708ce: could not find any suitable replica to move from server 82f93d1d11364ceeb485585b4ae78871 to server 3136daf7101445beadc1aa19bc01c227
W20260810 01:59:10.950947 6981 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 5b2df46262b142169af9a32c47535432: could not find any suitable replica to move from server dc85be7d460a404f997177f57680850f to server 22ce0e487f0341fd9bf853393d6e7683
W20260810 01:59:10.951107 6981 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table c515c90b2c71492f812b4df18501ee04: could not find any suitable replica to move from server 17b49c694faf479ea2e5083470fc0302 to server 3136daf7101445beadc1aa19bc01c227
W20260810 01:59:10.951221 6981 rebalancer_tool.cc:1212] table c515c90b2c71492f812b4df18501ee04: no follower replicas available on dc85be7d460a404f997177f57680850f, falling back to leader replicas
W20260810 01:59:10.951321 6981 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table c515c90b2c71492f812b4df18501ee04: could not find any suitable replica to move from server dc85be7d460a404f997177f57680850f to server 4dd4cba155c941b4b7ad4d64c7431536
W20260810 01:59:10.951442 6981 rebalancer_tool.cc:1212] table 8fd8ee0beeb54ad9bee1c94775d09e8f: no follower replicas available on ca4469fc2dbc48488bc7ad7f482f129e, falling back to leader replicas
W20260810 01:59:10.951553 6981 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 8fd8ee0beeb54ad9bee1c94775d09e8f: could not find any suitable replica to move from server ca4469fc2dbc48488bc7ad7f482f129e to server c5ed5317da9c464b93f979c405f0f6e4
W20260810 01:59:10.951681 6981 rebalancer_tool.cc:1212] table 3e1f7b9b31614ed383207098de38230c: no follower replicas available on 82f93d1d11364ceeb485585b4ae78871, falling back to leader replicas
W20260810 01:59:10.951794 6981 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 3e1f7b9b31614ed383207098de38230c: could not find any suitable replica to move from server 82f93d1d11364ceeb485585b4ae78871 to server c5ed5317da9c464b93f979c405f0f6e4
W20260810 01:59:10.951941 6981 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 3e1f7b9b31614ed383207098de38230c: could not find any suitable replica to move from server ca4469fc2dbc48488bc7ad7f482f129e to server 4dd4cba155c941b4b7ad4d64c7431536
W20260810 01:59:10.952064 6981 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table c515c90b2c71492f812b4df18501ee04: could not find any suitable replica to move from server 82f93d1d11364ceeb485585b4ae78871 to server 22ce0e487f0341fd9bf853393d6e7683
W20260810 01:59:10.952186 6981 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 945a223441a04ba2bf938b104bc91cf8: could not find any suitable replica to move from server dc85be7d460a404f997177f57680850f to server c5ed5317da9c464b93f979c405f0f6e4
W20260810 01:59:10.952306 6981 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table e211628d46b64734960dfd60d86708ce: could not find any suitable replica to move from server ca4469fc2dbc48488bc7ad7f482f129e to server 3136daf7101445beadc1aa19bc01c227
I20260810 01:59:11.343509 6981 rebalancer_tool.cc:1090] tablet f7a36f7ebd5d4342a259b093e45d4c32: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '4dd4cba155c941b4b7ad4d64c7431536' move scheduled
I20260810 01:59:11.998374 6981 rebalancer_tool.cc:1090] tablet df5b102a0b03406f9449cdd84dfd147e: '82f93d1d11364ceeb485585b4ae78871' -> 'c5ed5317da9c464b93f979c405f0f6e4' move scheduled
I20260810 01:59:12.393307 6981 rebalancer_tool.cc:1090] tablet 252899385eaa45b392974d2768e3cf01: '17b49c694faf479ea2e5083470fc0302' -> '22ce0e487f0341fd9bf853393d6e7683' move scheduled
I20260810 01:59:13.111352 6981 rebalancer_tool.cc:1090] tablet 4a4350cf2ece4769b8547620ac5bedcb: 'dc85be7d460a404f997177f57680850f' -> '3136daf7101445beadc1aa19bc01c227' move scheduled
I20260810 01:59:13.337759 6981 rebalancer_tool.cc:1100] tablet 4fc45932b9634d6d98d8a0204d4b121a: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '4dd4cba155c941b4b7ad4d64c7431536' move ignored: Illegal state: tablet 4fc45932b9634d6d98d8a0204d4b121a: replica 4dd4cba155c941b4b7ad4d64c7431536 is already present
I20260810 01:59:13.338013 6981 rebalancer_tool.cc:772] re-synchronizing cluster state
W20260810 01:59:15.221787 6981 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table e211628d46b64734960dfd60d86708ce: could not find any suitable replica to move from server 82f93d1d11364ceeb485585b4ae78871 to server c5ed5317da9c464b93f979c405f0f6e4
W20260810 01:59:15.222146 6981 rebalancer_tool.cc:1212] table b572363d270a4bfda571d46e96d0bfda: no follower replicas available on 17b49c694faf479ea2e5083470fc0302, falling back to leader replicas
W20260810 01:59:15.222412 6981 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table afa71147917d44a585bcbaa37497a2b1: could not find any suitable replica to move from server 82f93d1d11364ceeb485585b4ae78871 to server c5ed5317da9c464b93f979c405f0f6e4
W20260810 01:59:15.222579 6981 rebalancer_tool.cc:1212] table 3e1f7b9b31614ed383207098de38230c: no follower replicas available on ca4469fc2dbc48488bc7ad7f482f129e, falling back to leader replicas
W20260810 01:59:15.222785 6981 rebalancer_tool.cc:1212] table b572363d270a4bfda571d46e96d0bfda: no follower replicas available on 17b49c694faf479ea2e5083470fc0302, falling back to leader replicas
W20260810 01:59:15.222980 6981 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table b572363d270a4bfda571d46e96d0bfda: could not find any suitable replica to move from server 82f93d1d11364ceeb485585b4ae78871 to server 4dd4cba155c941b4b7ad4d64c7431536
W20260810 01:59:15.223253 6981 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table b572363d270a4bfda571d46e96d0bfda: could not find any suitable replica to move from server dc85be7d460a404f997177f57680850f to server 3136daf7101445beadc1aa19bc01c227
W20260810 01:59:15.223452 6981 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 8fd8ee0beeb54ad9bee1c94775d09e8f: could not find any suitable replica to move from server 17b49c694faf479ea2e5083470fc0302 to server 4dd4cba155c941b4b7ad4d64c7431536
W20260810 01:59:15.223733 6981 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table e211628d46b64734960dfd60d86708ce: could not find any suitable replica to move from server 82f93d1d11364ceeb485585b4ae78871 to server 4dd4cba155c941b4b7ad4d64c7431536
W20260810 01:59:15.223991 6981 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 372310cb713644ada1071e8eb628b0c9: could not find any suitable replica to move from server ca4469fc2dbc48488bc7ad7f482f129e to server c5ed5317da9c464b93f979c405f0f6e4
W20260810 01:59:15.224229 6981 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 3e1f7b9b31614ed383207098de38230c: could not find any suitable replica to move from server 17b49c694faf479ea2e5083470fc0302 to server c5ed5317da9c464b93f979c405f0f6e4
I20260810 01:59:15.400724 6981 rebalancer_tool.cc:1090] tablet 8308d63e9002418b876c3d3ae0095d9f: 'dc85be7d460a404f997177f57680850f' -> '' move scheduled
I20260810 01:59:15.907183 6981 rebalancer_tool.cc:1090] tablet 57f6f22d97c14ed98960e27ce2c8f3fb: '17b49c694faf479ea2e5083470fc0302' -> '4dd4cba155c941b4b7ad4d64c7431536' move scheduled
I20260810 01:59:16.286558 6981 rebalancer_tool.cc:1100] tablet f3d04e9457c944a8a72861680bdf9b7c: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '3136daf7101445beadc1aa19bc01c227' move ignored: Illegal state: Request specified cas_config_opid_index of -1 but the committed config has opid_index of 4
I20260810 01:59:16.286705 6981 rebalancer_tool.cc:772] re-synchronizing cluster state
W20260810 01:59:18.143342 6981 rebalancer_tool.cc:1212] table b572363d270a4bfda571d46e96d0bfda: no follower replicas available on 17b49c694faf479ea2e5083470fc0302, falling back to leader replicas
W20260810 01:59:18.146045 6981 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table c515c90b2c71492f812b4df18501ee04: could not find any suitable replica to move from server ca4469fc2dbc48488bc7ad7f482f129e to server c5ed5317da9c464b93f979c405f0f6e4
W20260810 01:59:18.149091 6981 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 372310cb713644ada1071e8eb628b0c9: could not find any suitable replica to move from server 17b49c694faf479ea2e5083470fc0302 to server 4dd4cba155c941b4b7ad4d64c7431536
W20260810 01:59:18.149497 6981 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table b572363d270a4bfda571d46e96d0bfda: could not find any suitable replica to move from server 82f93d1d11364ceeb485585b4ae78871 to server 22ce0e487f0341fd9bf853393d6e7683
I20260810 01:59:18.600795 6981 rebalancer_tool.cc:1090] tablet be4737d169be4419b5a0a0b656a3930f: '82f93d1d11364ceeb485585b4ae78871' -> '' move scheduled
I20260810 01:59:19.333422 6981 rebalancer_tool.cc:1090] tablet fe8e1f0908234e46881258cfe79835f8: 'dc85be7d460a404f997177f57680850f' -> 'c5ed5317da9c464b93f979c405f0f6e4' move scheduled
I20260810 01:59:19.734040 6981 rebalancer_tool.cc:1090] tablet d05e147199e44b8ca712e18d22e7cce7: '17b49c694faf479ea2e5083470fc0302' -> '3136daf7101445beadc1aa19bc01c227' move scheduled
I20260810 01:59:20.035838 6981 rebalancer_tool.cc:1100] tablet e70193bd4055469d870a76542eaef524: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '22ce0e487f0341fd9bf853393d6e7683' move ignored: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }.
Pending config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 01:59:20.036087 6981 rebalancer_tool.cc:772] re-synchronizing cluster state
W20260810 01:59:22.011837 6981 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 372310cb713644ada1071e8eb628b0c9: could not find any suitable replica to move from server 82f93d1d11364ceeb485585b4ae78871 to server 3136daf7101445beadc1aa19bc01c227
W20260810 01:59:22.012111 6981 rebalancer_tool.cc:1212] table b572363d270a4bfda571d46e96d0bfda: no follower replicas available on dc85be7d460a404f997177f57680850f, falling back to leader replicas
W20260810 01:59:22.012238 6981 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table b572363d270a4bfda571d46e96d0bfda: could not find any suitable replica to move from server dc85be7d460a404f997177f57680850f to server c5ed5317da9c464b93f979c405f0f6e4
W20260810 01:59:22.012482 6981 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 372310cb713644ada1071e8eb628b0c9: could not find any suitable replica to move from server 17b49c694faf479ea2e5083470fc0302 to server 22ce0e487f0341fd9bf853393d6e7683
W20260810 01:59:22.012616 6981 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table afa71147917d44a585bcbaa37497a2b1: could not find any suitable replica to move from server 82f93d1d11364ceeb485585b4ae78871 to server c5ed5317da9c464b93f979c405f0f6e4
I20260810 01:59:22.096899 6981 rebalancer_tool.cc:1090] tablet 4fc45932b9634d6d98d8a0204d4b121a: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '' move scheduled
I20260810 01:59:22.283921 6981 rebalancer_tool.cc:1100] tablet eb90d508a0004daa8f10d562cefe5fd6: '17b49c694faf479ea2e5083470fc0302' -> '3136daf7101445beadc1aa19bc01c227' move ignored: Illegal state: tablet eb90d508a0004daa8f10d562cefe5fd6: replica 3136daf7101445beadc1aa19bc01c227 is already present
I20260810 01:59:22.284164 6981 rebalancer_tool.cc:772] re-synchronizing cluster state
W20260810 01:59:24.027038 6981 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table afa71147917d44a585bcbaa37497a2b1: could not find any suitable replica to move from server dc85be7d460a404f997177f57680850f to server c5ed5317da9c464b93f979c405f0f6e4
W20260810 01:59:24.027326 6981 rebalancer_tool.cc:1212] table 8fd8ee0beeb54ad9bee1c94775d09e8f: no follower replicas available on ca4469fc2dbc48488bc7ad7f482f129e, falling back to leader replicas
W20260810 01:59:24.027443 6981 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table afa71147917d44a585bcbaa37497a2b1: could not find any suitable replica to move from server 82f93d1d11364ceeb485585b4ae78871 to server c5ed5317da9c464b93f979c405f0f6e4
W20260810 01:59:24.027544 6981 rebalancer_tool.cc:1212] table c515c90b2c71492f812b4df18501ee04: no follower replicas available on 82f93d1d11364ceeb485585b4ae78871, falling back to leader replicas
W20260810 01:59:24.027695 6981 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 8fd8ee0beeb54ad9bee1c94775d09e8f: could not find any suitable replica to move from server 17b49c694faf479ea2e5083470fc0302 to server c5ed5317da9c464b93f979c405f0f6e4
W20260810 01:59:24.027791 6981 rebalancer_tool.cc:1212] table 372310cb713644ada1071e8eb628b0c9: no follower replicas available on ca4469fc2dbc48488bc7ad7f482f129e, falling back to leader replicas
W20260810 01:59:24.027859 6981 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 372310cb713644ada1071e8eb628b0c9: could not find any suitable replica to move from server ca4469fc2dbc48488bc7ad7f482f129e to server 3136daf7101445beadc1aa19bc01c227
W20260810 01:59:24.027948 6981 rebalancer_tool.cc:1212] table c515c90b2c71492f812b4df18501ee04: no follower replicas available on dc85be7d460a404f997177f57680850f, falling back to leader replicas
W20260810 01:59:24.028017 6981 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table c515c90b2c71492f812b4df18501ee04: could not find any suitable replica to move from server dc85be7d460a404f997177f57680850f to server 4dd4cba155c941b4b7ad4d64c7431536
I20260810 01:59:24.221827 6981 rebalancer_tool.cc:1090] tablet 5528e3ba51a640eaa614f141440bb90b: '82f93d1d11364ceeb485585b4ae78871' -> '' move scheduled
I20260810 01:59:24.332873 6981 rebalancer_tool.cc:1090] tablet c53fc4008faf445fa05e436b9c8e0282: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '' move scheduled
I20260810 01:59:39.869388 6981 rebalancer_tool.cc:1152] tablet be4737d169be4419b5a0a0b656a3930f: '82f93d1d11364ceeb485585b4ae78871' -> '' move completed: OK
I20260810 01:59:46.016903 6981 rebalancer_tool.cc:1152] tablet f7a36f7ebd5d4342a259b093e45d4c32: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '4dd4cba155c941b4b7ad4d64c7431536' move completed: OK
I20260810 01:59:48.484236 6981 rebalancer_tool.cc:1152] tablet 8308d63e9002418b876c3d3ae0095d9f: 'dc85be7d460a404f997177f57680850f' -> '' move completed: OK
I20260810 01:59:48.651866 6981 rebalancer_tool.cc:1152] tablet 57f6f22d97c14ed98960e27ce2c8f3fb: '17b49c694faf479ea2e5083470fc0302' -> '4dd4cba155c941b4b7ad4d64c7431536' move completed: OK
I20260810 01:59:48.749655 6981 rebalancer_tool.cc:1090] tablet 1d377b919f4748c88efb249dfc964f17: '82f93d1d11364ceeb485585b4ae78871' -> '' move scheduled
I20260810 01:59:48.905040 6981 rebalancer_tool.cc:1090] tablet 0afbd7afdd834537b15c727355724562: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '' move scheduled
I20260810 01:59:49.109756 6981 rebalancer_tool.cc:1152] tablet 1d377b919f4748c88efb249dfc964f17: '82f93d1d11364ceeb485585b4ae78871' -> '' move completed: OK
I20260810 01:59:49.159530 6981 rebalancer_tool.cc:1152] tablet 5528e3ba51a640eaa614f141440bb90b: '82f93d1d11364ceeb485585b4ae78871' -> '' move completed: OK
I20260810 01:59:49.202785 6981 rebalancer_tool.cc:1152] tablet 4fc45932b9634d6d98d8a0204d4b121a: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '' move completed: OK
I20260810 01:59:49.319636 6981 rebalancer_tool.cc:1152] tablet c53fc4008faf445fa05e436b9c8e0282: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '' move completed: OK
I20260810 01:59:49.468396 6981 rebalancer_tool.cc:1152] tablet d05e147199e44b8ca712e18d22e7cce7: '17b49c694faf479ea2e5083470fc0302' -> '3136daf7101445beadc1aa19bc01c227' move completed: OK
I20260810 01:59:49.768405 6981 rebalancer_tool.cc:1152] tablet fe8e1f0908234e46881258cfe79835f8: 'dc85be7d460a404f997177f57680850f' -> 'c5ed5317da9c464b93f979c405f0f6e4' move completed: OK
I20260810 01:59:49.858390 6981 rebalancer_tool.cc:1152] tablet df5b102a0b03406f9449cdd84dfd147e: '82f93d1d11364ceeb485585b4ae78871' -> 'c5ed5317da9c464b93f979c405f0f6e4' move completed: OK
I20260810 01:59:53.307878 6981 rebalancer_tool.cc:1152] tablet 252899385eaa45b392974d2768e3cf01: '17b49c694faf479ea2e5083470fc0302' -> '22ce0e487f0341fd9bf853393d6e7683' move completed: OK
I20260810 01:59:53.522681 6981 rebalancer_tool.cc:1152] tablet 4a4350cf2ece4769b8547620ac5bedcb: 'dc85be7d460a404f997177f57680850f' -> '3136daf7101445beadc1aa19bc01c227' move completed: OK
I20260810 01:59:53.684504 6981 rebalancer_tool.cc:1090] tablet da507bc24d964ce1a5835edad5177726: '82f93d1d11364ceeb485585b4ae78871' -> '' move scheduled
I20260810 01:59:53.860848 6981 rebalancer_tool.cc:1090] tablet 8e8d13caf8054b1daf09b2b114843766: '17b49c694faf479ea2e5083470fc0302' -> '' move scheduled
I20260810 01:59:53.990182 6981 rebalancer_tool.cc:1090] tablet a586b7d625bb4c27a6343ae7918c8cea: 'dc85be7d460a404f997177f57680850f' -> '' move scheduled
I20260810 01:59:54.153362 6981 rebalancer_tool.cc:1090] tablet f3d04e9457c944a8a72861680bdf9b7c: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '' move scheduled
I20260810 01:59:54.249876 6981 rebalancer_tool.cc:1152] tablet f3d04e9457c944a8a72861680bdf9b7c: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '' move completed: OK
I20260810 01:59:54.314298 6981 rebalancer_tool.cc:1152] tablet a586b7d625bb4c27a6343ae7918c8cea: 'dc85be7d460a404f997177f57680850f' -> '' move completed: OK
I20260810 01:59:54.410564 6981 rebalancer_tool.cc:1152] tablet 8e8d13caf8054b1daf09b2b114843766: '17b49c694faf479ea2e5083470fc0302' -> '' move completed: OK
I20260810 02:00:02.549156 6981 rebalancer_tool.cc:1090] tablet cf531b93380e43bfa103837bd6350834: '17b49c694faf479ea2e5083470fc0302' -> '' move scheduled
I20260810 02:00:02.707428 6981 rebalancer_tool.cc:1090] tablet 389d3abfeadd4fe6a4efa74427d71c4d: '82f93d1d11364ceeb485585b4ae78871' -> '' move scheduled
I20260810 02:00:03.085175 6981 rebalancer_tool.cc:1090] tablet 2e72e04459b140cc9e20ad633b1ab5c4: '17b49c694faf479ea2e5083470fc0302' -> '' move scheduled
I20260810 02:00:05.254714 6981 rebalancer_tool.cc:1152] tablet 389d3abfeadd4fe6a4efa74427d71c4d: '82f93d1d11364ceeb485585b4ae78871' -> '' move completed: OK
I20260810 02:00:05.446157 6981 rebalancer_tool.cc:1152] tablet cf531b93380e43bfa103837bd6350834: '17b49c694faf479ea2e5083470fc0302' -> '' move completed: OK
I20260810 02:00:13.154992 6981 rebalancer_tool.cc:1152] tablet 2e72e04459b140cc9e20ad633b1ab5c4: '17b49c694faf479ea2e5083470fc0302' -> '' move completed: OK
I20260810 02:00:13.317531 6981 rebalancer_tool.cc:1152] tablet da507bc24d964ce1a5835edad5177726: '82f93d1d11364ceeb485585b4ae78871' -> '' move completed: OK
I20260810 02:00:13.589682 6981 rebalancer_tool.cc:1152] tablet 0afbd7afdd834537b15c727355724562: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '' move completed: OK
I20260810 02:00:16.007689 6981 rebalancer_tool.cc:1090] tablet 252899385eaa45b392974d2768e3cf01: '22ce0e487f0341fd9bf853393d6e7683' -> '3136daf7101445beadc1aa19bc01c227' move scheduled
I20260810 02:00:16.430081 6981 rebalancer_tool.cc:1090] tablet cf531b93380e43bfa103837bd6350834: 'c5ed5317da9c464b93f979c405f0f6e4' -> '82f93d1d11364ceeb485585b4ae78871' move scheduled
I20260810 02:00:16.646651 6981 rebalancer_tool.cc:1090] tablet f7a36f7ebd5d4342a259b093e45d4c32: '22ce0e487f0341fd9bf853393d6e7683' -> '' move scheduled
I20260810 02:00:23.737828 6981 rebalancer_tool.cc:1152] tablet f7a36f7ebd5d4342a259b093e45d4c32: '22ce0e487f0341fd9bf853393d6e7683' -> '' move completed: OK
I20260810 02:00:23.969812 6981 rebalancer_tool.cc:1152] tablet cf531b93380e43bfa103837bd6350834: 'c5ed5317da9c464b93f979c405f0f6e4' -> '82f93d1d11364ceeb485585b4ae78871' move completed: OK
I20260810 02:00:24.185581 6981 rebalancer_tool.cc:1152] tablet 252899385eaa45b392974d2768e3cf01: '22ce0e487f0341fd9bf853393d6e7683' -> '3136daf7101445beadc1aa19bc01c227' move completed: OK
W20260810 02:00:26.277338 6981 rebalancer_tool.cc:1212] table 945a223441a04ba2bf938b104bc91cf8: no follower replicas available on dc85be7d460a404f997177f57680850f, falling back to leader replicas
I20260810 02:00:26.812127 6981 rebalancer_tool.cc:1090] tablet 252899385eaa45b392974d2768e3cf01: '4dd4cba155c941b4b7ad4d64c7431536' -> '22ce0e487f0341fd9bf853393d6e7683' move scheduled
I20260810 02:00:27.430747 6981 rebalancer_tool.cc:1090] tablet 5528e3ba51a640eaa614f141440bb90b: '82f93d1d11364ceeb485585b4ae78871' -> '22ce0e487f0341fd9bf853393d6e7683' move scheduled
I20260810 02:00:28.059221 6981 rebalancer_tool.cc:1090] tablet 3a15b27dbdaf4092aea66c3670204fcc: 'dc85be7d460a404f997177f57680850f' -> '3136daf7101445beadc1aa19bc01c227' move scheduled
I20260810 02:00:38.246943 6981 rebalancer_tool.cc:1152] tablet 3a15b27dbdaf4092aea66c3670204fcc: 'dc85be7d460a404f997177f57680850f' -> '3136daf7101445beadc1aa19bc01c227' move completed: OK
I20260810 02:00:38.321513 6981 rebalancer_tool.cc:1152] tablet 5528e3ba51a640eaa614f141440bb90b: '82f93d1d11364ceeb485585b4ae78871' -> '22ce0e487f0341fd9bf853393d6e7683' move completed: OK
I20260810 02:00:38.372503 6981 rebalancer_tool.cc:1152] tablet 252899385eaa45b392974d2768e3cf01: '4dd4cba155c941b4b7ad4d64c7431536' -> '22ce0e487f0341fd9bf853393d6e7683' move completed: OK
I20260810 02:00:40.092767 6981 rebalancer_tool.cc:1090] tablet 252899385eaa45b392974d2768e3cf01: '22ce0e487f0341fd9bf853393d6e7683' -> '4dd4cba155c941b4b7ad4d64c7431536' move scheduled
I20260810 02:00:42.745154 6981 rebalancer_tool.cc:1152] tablet 252899385eaa45b392974d2768e3cf01: '22ce0e487f0341fd9bf853393d6e7683' -> '4dd4cba155c941b4b7ad4d64c7431536' move completed: OK
I20260810 02:00:44.100126 6981 rebalancer_tool.cc:1090] tablet 389d3abfeadd4fe6a4efa74427d71c4d: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '82f93d1d11364ceeb485585b4ae78871' move scheduled
I20260810 02:00:44.765480 6981 rebalancer_tool.cc:1090] tablet abf302f27a12414a8647dab82ab8101f: '3136daf7101445beadc1aa19bc01c227' -> 'c5ed5317da9c464b93f979c405f0f6e4' move scheduled
W20260810 02:00:50.084115 28152 negotiation.cc:336] Failed RPC negotiation. Trace:
0810 02:00:49.405760 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.21.64.193:36797 (local address 127.0.0.1:53152)
0810 02:00:49.406524 (+ 764us) negotiation.cc:107] Waiting for socket to connect
0810 02:00:49.406544 (+ 20us) client_negotiation.cc:175] Beginning negotiation
0810 02:00:49.406636 (+ 92us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0810 02:00:50.082906 (+676270us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.64.193:36797: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":641}
W20260810 02:00:50.283934 28147 negotiation.cc:336] Failed RPC negotiation. Trace:
0810 02:00:49.329470 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.21.64.194:43893 (local address 127.0.0.1:37002)
0810 02:00:49.343264 (+ 13794us) negotiation.cc:107] Waiting for socket to connect
0810 02:00:49.343282 (+ 18us) client_negotiation.cc:175] Beginning negotiation
0810 02:00:49.343391 (+ 109us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0810 02:00:50.283783 (+940392us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.64.194:43893: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":13673}
I20260810 02:00:50.539907 6981 rebalancer_tool.cc:1139] tablet 389d3abfeadd4fe6a4efa74427d71c4d: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '82f93d1d11364ceeb485585b4ae78871' move is abandoned: Network error: Client connection negotiation failed: client connection to 127.21.64.193:36797: connect: Connection refused (error 111)
I20260810 02:00:50.540043 6981 rebalancer_tool.cc:772] re-synchronizing cluster state
Illegal state: tablet server 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): unacceptable health status UNAVAILABLE
I20260810 02:00:53.328189 6975 rebalancer_tool-test.cc:1258] rebalancer run info: Runtime error: /tmp/dist-test-taskNubV1X/build/asan/bin/kudu: process exited with non-zero status 1
stdout: Per-server replica distribution summary:
Statistic | Value
-----------------------+-----------
Minimum Replica Count | 0
Maximum Replica Count | 23
Average Replica Count | 11.250000
Per-table replica distribution summary:
Replica Skew | Value
--------------+----------
Minimum | 3
Maximum | 3
Average | 3.000000
stderr: W20260810 01:59:04.281301 6979 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:59:04.282223 6979 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260810 01:59:08.966619 6979 rebalancer_tool.cc:215] running whole-cluster rebalancing
W20260810 01:59:10.648808 6979 rebalancer_tool.cc:1212] table b572363d270a4bfda571d46e96d0bfda: no follower replicas available on 17b49c694faf479ea2e5083470fc0302, falling back to leader replicas
W20260810 01:59:10.649032 6979 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 945a223441a04ba2bf938b104bc91cf8: could not find any suitable replica to move from server ca4469fc2dbc48488bc7ad7f482f129e to server 4dd4cba155c941b4b7ad4d64c7431536
W20260810 01:59:10.649283 6979 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 3e1f7b9b31614ed383207098de38230c: could not find any suitable replica to move from server ca4469fc2dbc48488bc7ad7f482f129e to server 3136daf7101445beadc1aa19bc01c227
W20260810 01:59:10.649461 6979 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 8fd8ee0beeb54ad9bee1c94775d09e8f: could not find any suitable replica to move from server 82f93d1d11364ceeb485585b4ae78871 to server 22ce0e487f0341fd9bf853393d6e7683
W20260810 01:59:10.649706 6979 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 5b2df46262b142169af9a32c47535432: could not find any suitable replica to move from server ca4469fc2dbc48488bc7ad7f482f129e to server 3136daf7101445beadc1aa19bc01c227
W20260810 01:59:10.649897 6979 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 8fd8ee0beeb54ad9bee1c94775d09e8f: could not find any suitable replica to move from server 17b49c694faf479ea2e5083470fc0302 to server 4dd4cba155c941b4b7ad4d64c7431536
W20260810 01:59:10.650017 6979 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table e211628d46b64734960dfd60d86708ce: could not find any suitable replica to move from server 82f93d1d11364ceeb485585b4ae78871 to server 3136daf7101445beadc1aa19bc01c227
W20260810 01:59:10.650108 6979 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 372310cb713644ada1071e8eb628b0c9: could not find any suitable replica to move from server ca4469fc2dbc48488bc7ad7f482f129e to server 22ce0e487f0341fd9bf853393d6e7683
W20260810 01:59:10.650238 6979 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table b572363d270a4bfda571d46e96d0bfda: could not find any suitable replica to move from server dc85be7d460a404f997177f57680850f to server 4dd4cba155c941b4b7ad4d64c7431536
W20260810 01:59:10.650460 6979 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table afa71147917d44a585bcbaa37497a2b1: could not find any suitable replica to move from server dc85be7d460a404f997177f57680850f to server c5ed5317da9c464b93f979c405f0f6e4
W20260810 01:59:10.650547 6979 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 5e8751d351ba4b7da7861e02b0c3c634: could not find any suitable replica to move from server ca4469fc2dbc48488bc7ad7f482f129e to server 3136daf7101445beadc1aa19bc01c227
W20260810 01:59:10.650666 6979 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table c515c90b2c71492f812b4df18501ee04: could not find any suitable replica to move from server 82f93d1d11364ceeb485585b4ae78871 to server 4dd4cba155c941b4b7ad4d64c7431536
W20260810 01:59:10.650787 6979 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table afa71147917d44a585bcbaa37497a2b1: could not find any suitable replica to move from server 82f93d1d11364ceeb485585b4ae78871 to server 4dd4cba155c941b4b7ad4d64c7431536
W20260810 01:59:10.650892 6979 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 945a223441a04ba2bf938b104bc91cf8: could not find any suitable replica to move from server 17b49c694faf479ea2e5083470fc0302 to server c5ed5317da9c464b93f979c405f0f6e4
W20260810 01:59:10.651240 6979 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 372310cb713644ada1071e8eb628b0c9: could not find any suitable replica to move from server 82f93d1d11364ceeb485585b4ae78871 to server 22ce0e487f0341fd9bf853393d6e7683
W20260810 01:59:10.651382 6979 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table c515c90b2c71492f812b4df18501ee04: could not find any suitable replica to move from server ca4469fc2dbc48488bc7ad7f482f129e to server 3136daf7101445beadc1aa19bc01c227
I20260810 01:59:11.110083 6979 rebalancer_tool.cc:1090] tablet b6c5892f4de449fb8cb7f4cff7eb2e20: 'dc85be7d460a404f997177f57680850f' -> '4dd4cba155c941b4b7ad4d64c7431536' move scheduled
I20260810 01:59:11.733086 6979 rebalancer_tool.cc:1090] tablet 7207ea155ba44c0a9ba216acd22dc1b4: '82f93d1d11364ceeb485585b4ae78871' -> 'c5ed5317da9c464b93f979c405f0f6e4' move scheduled
I20260810 01:59:12.460533 6979 rebalancer_tool.cc:1090] tablet df5b102a0b03406f9449cdd84dfd147e: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '22ce0e487f0341fd9bf853393d6e7683' move scheduled
I20260810 01:59:13.182817 6979 rebalancer_tool.cc:1090] tablet 8e8d13caf8054b1daf09b2b114843766: '17b49c694faf479ea2e5083470fc0302' -> '3136daf7101445beadc1aa19bc01c227' move scheduled
I20260810 01:59:13.442078 6979 rebalancer_tool.cc:1100] tablet 4fc45932b9634d6d98d8a0204d4b121a: 'dc85be7d460a404f997177f57680850f' -> '4dd4cba155c941b4b7ad4d64c7431536' move ignored: Illegal state: tablet 4fc45932b9634d6d98d8a0204d4b121a: replica 4dd4cba155c941b4b7ad4d64c7431536 is already present
I20260810 01:59:13.442292 6979 rebalancer_tool.cc:772] re-synchronizing cluster state
W20260810 01:59:15.163380 6979 rebalancer_tool.cc:1212] table b572363d270a4bfda571d46e96d0bfda: no follower replicas available on 17b49c694faf479ea2e5083470fc0302, falling back to leader replicas
W20260810 01:59:15.163563 6979 rebalancer_tool.cc:1212] table 3e1f7b9b31614ed383207098de38230c: no follower replicas available on ca4469fc2dbc48488bc7ad7f482f129e, falling back to leader replicas
W20260810 01:59:15.163744 6979 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 5b2df46262b142169af9a32c47535432: could not find any suitable replica to move from server dc85be7d460a404f997177f57680850f to server 22ce0e487f0341fd9bf853393d6e7683
W20260810 01:59:15.163923 6979 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table e211628d46b64734960dfd60d86708ce: could not find any suitable replica to move from server ca4469fc2dbc48488bc7ad7f482f129e to server 22ce0e487f0341fd9bf853393d6e7683
W20260810 01:59:15.164113 6979 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 3e1f7b9b31614ed383207098de38230c: could not find any suitable replica to move from server 17b49c694faf479ea2e5083470fc0302 to server c5ed5317da9c464b93f979c405f0f6e4
W20260810 01:59:15.164351 6979 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table b572363d270a4bfda571d46e96d0bfda: could not find any suitable replica to move from server dc85be7d460a404f997177f57680850f to server 22ce0e487f0341fd9bf853393d6e7683
W20260810 01:59:15.164443 6979 rebalancer_tool.cc:1212] table 945a223441a04ba2bf938b104bc91cf8: no follower replicas available on ca4469fc2dbc48488bc7ad7f482f129e, falling back to leader replicas
W20260810 01:59:15.164538 6979 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 945a223441a04ba2bf938b104bc91cf8: could not find any suitable replica to move from server ca4469fc2dbc48488bc7ad7f482f129e to server 4dd4cba155c941b4b7ad4d64c7431536
W20260810 01:59:15.164672 6979 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table afa71147917d44a585bcbaa37497a2b1: could not find any suitable replica to move from server ca4469fc2dbc48488bc7ad7f482f129e to server 3136daf7101445beadc1aa19bc01c227
W20260810 01:59:15.164786 6979 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 8fd8ee0beeb54ad9bee1c94775d09e8f: could not find any suitable replica to move from server dc85be7d460a404f997177f57680850f to server 3136daf7101445beadc1aa19bc01c227
W20260810 01:59:15.164960 6979 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table e211628d46b64734960dfd60d86708ce: could not find any suitable replica to move from server 17b49c694faf479ea2e5083470fc0302 to server c5ed5317da9c464b93f979c405f0f6e4
W20260810 01:59:15.165124 6979 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 945a223441a04ba2bf938b104bc91cf8: could not find any suitable replica to move from server dc85be7d460a404f997177f57680850f to server c5ed5317da9c464b93f979c405f0f6e4
I20260810 01:59:15.593930 6979 rebalancer_tool.cc:1090] tablet f7a36f7ebd5d4342a259b093e45d4c32: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '' move scheduled
I20260810 01:59:15.989207 6979 rebalancer_tool.cc:1100] tablet 57f6f22d97c14ed98960e27ce2c8f3fb: '82f93d1d11364ceeb485585b4ae78871' -> 'c5ed5317da9c464b93f979c405f0f6e4' move ignored: Illegal state: Request specified cas_config_opid_index of -1 but the committed config has opid_index of 4
I20260810 01:59:15.989356 6979 rebalancer_tool.cc:772] re-synchronizing cluster state
W20260810 01:59:18.001220 6979 rebalancer_tool.cc:1212] table b572363d270a4bfda571d46e96d0bfda: no follower replicas available on 17b49c694faf479ea2e5083470fc0302, falling back to leader replicas
W20260810 01:59:18.001628 6979 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 3e1f7b9b31614ed383207098de38230c: could not find any suitable replica to move from server ca4469fc2dbc48488bc7ad7f482f129e to server c5ed5317da9c464b93f979c405f0f6e4
W20260810 01:59:18.001801 6979 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table e211628d46b64734960dfd60d86708ce: could not find any suitable replica to move from server 82f93d1d11364ceeb485585b4ae78871 to server 4dd4cba155c941b4b7ad4d64c7431536
W20260810 01:59:18.001926 6979 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 372310cb713644ada1071e8eb628b0c9: could not find any suitable replica to move from server ca4469fc2dbc48488bc7ad7f482f129e to server 4dd4cba155c941b4b7ad4d64c7431536
W20260810 01:59:18.002079 6979 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 945a223441a04ba2bf938b104bc91cf8: could not find any suitable replica to move from server dc85be7d460a404f997177f57680850f to server c5ed5317da9c464b93f979c405f0f6e4
W20260810 01:59:18.002336 6979 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table afa71147917d44a585bcbaa37497a2b1: could not find any suitable replica to move from server 82f93d1d11364ceeb485585b4ae78871 to server c5ed5317da9c464b93f979c405f0f6e4
W20260810 01:59:18.002504 6979 rebalancer_tool.cc:1212] table 5e8751d351ba4b7da7861e02b0c3c634: no follower replicas available on ca4469fc2dbc48488bc7ad7f482f129e, falling back to leader replicas
W20260810 01:59:18.002614 6979 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 5e8751d351ba4b7da7861e02b0c3c634: could not find any suitable replica to move from server ca4469fc2dbc48488bc7ad7f482f129e to server 22ce0e487f0341fd9bf853393d6e7683
I20260810 01:59:18.500330 6979 rebalancer_tool.cc:1090] tablet 1d377b919f4748c88efb249dfc964f17: '82f93d1d11364ceeb485585b4ae78871' -> '' move scheduled
I20260810 01:59:19.326407 6979 rebalancer_tool.cc:1090] tablet 2e72e04459b140cc9e20ad633b1ab5c4: 'dc85be7d460a404f997177f57680850f' -> '3136daf7101445beadc1aa19bc01c227' move scheduled
I20260810 01:59:19.697124 6979 rebalancer_tool.cc:1090] tablet fe8e1f0908234e46881258cfe79835f8: '17b49c694faf479ea2e5083470fc0302' -> '4dd4cba155c941b4b7ad4d64c7431536' move scheduled
I20260810 01:59:20.086154 6979 rebalancer_tool.cc:1090] tablet e70193bd4055469d870a76542eaef524: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '22ce0e487f0341fd9bf853393d6e7683' move scheduled
I20260810 01:59:20.157397 6979 rebalancer_tool.cc:1090] tablet be4737d169be4419b5a0a0b656a3930f: '82f93d1d11364ceeb485585b4ae78871' -> '' move scheduled
I20260810 01:59:20.345796 6979 rebalancer_tool.cc:1090] tablet 4a4350cf2ece4769b8547620ac5bedcb: 'dc85be7d460a404f997177f57680850f' -> '' move scheduled
I20260810 01:59:20.936532 6979 rebalancer_tool.cc:1100] tablet d05e147199e44b8ca712e18d22e7cce7: '17b49c694faf479ea2e5083470fc0302' -> '3136daf7101445beadc1aa19bc01c227' move ignored: Illegal state: tablet d05e147199e44b8ca712e18d22e7cce7: replica 3136daf7101445beadc1aa19bc01c227 is already present
I20260810 01:59:20.936704 6979 rebalancer_tool.cc:772] re-synchronizing cluster state
W20260810 01:59:22.676499 6979 rebalancer_tool.cc:1212] table b572363d270a4bfda571d46e96d0bfda: no follower replicas available on 17b49c694faf479ea2e5083470fc0302, falling back to leader replicas
W20260810 01:59:22.676716 6979 rebalancer_tool.cc:1212] table 945a223441a04ba2bf938b104bc91cf8: no follower replicas available on ca4469fc2dbc48488bc7ad7f482f129e, falling back to leader replicas
W20260810 01:59:22.676853 6979 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 945a223441a04ba2bf938b104bc91cf8: could not find any suitable replica to move from server ca4469fc2dbc48488bc7ad7f482f129e to server 4dd4cba155c941b4b7ad4d64c7431536
W20260810 01:59:22.676992 6979 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 8fd8ee0beeb54ad9bee1c94775d09e8f: could not find any suitable replica to move from server 82f93d1d11364ceeb485585b4ae78871 to server 22ce0e487f0341fd9bf853393d6e7683
W20260810 01:59:22.677147 6979 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 372310cb713644ada1071e8eb628b0c9: could not find any suitable replica to move from server 17b49c694faf479ea2e5083470fc0302 to server c5ed5317da9c464b93f979c405f0f6e4
W20260810 01:59:22.677270 6979 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table afa71147917d44a585bcbaa37497a2b1: could not find any suitable replica to move from server dc85be7d460a404f997177f57680850f to server 3136daf7101445beadc1aa19bc01c227
W20260810 01:59:22.677420 6979 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 5e8751d351ba4b7da7861e02b0c3c634: could not find any suitable replica to move from server 82f93d1d11364ceeb485585b4ae78871 to server 3136daf7101445beadc1aa19bc01c227
W20260810 01:59:22.677531 6979 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 372310cb713644ada1071e8eb628b0c9: could not find any suitable replica to move from server ca4469fc2dbc48488bc7ad7f482f129e to server 22ce0e487f0341fd9bf853393d6e7683
I20260810 01:59:22.831928 6979 rebalancer_tool.cc:1090] tablet da507bc24d964ce1a5835edad5177726: '17b49c694faf479ea2e5083470fc0302' -> '' move scheduled
I20260810 01:59:41.112491 6979 rebalancer_tool.cc:1152] tablet 1d377b919f4748c88efb249dfc964f17: '82f93d1d11364ceeb485585b4ae78871' -> '' move completed: OK
I20260810 01:59:43.946035 6979 rebalancer_tool.cc:1152] tablet b6c5892f4de449fb8cb7f4cff7eb2e20: 'dc85be7d460a404f997177f57680850f' -> '4dd4cba155c941b4b7ad4d64c7431536' move completed: OK
I20260810 01:59:46.743993 6979 rebalancer_tool.cc:1152] tablet df5b102a0b03406f9449cdd84dfd147e: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '22ce0e487f0341fd9bf853393d6e7683' move completed: OK
I20260810 01:59:46.842760 6979 rebalancer_tool.cc:1090] tablet 5528e3ba51a640eaa614f141440bb90b: '82f93d1d11364ceeb485585b4ae78871' -> '' move scheduled
I20260810 01:59:46.964926 6979 rebalancer_tool.cc:1152] tablet da507bc24d964ce1a5835edad5177726: '17b49c694faf479ea2e5083470fc0302' -> '' move completed: OK
I20260810 01:59:48.950688 6979 rebalancer_tool.cc:1152] tablet be4737d169be4419b5a0a0b656a3930f: '82f93d1d11364ceeb485585b4ae78871' -> '' move completed: OK
I20260810 01:59:49.140899 6979 rebalancer_tool.cc:1152] tablet fe8e1f0908234e46881258cfe79835f8: '17b49c694faf479ea2e5083470fc0302' -> '4dd4cba155c941b4b7ad4d64c7431536' move completed: OK
I20260810 01:59:49.218878 6979 rebalancer_tool.cc:1152] tablet e70193bd4055469d870a76542eaef524: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '22ce0e487f0341fd9bf853393d6e7683' move completed: OK
I20260810 01:59:49.409838 6979 rebalancer_tool.cc:1152] tablet 2e72e04459b140cc9e20ad633b1ab5c4: 'dc85be7d460a404f997177f57680850f' -> '3136daf7101445beadc1aa19bc01c227' move completed: OK
I20260810 01:59:49.465848 6979 rebalancer_tool.cc:1152] tablet 7207ea155ba44c0a9ba216acd22dc1b4: '82f93d1d11364ceeb485585b4ae78871' -> 'c5ed5317da9c464b93f979c405f0f6e4' move completed: OK
I20260810 01:59:49.719107 6979 rebalancer_tool.cc:1152] tablet f7a36f7ebd5d4342a259b093e45d4c32: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '' move completed: OK
I20260810 01:59:49.883023 6979 rebalancer_tool.cc:1152] tablet 5528e3ba51a640eaa614f141440bb90b: '82f93d1d11364ceeb485585b4ae78871' -> '' move completed: OK
I20260810 01:59:49.979483 6979 rebalancer_tool.cc:1152] tablet 8e8d13caf8054b1daf09b2b114843766: '17b49c694faf479ea2e5083470fc0302' -> '3136daf7101445beadc1aa19bc01c227' move completed: OK
I20260810 01:59:50.140950 6979 rebalancer_tool.cc:1090] tablet 4fc45932b9634d6d98d8a0204d4b121a: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '' move scheduled
I20260810 01:59:50.383819 6979 rebalancer_tool.cc:1090] tablet 252899385eaa45b392974d2768e3cf01: '82f93d1d11364ceeb485585b4ae78871' -> '' move scheduled
I20260810 01:59:50.509444 6979 rebalancer_tool.cc:1090] tablet 18a93b1a1ce1440b99bdd7a3bcf49064: '17b49c694faf479ea2e5083470fc0302' -> '' move scheduled
I20260810 01:59:50.604212 6979 rebalancer_tool.cc:1090] tablet 0afbd7afdd834537b15c727355724562: 'dc85be7d460a404f997177f57680850f' -> '' move scheduled
I20260810 01:59:50.710989 6979 rebalancer_tool.cc:1152] tablet 18a93b1a1ce1440b99bdd7a3bcf49064: '17b49c694faf479ea2e5083470fc0302' -> '' move completed: OK
I20260810 01:59:50.769166 6979 rebalancer_tool.cc:1152] tablet 0afbd7afdd834537b15c727355724562: 'dc85be7d460a404f997177f57680850f' -> '' move completed: OK
I20260810 01:59:53.034111 6979 rebalancer_tool.cc:1152] tablet 4fc45932b9634d6d98d8a0204d4b121a: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '' move completed: OK
I20260810 01:59:53.159116 6979 rebalancer_tool.cc:1152] tablet 4a4350cf2ece4769b8547620ac5bedcb: 'dc85be7d460a404f997177f57680850f' -> '' move completed: OK
I20260810 01:59:53.353223 6979 rebalancer_tool.cc:1090] tablet a586b7d625bb4c27a6343ae7918c8cea: '17b49c694faf479ea2e5083470fc0302' -> '' move scheduled
I20260810 01:59:53.506600 6979 rebalancer_tool.cc:1090] tablet 8308d63e9002418b876c3d3ae0095d9f: 'dc85be7d460a404f997177f57680850f' -> '' move scheduled
I20260810 01:59:53.632725 6979 rebalancer_tool.cc:1090] tablet d05e147199e44b8ca712e18d22e7cce7: '17b49c694faf479ea2e5083470fc0302' -> '' move scheduled
I20260810 01:59:53.723932 6979 rebalancer_tool.cc:1152] tablet d05e147199e44b8ca712e18d22e7cce7: '17b49c694faf479ea2e5083470fc0302' -> '' move completed: OK
I20260810 01:59:53.806871 6979 rebalancer_tool.cc:1152] tablet 8308d63e9002418b876c3d3ae0095d9f: 'dc85be7d460a404f997177f57680850f' -> '' move completed: OK
I20260810 01:59:53.899763 6979 rebalancer_tool.cc:1152] tablet a586b7d625bb4c27a6343ae7918c8cea: '17b49c694faf479ea2e5083470fc0302' -> '' move completed: OK
I20260810 01:59:54.022794 6979 rebalancer_tool.cc:1152] tablet 252899385eaa45b392974d2768e3cf01: '82f93d1d11364ceeb485585b4ae78871' -> '' move completed: OK
I20260810 01:59:55.559186 6979 rebalancer_tool.cc:1090] tablet fe8e1f0908234e46881258cfe79835f8: '3136daf7101445beadc1aa19bc01c227' -> '' move scheduled
I20260810 01:59:56.005308 6979 rebalancer_tool.cc:1090] tablet 4a4350cf2ece4769b8547620ac5bedcb: '3136daf7101445beadc1aa19bc01c227' -> 'ca4469fc2dbc48488bc7ad7f482f129e' move scheduled
I20260810 01:59:56.152280 6979 rebalancer_tool.cc:1100] tablet 7207ea155ba44c0a9ba216acd22dc1b4: 'dc85be7d460a404f997177f57680850f' -> '82f93d1d11364ceeb485585b4ae78871' move ignored: Illegal state: tablet 7207ea155ba44c0a9ba216acd22dc1b4: replica 82f93d1d11364ceeb485585b4ae78871 is already present
I20260810 01:59:56.152588 6979 rebalancer_tool.cc:772] re-synchronizing cluster state
W20260810 01:59:58.330225 6979 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 3e1f7b9b31614ed383207098de38230c: could not find any suitable replica to move from server 4dd4cba155c941b4b7ad4d64c7431536 to server dc85be7d460a404f997177f57680850f
W20260810 01:59:58.340569 6979 rebalancer_tool.cc:1212] table 372310cb713644ada1071e8eb628b0c9: no follower replicas available on ca4469fc2dbc48488bc7ad7f482f129e, falling back to leader replicas
W20260810 01:59:58.340728 6979 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 372310cb713644ada1071e8eb628b0c9: could not find any suitable replica to move from server ca4469fc2dbc48488bc7ad7f482f129e to server 17b49c694faf479ea2e5083470fc0302
I20260810 01:59:58.879681 6979 rebalancer_tool.cc:1090] tablet 1d377b919f4748c88efb249dfc964f17: '3136daf7101445beadc1aa19bc01c227' -> '17b49c694faf479ea2e5083470fc0302' move scheduled
I20260810 01:59:58.960177 6979 rebalancer_tool.cc:1090] tablet abf302f27a12414a8647dab82ab8101f: '4dd4cba155c941b4b7ad4d64c7431536' -> '' move scheduled
I20260810 01:59:59.054152 6979 rebalancer_tool.cc:1090] tablet 3a15b27dbdaf4092aea66c3670204fcc: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '' move scheduled
I20260810 01:59:59.548870 6979 rebalancer_tool.cc:1090] tablet 0afbd7afdd834537b15c727355724562: '3136daf7101445beadc1aa19bc01c227' -> '4dd4cba155c941b4b7ad4d64c7431536' move scheduled
I20260810 02:00:03.866220 6979 rebalancer_tool.cc:1152] tablet abf302f27a12414a8647dab82ab8101f: '4dd4cba155c941b4b7ad4d64c7431536' -> '' move completed: OK
W20260810 02:00:12.816371 20715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.GetConsensusState -> {remote=127.21.64.200:32995, user_credentials={real_user=slave}} blocked reactor thread for 56525.2us
I20260810 02:00:13.350646 6979 rebalancer_tool.cc:1152] tablet 3a15b27dbdaf4092aea66c3670204fcc: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '' move completed: OK
I20260810 02:00:13.444180 6979 rebalancer_tool.cc:1152] tablet 1d377b919f4748c88efb249dfc964f17: '3136daf7101445beadc1aa19bc01c227' -> '17b49c694faf479ea2e5083470fc0302' move completed: OK
I20260810 02:00:13.735819 6979 rebalancer_tool.cc:1152] tablet 4a4350cf2ece4769b8547620ac5bedcb: '3136daf7101445beadc1aa19bc01c227' -> 'ca4469fc2dbc48488bc7ad7f482f129e' move completed: Incomplete: tablet 4a4350cf2ece4769b8547620ac5bedcb, TS 3136daf7101445beadc1aa19bc01c227 -> TS ca4469fc2dbc48488bc7ad7f482f129e move failed, target replica disappeared
I20260810 02:00:13.970741 6979 rebalancer_tool.cc:1152] tablet fe8e1f0908234e46881258cfe79835f8: '3136daf7101445beadc1aa19bc01c227' -> '' move completed: OK
W20260810 02:00:15.035308 21482 meta_cache.cc:1261] Time spent looking up entry by key: real 0.077s user 0.001s sys 0.000s
I20260810 02:00:16.813650 6979 rebalancer_tool.cc:1152] tablet 0afbd7afdd834537b15c727355724562: '3136daf7101445beadc1aa19bc01c227' -> '4dd4cba155c941b4b7ad4d64c7431536' move completed: OK
W20260810 02:00:18.354859 6979 rebalancer_tool.cc:1212] table 3e1f7b9b31614ed383207098de38230c: no follower replicas available on 82f93d1d11364ceeb485585b4ae78871, falling back to leader replicas
I20260810 02:00:19.075534 6979 rebalancer_tool.cc:1090] tablet 4a4350cf2ece4769b8547620ac5bedcb: '22ce0e487f0341fd9bf853393d6e7683' -> '4dd4cba155c941b4b7ad4d64c7431536' move scheduled
I20260810 02:00:19.443100 6979 rebalancer_tool.cc:1090] tablet b6c5892f4de449fb8cb7f4cff7eb2e20: '82f93d1d11364ceeb485585b4ae78871' -> '3136daf7101445beadc1aa19bc01c227' move scheduled
I20260810 02:00:20.129606 6979 rebalancer_tool.cc:1090] tablet 5528e3ba51a640eaa614f141440bb90b: '22ce0e487f0341fd9bf853393d6e7683' -> '82f93d1d11364ceeb485585b4ae78871' move scheduled
I20260810 02:00:29.198616 6979 rebalancer_tool.cc:1139] tablet 4a4350cf2ece4769b8547620ac5bedcb: '22ce0e487f0341fd9bf853393d6e7683' -> '4dd4cba155c941b4b7ad4d64c7431536' move is abandoned: Not found: Server with UUID 22ce0e487f0341fd9bf853393d6e7683 not a member of the config. RaftConfig: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 02:00:29.198756 6979 rebalancer_tool.cc:772] re-synchronizing cluster state
W20260810 02:00:30.499634 6979 rebalancer_tool.cc:1212] table 372310cb713644ada1071e8eb628b0c9: no follower replicas available on 82f93d1d11364ceeb485585b4ae78871, falling back to leader replicas
I20260810 02:00:30.976904 6979 rebalancer_tool.cc:1090] tablet c53fc4008faf445fa05e436b9c8e0282: '4dd4cba155c941b4b7ad4d64c7431536' -> 'dc85be7d460a404f997177f57680850f' move scheduled
I20260810 02:00:31.786584 6979 rebalancer_tool.cc:1090] tablet abf302f27a12414a8647dab82ab8101f: 'c5ed5317da9c464b93f979c405f0f6e4' -> '3136daf7101445beadc1aa19bc01c227' move scheduled
I20260810 02:00:32.460167 6979 rebalancer_tool.cc:1090] tablet 4a4350cf2ece4769b8547620ac5bedcb: '4dd4cba155c941b4b7ad4d64c7431536' -> '22ce0e487f0341fd9bf853393d6e7683' move scheduled
I20260810 02:00:33.044281 6979 rebalancer_tool.cc:1090] tablet 8e8d13caf8054b1daf09b2b114843766: '82f93d1d11364ceeb485585b4ae78871' -> '22ce0e487f0341fd9bf853393d6e7683' move scheduled
I20260810 02:00:43.135231 6979 rebalancer_tool.cc:1152] tablet 5528e3ba51a640eaa614f141440bb90b: '22ce0e487f0341fd9bf853393d6e7683' -> '82f93d1d11364ceeb485585b4ae78871' move completed: Incomplete: tablet 5528e3ba51a640eaa614f141440bb90b, TS 22ce0e487f0341fd9bf853393d6e7683 -> TS 82f93d1d11364ceeb485585b4ae78871 move failed, target replica disappeared
I20260810 02:00:43.243680 6979 rebalancer_tool.cc:1152] tablet b6c5892f4de449fb8cb7f4cff7eb2e20: '82f93d1d11364ceeb485585b4ae78871' -> '3136daf7101445beadc1aa19bc01c227' move completed: OK
I20260810 02:00:43.351856 6979 rebalancer_tool.cc:1152] tablet 4a4350cf2ece4769b8547620ac5bedcb: '4dd4cba155c941b4b7ad4d64c7431536' -> '22ce0e487f0341fd9bf853393d6e7683' move completed: Incomplete: tablet 4a4350cf2ece4769b8547620ac5bedcb, TS 4dd4cba155c941b4b7ad4d64c7431536 -> TS 22ce0e487f0341fd9bf853393d6e7683 move failed, target replica disappeared
I20260810 02:00:43.488854 6979 rebalancer_tool.cc:1152] tablet abf302f27a12414a8647dab82ab8101f: 'c5ed5317da9c464b93f979c405f0f6e4' -> '3136daf7101445beadc1aa19bc01c227' move completed: OK
I20260810 02:00:43.551098 6979 rebalancer_tool.cc:1152] tablet c53fc4008faf445fa05e436b9c8e0282: '4dd4cba155c941b4b7ad4d64c7431536' -> 'dc85be7d460a404f997177f57680850f' move completed: OK
I20260810 02:00:43.584368 6979 rebalancer_tool.cc:1152] tablet 8e8d13caf8054b1daf09b2b114843766: '82f93d1d11364ceeb485585b4ae78871' -> '22ce0e487f0341fd9bf853393d6e7683' move completed: OK
W20260810 02:00:44.848676 6979 rebalancer_tool.cc:1212] table 372310cb713644ada1071e8eb628b0c9: no follower replicas available on ca4469fc2dbc48488bc7ad7f482f129e, falling back to leader replicas
I20260810 02:00:45.034904 6979 rebalancer_tool.cc:1100] tablet 5528e3ba51a640eaa614f141440bb90b: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '82f93d1d11364ceeb485585b4ae78871' move ignored: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }.
Pending config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 02:00:45.035073 6979 rebalancer_tool.cc:772] re-synchronizing cluster state
I20260810 02:00:46.989321 6979 rebalancer_tool.cc:1100] tablet 7207ea155ba44c0a9ba216acd22dc1b4: 'c5ed5317da9c464b93f979c405f0f6e4' -> '4dd4cba155c941b4b7ad4d64c7431536' move ignored: Illegal state: Request specified cas_config_opid_index of 7 but the committed config has op
W20260810 02:00:53.356841 6308 consensus_peers.cc:597] T 57f6f22d97c14ed98960e27ce2c8f3fb P 4dd4cba155c941b4b7ad4d64c7431536 -> Peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797): Couldn't send request to peer dc85be7d460a404f997177f57680850f. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.193:36797: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260810 02:00:53.376528 6308 consensus_peers.cc:597] T 252899385eaa45b392974d2768e3cf01 P 4dd4cba155c941b4b7ad4d64c7431536 -> Peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797): Couldn't send request to peer dc85be7d460a404f997177f57680850f. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.193:36797: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260810 02:00:53.390085 28782 raft_consensus.cc:493] T 7207ea155ba44c0a9ba216acd22dc1b4 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca4469fc2dbc48488bc7ad7f482f129e)
I20260810 02:00:53.390336 28782 raft_consensus.cc:515] T 7207ea155ba44c0a9ba216acd22dc1b4 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } }
I20260810 02:00:53.391301 28782 leader_election.cc:290] T 7207ea155ba44c0a9ba216acd22dc1b4 P 4dd4cba155c941b4b7ad4d64c7431536 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943), 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 02:00:53.393486 4102 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
W20260810 02:00:53.408330 6311 leader_election.cc:336] T 7207ea155ba44c0a9ba216acd22dc1b4 P 4dd4cba155c941b4b7ad4d64c7431536 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): Network error: Client connection negotiation failed: client connection to 127.21.64.196:41943: connect: Connection refused (error 111)
W20260810 02:00:53.408694 6311 leader_election.cc:336] T 7207ea155ba44c0a9ba216acd22dc1b4 P 4dd4cba155c941b4b7ad4d64c7431536 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): Network error: Client connection negotiation failed: client connection to 127.21.64.194:43893: connect: Connection refused (error 111)
I20260810 02:00:53.408922 6311 leader_election.cc:304] T 7207ea155ba44c0a9ba216acd22dc1b4 P 4dd4cba155c941b4b7ad4d64c7431536 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dd4cba155c941b4b7ad4d64c7431536; no voters: 82f93d1d11364ceeb485585b4ae78871, ca4469fc2dbc48488bc7ad7f482f129e
I20260810 02:00:53.409368 28782 raft_consensus.cc:2749] T 7207ea155ba44c0a9ba216acd22dc1b4 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 02:00:53.422829 28696 raft_consensus.cc:493] T 5528e3ba51a640eaa614f141440bb90b P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca4469fc2dbc48488bc7ad7f482f129e)
I20260810 02:00:53.423092 28696 raft_consensus.cc:515] T 5528e3ba51a640eaa614f141440bb90b P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 02:00:53.424335 28696 leader_election.cc:290] T 5528e3ba51a640eaa614f141440bb90b P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943), 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317), 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
I20260810 02:00:53.429445 6563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5528e3ba51a640eaa614f141440bb90b" candidate_uuid: "17b49c694faf479ea2e5083470fc0302" candidate_term: 2 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "22ce0e487f0341fd9bf853393d6e7683" is_pre_election: true
I20260810 02:00:53.429733 6563 raft_consensus.cc:2468] T 5528e3ba51a640eaa614f141440bb90b P 22ce0e487f0341fd9bf853393d6e7683 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17b49c694faf479ea2e5083470fc0302 in term 1.
W20260810 02:00:53.442830 4038 leader_election.cc:336] T 5528e3ba51a640eaa614f141440bb90b P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): Network error: Client connection negotiation failed: client connection to 127.21.64.196:41943: connect: Connection refused (error 111)
W20260810 02:00:53.443241 4038 leader_election.cc:336] T 5528e3ba51a640eaa614f141440bb90b P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): Network error: Client connection negotiation failed: client connection to 127.21.64.194:43893: connect: Connection refused (error 111)
I20260810 02:00:53.443508 4038 leader_election.cc:304] T 5528e3ba51a640eaa614f141440bb90b P 17b49c694faf479ea2e5083470fc0302 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 17b49c694faf479ea2e5083470fc0302, 22ce0e487f0341fd9bf853393d6e7683; no voters: 82f93d1d11364ceeb485585b4ae78871, ca4469fc2dbc48488bc7ad7f482f129e
I20260810 02:00:53.443931 28696 raft_consensus.cc:2749] T 5528e3ba51a640eaa614f141440bb90b P 17b49c694faf479ea2e5083470fc0302 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 02:00:53.451824 6537 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260810 02:00:53.460247 6884 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260810 02:00:53.493764 6368 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260810 02:00:53.508078 6968 rebalancer_tool-test.cc:1258] rebalancer run info: Runtime error: /tmp/dist-test-taskNubV1X/build/asan/bin/kudu: process exited with non-zero status 1
stdout: Per-server replica distribution summary:
Statistic | Value
-----------------------+-----------
Minimum Replica Count | 0
Maximum Replica Count | 23
Average Replica Count | 11.250000
Per-table replica distribution summary:
Replica Skew | Value
--------------+----------
Minimum | 3
Maximum | 3
Average | 3.000000
stderr: W20260810 01:59:04.122367 6977 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:59:04.122953 6977 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260810 01:59:07.286839 6977 rebalancer_tool.cc:215] running whole-cluster rebalancing
W20260810 01:59:09.282547 6977 rebalancer_tool.cc:1212] table b572363d270a4bfda571d46e96d0bfda: no follower replicas available on 17b49c694faf479ea2e5083470fc0302, falling back to leader replicas
W20260810 01:59:09.283782 6977 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 372310cb713644ada1071e8eb628b0c9: could not find any suitable replica to move from server 17b49c694faf479ea2e5083470fc0302 to server 22ce0e487f0341fd9bf853393d6e7683
W20260810 01:59:09.284092 6977 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 945a223441a04ba2bf938b104bc91cf8: could not find any suitable replica to move from server dc85be7d460a404f997177f57680850f to server 3136daf7101445beadc1aa19bc01c227
W20260810 01:59:09.284293 6977 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 5e8751d351ba4b7da7861e02b0c3c634: could not find any suitable replica to move from server 82f93d1d11364ceeb485585b4ae78871 to server 3136daf7101445beadc1aa19bc01c227
W20260810 01:59:09.284472 6977 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table e211628d46b64734960dfd60d86708ce: could not find any suitable replica to move from server ca4469fc2dbc48488bc7ad7f482f129e to server 22ce0e487f0341fd9bf853393d6e7683
W20260810 01:59:09.284668 6977 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 3e1f7b9b31614ed383207098de38230c: could not find any suitable replica to move from server ca4469fc2dbc48488bc7ad7f482f129e to server 4dd4cba155c941b4b7ad4d64c7431536
W20260810 01:59:09.284883 6977 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table b572363d270a4bfda571d46e96d0bfda: could not find any suitable replica to move from server dc85be7d460a404f997177f57680850f to server 22ce0e487f0341fd9bf853393d6e7683
W20260810 01:59:09.285025 6977 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 5b2df46262b142169af9a32c47535432: could not find any suitable replica to move from server dc85be7d460a404f997177f57680850f to server 4dd4cba155c941b4b7ad4d64c7431536
W20260810 01:59:09.285166 6977 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 8fd8ee0beeb54ad9bee1c94775d09e8f: could not find any suitable replica to move from server dc85be7d460a404f997177f57680850f to server 22ce0e487f0341fd9bf853393d6e7683
W20260810 01:59:09.285401 6977 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table c515c90b2c71492f812b4df18501ee04: could not find any suitable replica to move from server 82f93d1d11364ceeb485585b4ae78871 to server 3136daf7101445beadc1aa19bc01c227
W20260810 01:59:09.285670 6977 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table afa71147917d44a585bcbaa37497a2b1: could not find any suitable replica to move from server 82f93d1d11364ceeb485585b4ae78871 to server 4dd4cba155c941b4b7ad4d64c7431536
W20260810 01:59:09.285830 6977 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 5b2df46262b142169af9a32c47535432: could not find any suitable replica to move from server ca4469fc2dbc48488bc7ad7f482f129e to server c5ed5317da9c464b93f979c405f0f6e4
W20260810 01:59:09.286002 6977 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table e211628d46b64734960dfd60d86708ce: could not find any suitable replica to move from server 17b49c694faf479ea2e5083470fc0302 to server 22ce0e487f0341fd9bf853393d6e7683
W20260810 01:59:09.286141 6977 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 5e8751d351ba4b7da7861e02b0c3c634: could not find any suitable replica to move from server dc85be7d460a404f997177f57680850f to server 3136daf7101445beadc1aa19bc01c227
W20260810 01:59:09.286254 6977 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table afa71147917d44a585bcbaa37497a2b1: could not find any suitable replica to move from server ca4469fc2dbc48488bc7ad7f482f129e to server 4dd4cba155c941b4b7ad4d64c7431536
I20260810 01:59:09.861089 6977 rebalancer_tool.cc:1090] tablet be4737d169be4419b5a0a0b656a3930f: '82f93d1d11364ceeb485585b4ae78871' -> '3136daf7101445beadc1aa19bc01c227' move scheduled
I20260810 01:59:10.495916 6977 rebalancer_tool.cc:1090] tablet da507bc24d964ce1a5835edad5177726: '17b49c694faf479ea2e5083470fc0302' -> '4dd4cba155c941b4b7ad4d64c7431536' move scheduled
I20260810 01:59:10.916935 6977 rebalancer_tool.cc:1090] tablet abf302f27a12414a8647dab82ab8101f: 'ca4469fc2dbc48488bc7ad7f482f129e' -> 'c5ed5317da9c464b93f979c405f0f6e4' move scheduled
I20260810 01:59:11.282462 6977 rebalancer_tool.cc:1090] tablet 4fc45932b9634d6d98d8a0204d4b121a: 'dc85be7d460a404f997177f57680850f' -> '22ce0e487f0341fd9bf853393d6e7683' move scheduled
I20260810 01:59:12.041899 6977 rebalancer_tool.cc:1090] tablet 1d377b919f4748c88efb249dfc964f17: '82f93d1d11364ceeb485585b4ae78871' -> '3136daf7101445beadc1aa19bc01c227' move scheduled
I20260810 01:59:12.730652 6977 rebalancer_tool.cc:1090] tablet a586b7d625bb4c27a6343ae7918c8cea: '17b49c694faf479ea2e5083470fc0302' -> 'c5ed5317da9c464b93f979c405f0f6e4' move scheduled
I20260810 01:59:13.530514 6977 rebalancer_tool.cc:1090] tablet df5b102a0b03406f9449cdd84dfd147e: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '4dd4cba155c941b4b7ad4d64c7431536' move scheduled
I20260810 01:59:14.133693 6977 rebalancer_tool.cc:1090] tablet b6c5892f4de449fb8cb7f4cff7eb2e20: 'dc85be7d460a404f997177f57680850f' -> '22ce0e487f0341fd9bf853393d6e7683' move scheduled
I20260810 01:59:14.829097 6977 rebalancer_tool.cc:1090] tablet 8308d63e9002418b876c3d3ae0095d9f: '82f93d1d11364ceeb485585b4ae78871' -> '3136daf7101445beadc1aa19bc01c227' move scheduled
I20260810 01:59:15.507529 6977 rebalancer_tool.cc:1090] tablet 18a93b1a1ce1440b99bdd7a3bcf49064: '17b49c694faf479ea2e5083470fc0302' -> 'c5ed5317da9c464b93f979c405f0f6e4' move scheduled
I20260810 01:59:16.097782 6977 rebalancer_tool.cc:1090] tablet f3d04e9457c944a8a72861680bdf9b7c: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '4dd4cba155c941b4b7ad4d64c7431536' move scheduled
I20260810 01:59:16.617762 6977 rebalancer_tool.cc:1090] tablet f7a36f7ebd5d4342a259b093e45d4c32: 'dc85be7d460a404f997177f57680850f' -> '22ce0e487f0341fd9bf853393d6e7683' move scheduled
I20260810 01:59:16.719028 6977 rebalancer_tool.cc:1100] tablet 7207ea155ba44c0a9ba216acd22dc1b4: '82f93d1d11364ceeb485585b4ae78871' -> 'c5ed5317da9c464b93f979c405f0f6e4' move ignored: Illegal state: tablet 7207ea155ba44c0a9ba216acd22dc1b4: replica c5ed5317da9c464b93f979c405f0f6e4 is already present
I20260810 01:59:16.719195 6977 rebalancer_tool.cc:772] re-synchronizing cluster state
W20260810 01:59:18.777503 6977 rebalancer_tool.cc:1212] table b572363d270a4bfda571d46e96d0bfda: no follower replicas available on 17b49c694faf479ea2e5083470fc0302, falling back to leader replicas
W20260810 01:59:18.777689 6977 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 3e1f7b9b31614ed383207098de38230c: could not find any suitable replica to move from server ca4469fc2dbc48488bc7ad7f482f129e to server c5ed5317da9c464b93f979c405f0f6e4
W20260810 01:59:18.777941 6977 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table c515c90b2c71492f812b4df18501ee04: could not find any suitable replica to move from server dc85be7d460a404f997177f57680850f to server 3136daf7101445beadc1aa19bc01c227
W20260810 01:59:18.778218 6977 rebalancer_tool.cc:1212] table b572363d270a4bfda571d46e96d0bfda: no follower replicas available on 17b49c694faf479ea2e5083470fc0302, falling back to leader replicas
W20260810 01:59:18.778420 6977 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 8fd8ee0beeb54ad9bee1c94775d09e8f: could not find any suitable replica to move from server dc85be7d460a404f997177f57680850f to server 22ce0e487f0341fd9bf853393d6e7683
W20260810 01:59:18.778570 6977 rebalancer_tool.cc:1212] table 945a223441a04ba2bf938b104bc91cf8: no follower replicas available on ca4469fc2dbc48488bc7ad7f482f129e, falling back to leader replicas
W20260810 01:59:18.778685 6977 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 945a223441a04ba2bf938b104bc91cf8: could not find any suitable replica to move from server ca4469fc2dbc48488bc7ad7f482f129e to server 22ce0e487f0341fd9bf853393d6e7683
W20260810 01:59:18.778805 6977 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table afa71147917d44a585bcbaa37497a2b1: could not find any suitable replica to move from server dc85be7d460a404f997177f57680850f to server c5ed5317da9c464b93f979c405f0f6e4
W20260810 01:59:18.778949 6977 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table b572363d270a4bfda571d46e96d0bfda: could not find any suitable replica to move from server 82f93d1d11364ceeb485585b4ae78871 to server 4dd4cba155c941b4b7ad4d64c7431536
W20260810 01:59:18.779086 6977 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table e211628d46b64734960dfd60d86708ce: could not find any suitable replica to move from server 17b49c694faf479ea2e5083470fc0302 to server 4dd4cba155c941b4b7ad4d64c7431536
W20260810 01:59:18.779222 6977 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 5b2df46262b142169af9a32c47535432: could not find any suitable replica to move from server ca4469fc2dbc48488bc7ad7f482f129e to server c5ed5317da9c464b93f979c405f0f6e4
I20260810 01:59:19.169018 6977 rebalancer_tool.cc:1090] tablet 5528e3ba51a640eaa614f141440bb90b: '82f93d1d11364ceeb485585b4ae78871' -> '' move scheduled
I20260810 01:59:19.393230 6977 rebalancer_tool.cc:1090] tablet 8e8d13caf8054b1daf09b2b114843766: '17b49c694faf479ea2e5083470fc0302' -> '' move scheduled
I20260810 01:59:19.494535 6977 rebalancer_tool.cc:1090] tablet 4a4350cf2ece4769b8547620ac5bedcb: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '' move scheduled
I20260810 01:59:19.618433 6977 rebalancer_tool.cc:1100] tablet 2e72e04459b140cc9e20ad633b1ab5c4: 'dc85be7d460a404f997177f57680850f' -> '3136daf7101445beadc1aa19bc01c227' move ignored: Illegal state: tablet 2e72e04459b140cc9e20ad633b1ab5c4: replica 3136daf7101445beadc1aa19bc01c227 is already present
I20260810 01:59:19.618628 6977 rebalancer_tool.cc:772] re-synchronizing cluster state
W20260810 01:59:21.922187 6977 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table c515c90b2c71492f812b4df18501ee04: could not find any suitable replica to move from server dc85be7d460a404f997177f57680850f to server 3136daf7101445beadc1aa19bc01c227
W20260810 01:59:21.922384 6977 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table e211628d46b64734960dfd60d86708ce: could not find any suitable replica to move from server ca4469fc2dbc48488bc7ad7f482f129e to server 22ce0e487f0341fd9bf853393d6e7683
W20260810 01:59:21.922690 6977 rebalancer_tool.cc:1212] table b572363d270a4bfda571d46e96d0bfda: no follower replicas available on 17b49c694faf479ea2e5083470fc0302, falling back to leader replicas
W20260810 01:59:21.922789 6977 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table b572363d270a4bfda571d46e96d0bfda: could not find any suitable replica to move from server 17b49c694faf479ea2e5083470fc0302 to server 22ce0e487f0341fd9bf853393d6e7683
W20260810 01:59:21.922924 6977 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table afa71147917d44a585bcbaa37497a2b1: could not find any suitable replica to move from server 17b49c694faf479ea2e5083470fc0302 to server 3136daf7101445beadc1aa19bc01c227
W20260810 01:59:21.923017 6977 rebalancer_tool.cc:1212] table b572363d270a4bfda571d46e96d0bfda: no follower replicas available on 82f93d1d11364ceeb485585b4ae78871, falling back to leader replicas
W20260810 01:59:21.923115 6977 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table b572363d270a4bfda571d46e96d0bfda: could not find any suitable replica to move from server 82f93d1d11364ceeb485585b4ae78871 to server 4dd4cba155c941b4b7ad4d64c7431536
W20260810 01:59:21.923336 6977 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 372310cb713644ada1071e8eb628b0c9: could not find any suitable replica to move from server 82f93d1d11364ceeb485585b4ae78871 to server 3136daf7101445beadc1aa19bc01c227
W20260810 01:59:21.923484 6977 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 5b2df46262b142169af9a32c47535432: could not find any suitable replica to move from server ca4469fc2dbc48488bc7ad7f482f129e to server c5ed5317da9c464b93f979c405f0f6e4
I20260810 01:59:22.018749 6977 rebalancer_tool.cc:1090] tablet 0afbd7afdd834537b15c727355724562: 'dc85be7d460a404f997177f57680850f' -> '' move scheduled
I20260810 01:59:22.479295 6977 rebalancer_tool.cc:1100] tablet eb90d508a0004daa8f10d562cefe5fd6: '17b49c694faf479ea2e5083470fc0302' -> '4dd4cba155c941b4b7ad4d64c7431536' move ignored: Illegal state: Request specified cas_config_opid_index of -1 but the committed config has opid_index of 4
I20260810 01:59:22.479444 6977 rebalancer_tool.cc:772] re-synchronizing cluster state
W20260810 01:59:24.249639 6977 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table afa71147917d44a585bcbaa37497a2b1: could not find any suitable replica to move from server dc85be7d460a404f997177f57680850f to server c5ed5317da9c464b93f979c405f0f6e4
W20260810 01:59:24.250128 6977 rebalancer_tool.cc:1212] table b572363d270a4bfda571d46e96d0bfda: no follower replicas available on 17b49c694faf479ea2e5083470fc0302, falling back to leader replicas
W20260810 01:59:24.250349 6977 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table e211628d46b64734960dfd60d86708ce: could not find any suitable replica to move from server ca4469fc2dbc48488bc7ad7f482f129e to server 22ce0e487f0341fd9bf853393d6e7683
W20260810 01:59:24.250737 6977 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 5b2df46262b142169af9a32c47535432: could not find any suitable replica to move from server dc85be7d460a404f997177f57680850f to server c5ed5317da9c464b93f979c405f0f6e4
W20260810 01:59:24.250932 6977 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table e211628d46b64734960dfd60d86708ce: could not find any suitable replica to move from server 82f93d1d11364ceeb485585b4ae78871 to server 4dd4cba155c941b4b7ad4d64c7431536
I20260810 01:59:24.343379 6977 rebalancer_tool.cc:1090] tablet 57f6f22d97c14ed98960e27ce2c8f3fb: '17b49c694faf479ea2e5083470fc0302' -> '' move scheduled
W20260810 01:59:31.045490 6977 thread.cc:641] ksck-fetch [worker] (thread pool) Time spent creating pthread: real 0.515s user 0.036s sys 0.146s
W20260810 01:59:31.045706 6977 thread.cc:608] ksck-fetch [worker] (thread pool) Time spent starting thread: real 0.515s user 0.036s sys 0.146s
I20260810 01:59:32.116990 6977 rebalancer_tool.cc:1152] tablet da507bc24d964ce1a5835edad5177726: '17b49c694faf479ea2e5083470fc0302' -> '4dd4cba155c941b4b7ad4d64c7431536' move completed: OK
I20260810 01:59:32.284791 6977 rebalancer_tool.cc:1152] tablet be4737d169be4419b5a0a0b656a3930f: '82f93d1d11364ceeb485585b4ae78871' -> '3136daf7101445beadc1aa19bc01c227' move completed: OK
I20260810 01:59:47.644255 6977 rebalancer_tool.cc:1152] tablet f3d04e9457c944a8a72861680bdf9b7c: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '4dd4cba155c941b4b7ad4d64c7431536' move completed: OK
I20260810 01:59:47.762475 6977 rebalancer_tool.cc:1152] tablet 5528e3ba51a640eaa614f141440bb90b: '82f93d1d11364ceeb485585b4ae78871' -> '' move completed: OK
I20260810 01:59:47.796306 6977 rebalancer_tool.cc:1152] tablet abf302f27a12414a8647dab82ab8101f: 'ca4469fc2dbc48488bc7ad7f482f129e' -> 'c5ed5317da9c464b93f979c405f0f6e4' move completed: OK
I20260810 01:59:47.864413 6977 rebalancer_tool.cc:1152] tablet 8e8d13caf8054b1daf09b2b114843766: '17b49c694faf479ea2e5083470fc0302' -> '' move completed: OK
I20260810 01:59:48.049183 6977 rebalancer_tool.cc:1152] tablet 4a4350cf2ece4769b8547620ac5bedcb: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '' move completed: OK
I20260810 01:59:50.716352 6977 rebalancer_tool.cc:1090] tablet cf531b93380e43bfa103837bd6350834: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '' move scheduled
I20260810 01:59:50.886600 6977 rebalancer_tool.cc:1090] tablet 389d3abfeadd4fe6a4efa74427d71c4d: '82f93d1d11364ceeb485585b4ae78871' -> '' move scheduled
I20260810 01:59:50.957245 6977 rebalancer_tool.cc:1090] tablet b63d0798e1ae4aea9b0272716d53d46d: '17b49c694faf479ea2e5083470fc0302' -> '' move scheduled
I20260810 01:59:51.152985 6977 rebalancer_tool.cc:1152] tablet b63d0798e1ae4aea9b0272716d53d46d: '17b49c694faf479ea2e5083470fc0302' -> '' move completed: OK
I20260810 01:59:51.322984 6977 rebalancer_tool.cc:1152] tablet cf531b93380e43bfa103837bd6350834: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '' move completed: OK
I20260810 01:59:51.407291 6977 rebalancer_tool.cc:1152] tablet 1d377b919f4748c88efb249dfc964f17: '82f93d1d11364ceeb485585b4ae78871' -> '3136daf7101445beadc1aa19bc01c227' move completed: OK
I20260810 01:59:51.510252 6977 rebalancer_tool.cc:1152] tablet 4fc45932b9634d6d98d8a0204d4b121a: 'dc85be7d460a404f997177f57680850f' -> '22ce0e487f0341fd9bf853393d6e7683' move completed: OK
I20260810 01:59:51.672700 6977 rebalancer_tool.cc:1152] tablet 389d3abfeadd4fe6a4efa74427d71c4d: '82f93d1d11364ceeb485585b4ae78871' -> '' move completed: OK
I20260810 01:59:51.884065 6977 rebalancer_tool.cc:1152] tablet 57f6f22d97c14ed98960e27ce2c8f3fb: '17b49c694faf479ea2e5083470fc0302' -> '' move completed: OK
I20260810 01:59:52.113582 6977 rebalancer_tool.cc:1152] tablet df5b102a0b03406f9449cdd84dfd147e: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '4dd4cba155c941b4b7ad4d64c7431536' move completed: OK
I20260810 01:59:52.203742 6977 rebalancer_tool.cc:1152] tablet b6c5892f4de449fb8cb7f4cff7eb2e20: 'dc85be7d460a404f997177f57680850f' -> '22ce0e487f0341fd9bf853393d6e7683' move completed: OK
I20260810 01:59:52.339951 6977 rebalancer_tool.cc:1152] tablet f7a36f7ebd5d4342a259b093e45d4c32: 'dc85be7d460a404f997177f57680850f' -> '22ce0e487f0341fd9bf853393d6e7683' move completed: OK
I20260810 01:59:52.783699 6977 rebalancer_tool.cc:1152] tablet 8308d63e9002418b876c3d3ae0095d9f: '82f93d1d11364ceeb485585b4ae78871' -> '3136daf7101445beadc1aa19bc01c227' move completed: OK
I20260810 01:59:53.015268 6977 rebalancer_tool.cc:1152] tablet 18a93b1a1ce1440b99bdd7a3bcf49064: '17b49c694faf479ea2e5083470fc0302' -> 'c5ed5317da9c464b93f979c405f0f6e4' move completed: OK
I20260810 01:59:53.263572 6977 rebalancer_tool.cc:1152] tablet a586b7d625bb4c27a6343ae7918c8cea: '17b49c694faf479ea2e5083470fc0302' -> 'c5ed5317da9c464b93f979c405f0f6e4' move completed: OK
I20260810 01:59:53.348495 6977 rebalancer_tool.cc:1152] tablet 0afbd7afdd834537b15c727355724562: 'dc85be7d460a404f997177f57680850f' -> '' move completed: OK
I20260810 01:59:53.488651 6977 rebalancer_tool.cc:1090] tablet 7207ea155ba44c0a9ba216acd22dc1b4: '82f93d1d11364ceeb485585b4ae78871' -> '' move scheduled
I20260810 01:59:53.648887 6977 rebalancer_tool.cc:1090] tablet d05e147199e44b8ca712e18d22e7cce7: '17b49c694faf479ea2e5083470fc0302' -> '' move scheduled
I20260810 01:59:53.746289 6977 rebalancer_tool.cc:1090] tablet 2e72e04459b140cc9e20ad633b1ab5c4: 'dc85be7d460a404f997177f57680850f' -> '' move scheduled
I20260810 01:59:53.800289 6977 rebalancer_tool.cc:1090] tablet eb90d508a0004daa8f10d562cefe5fd6: '82f93d1d11364ceeb485585b4ae78871' -> '' move scheduled
I20260810 01:59:53.873389 6977 rebalancer_tool.cc:1090] tablet 3a15b27dbdaf4092aea66c3670204fcc: '17b49c694faf479ea2e5083470fc0302' -> '' move scheduled
I20260810 01:59:53.988169 6977 rebalancer_tool.cc:1152] tablet 3a15b27dbdaf4092aea66c3670204fcc: '17b49c694faf479ea2e5083470fc0302' -> '' move completed: OK
I20260810 01:59:54.164680 6977 rebalancer_tool.cc:1152] tablet eb90d508a0004daa8f10d562cefe5fd6: '82f93d1d11364ceeb485585b4ae78871' -> '' move completed: OK
I20260810 01:59:54.258571 6977 rebalancer_tool.cc:1152] tablet 2e72e04459b140cc9e20ad633b1ab5c4: 'dc85be7d460a404f997177f57680850f' -> '' move completed: OK
I20260810 01:59:54.382009 6977 rebalancer_tool.cc:1152] tablet d05e147199e44b8ca712e18d22e7cce7: '17b49c694faf479ea2e5083470fc0302' -> '' move completed: OK
I20260810 01:59:54.516120 6977 rebalancer_tool.cc:1152] tablet 7207ea155ba44c0a9ba216acd22dc1b4: '82f93d1d11364ceeb485585b4ae78871' -> '' move completed: OK
W20260810 01:59:56.204703 6977 rebalancer_tool.cc:1212] table 5e8751d351ba4b7da7861e02b0c3c634: no follower replicas available on dc85be7d460a404f997177f57680850f, falling back to leader replicas
I20260810 01:59:56.574189 6977 rebalancer_tool.cc:1090] tablet e70193bd4055469d870a76542eaef524: '3136daf7101445beadc1aa19bc01c227' -> 'ca4469fc2dbc48488bc7ad7f482f129e' move scheduled
I20260810 01:59:57.437018 6977 rebalancer_tool.cc:1090] tablet b6c5892f4de449fb8cb7f4cff7eb2e20: '4dd4cba155c941b4b7ad4d64c7431536' -> 'c5ed5317da9c464b93f979c405f0f6e4' move scheduled
I20260810 01:59:57.611193 6977 rebalancer_tool.cc:1090] tablet df5b102a0b03406f9449cdd84dfd147e: 'dc85be7d460a404f997177f57680850f' -> '' move scheduled
I20260810 01:59:58.585822 6977 rebalancer_tool.cc:1090] tablet 4fc45932b9634d6d98d8a0204d4b121a: '22ce0e487f0341fd9bf853393d6e7683' -> 'ca4469fc2dbc48488bc7ad7f482f129e' move scheduled
I20260810 01:59:59.124122 6977 rebalancer_tool.cc:1090] tablet a586b7d625bb4c27a6343ae7918c8cea: '3136daf7101445beadc1aa19bc01c227' -> '17b49c694faf479ea2e5083470fc0302' move scheduled
I20260810 01:59:59.528074 6977 rebalancer_tool.cc:1090] tablet d05e147199e44b8ca712e18d22e7cce7: '4dd4cba155c941b4b7ad4d64c7431536' -> '17b49c694faf479ea2e5083470fc0302' move scheduled
I20260810 02:00:00.112999 6977 rebalancer_tool.cc:1090] tablet 18a93b1a1ce1440b99bdd7a3bcf49064: 'c5ed5317da9c464b93f979c405f0f6e4' -> '17b49c694faf479ea2e5083470fc0302' move scheduled
I20260810 02:00:00.260704 6977 rebalancer_tool.cc:1100] tablet 606ad043ee3344c39c9eef7cd1920d7e: '3136daf7101445beadc1aa19bc01c227' -> 'dc85be7d460a404f997177f57680850f' move ignored: Illegal state: tablet 606ad043ee3344c39c9eef7cd1920d7e: replica dc85be7d460a404f997177f57680850f is already present
I20260810 02:00:00.260886 6977 rebalancer_tool.cc:772] re-synchronizing cluster state
I20260810 02:00:02.814867 6977 rebalancer_tool.cc:1090] tablet da507bc24d964ce1a5835edad5177726: '4dd4cba155c941b4b7ad4d64c7431536' -> '82f93d1d11364ceeb485585b4ae78871' move scheduled
I20260810 02:00:03.123735 6977 rebalancer_tool.cc:1090] tablet 252899385eaa45b392974d2768e3cf01: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '' move scheduled
I20260810 02:00:03.601264 6977 rebalancer_tool.cc:1090] tablet 8308d63e9002418b876c3d3ae0095d9f: '3136daf7101445beadc1aa19bc01c227' -> '82f93d1d11364ceeb485585b4ae78871' move scheduled
I20260810 02:00:03.748379 6977 rebalancer_tool.cc:1090] tablet 4a4350cf2ece4769b8547620ac5bedcb: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '' move scheduled
I20260810 02:00:09.802608 6977 rebalancer_tool.cc:1152] tablet da507bc24d964ce1a5835edad5177726: '4dd4cba155c941b4b7ad4d64c7431536' -> '82f93d1d11364ceeb485585b4ae78871' move completed: Incomplete: tablet da507bc24d964ce1a5835edad5177726, TS 4dd4cba155c941b4b7ad4d64c7431536 -> TS 82f93d1d11364ceeb485585b4ae78871 move failed, target replica disappeared
I20260810 02:00:27.249029 6977 rebalancer_tool.cc:1152] tablet b6c5892f4de449fb8cb7f4cff7eb2e20: '4dd4cba155c941b4b7ad4d64c7431536' -> 'c5ed5317da9c464b93f979c405f0f6e4' move completed: OK
I20260810 02:00:29.973773 6977 rebalancer_tool.cc:1152] tablet 4a4350cf2ece4769b8547620ac5bedcb: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '' move completed: OK
I20260810 02:00:30.198130 6977 rebalancer_tool.cc:1152] tablet 8308d63e9002418b876c3d3ae0095d9f: '3136daf7101445beadc1aa19bc01c227' -> '82f93d1d11364ceeb485585b4ae78871' move completed: Incomplete: tablet 8308d63e9002418b876c3d3ae0095d9f, TS 3136daf7101445beadc1aa19bc01c227 -> TS 82f93d1d11364ceeb485585b4ae78871 move failed, target replica disappeared
I20260810 02:00:30.343348 6977 rebalancer_tool.cc:1152] tablet 252899385eaa45b392974d2768e3cf01: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '' move completed: OK
I20260810 02:00:30.412885 6977 rebalancer_tool.cc:1152] tablet 18a93b1a1ce1440b99bdd7a3bcf49064: 'c5ed5317da9c464b93f979c405f0f6e4' -> '17b49c694faf479ea2e5083470fc0302' move completed: OK
I20260810 02:00:30.472187 6977 rebalancer_tool.cc:1152] tablet d05e147199e44b8ca712e18d22e7cce7: '4dd4cba155c941b4b7ad4d64c7431536' -> '17b49c694faf479ea2e5083470fc0302' move completed: OK
I20260810 02:00:30.545399 6977 rebalancer_tool.cc:1152] tablet a586b7d625bb4c27a6343ae7918c8cea: '3136daf7101445beadc1aa19bc01c227' -> '17b49c694faf479ea2e5083470fc0302' move completed: OK
I20260810 02:00:30.586385 6977 rebalancer_tool.cc:1152] tablet 4fc45932b9634d6d98d8a0204d4b121a: '22ce0e487f0341fd9bf853393d6e7683' -> 'ca4469fc2dbc48488bc7ad7f482f129e' move completed: OK
I20260810 02:00:30.709774 6977 rebalancer_tool.cc:1152] tablet df5b102a0b03406f9449cdd84dfd147e: 'dc85be7d460a404f997177f57680850f' -> '' move completed: OK
I20260810 02:00:30.791975 6977 rebalancer_tool.cc:1152] tablet e70193bd4055469d870a76542eaef524: '3136daf7101445beadc1aa19bc01c227' -> 'ca4469fc2dbc48488bc7ad7f482f129e' move completed: OK
I20260810 02:00:33.236549 6977 rebalancer_tool.cc:1100] tablet 4a4350cf2ece4769b8547620ac5bedcb: '4dd4cba155c941b4b7ad4d64c7431536' -> '22ce0e487f0341fd9bf853393d6e7683' move ignored: Illegal state: tablet 4a4350cf2ece4769b8547620ac5bedcb: replica 22ce0e487f0341fd9bf853393d6e7683 is already present
I20260810 02:00:33.236730 6977 rebalancer_tool.cc:772] re-synchronizing cluster state
I20260810 02:00:35.347952 6977 rebalancer_tool.cc:1090] tablet 4a4350cf2ece4769b8547620ac5bedcb: '22ce0e487f0341fd9bf853393d6e7683' -> '' move scheduled
I20260810 02:00:35.423266 6977 rebalancer_tool.cc:1090] tablet 252899385eaa45b392974d2768e3cf01: '4dd4cba155c941b4b7ad4d64c7431536' -> '' move scheduled
I20260810 02:00:37.796882 6977 rebalancer_tool.cc:1139] tablet 252899385eaa45b392974d2768e3cf01: '4dd4cba155c941b4b7ad4d64c7431536' -> '' move is abandoned: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }.
Pending config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 02:00:39.448099 6977 rebalancer_tool.cc:772] re-synchronizing cluster state
W20260810 02:00:40.757874 6977 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table afa71147917d44a585bcbaa37497a2b1: could not find any suitable replica to move from server dc85be7d460a404f997177f57680850f to server 4dd4cba155c941b4b7ad4d64c7431536
I20260810 02:00:43.285717 6977 rebalancer_tool.cc:1152] tablet 4a4350cf2ece4769b8547620ac5bedcb: '22ce0e487f0341fd9bf853393d6e7683' -> '' move completed: OK
I20260810 02:00:44.726469 6977 rebalancer_tool.cc:1090] tablet f7a36f7ebd5d4342a259b093e45d4c32: '3136daf7101445beadc1aa19bc01c227' -> 'c5ed5317da9c464b93f979c405f0f6e4' move scheduled
I20260810 02:00:44.848901 6977 rebalancer_tool.cc:1100] tablet 389d3abfeadd4fe6a4efa74427d71c4d: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '82f93d1d11364ceeb485585b4ae78871' move ignored: Illegal state: tablet 389d3abfeadd4fe6a4efa74427d71c4d: replica 82f93d1d11364ceeb485585b4ae78871 is already present
I20260810 02:00:44.849011 6977 rebalancer_tool.cc:772] re-synchronizing cluster state
I20260810 02:00:46.781869 6977 rebalancer_tool.cc:1090] tablet 7207ea155ba44c0a9ba216acd22dc1b4: 'c5ed5317da9c464b93f979c405f0f6e4' -> '4dd4cba155c941b4b7ad4d64c7431536' move scheduled
W20260810 02:00:50.288400 28288 negotiation.cc:336] Failed RPC negotiation. Trace:
0810 02:00:50.054170 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.21.64.194:43893 (local address 127.0.0.1:37016)
0810 02:00:50.071229 (+ 17059us) negotiation.cc:107] Waiting for socket to connect
0810 02:00:50.071
W20260810 02:00:53.512435 4038 consensus_peers.cc:597] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 17b49c694faf479ea2e5083470fc0302 -> Peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): Couldn't send request to peer 82f93d1d11364ceeb485585b4ae78871. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.194:43893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260810 02:00:53.519789 6715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260810 02:00:53.581111 28702 raft_consensus.cc:493] T 2e72e04459b140cc9e20ad633b1ab5c4 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 82f93d1d11364ceeb485585b4ae78871)
I20260810 02:00:53.581373 28702 raft_consensus.cc:515] T 2e72e04459b140cc9e20ad633b1ab5c4 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 02:00:53.582074 28702 leader_election.cc:290] T 2e72e04459b140cc9e20ad633b1ab5c4 P 3136daf7101445beadc1aa19bc01c227 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893), dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
W20260810 02:00:53.584002 6826 leader_election.cc:336] T 2e72e04459b140cc9e20ad633b1ab5c4 P 3136daf7101445beadc1aa19bc01c227 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): Network error: Client connection negotiation failed: client connection to 127.21.64.194:43893: connect: Connection refused (error 111)
W20260810 02:00:53.584214 6824 leader_election.cc:336] T 2e72e04459b140cc9e20ad633b1ab5c4 P 3136daf7101445beadc1aa19bc01c227 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797): Network error: Client connection negotiation failed: client connection to 127.21.64.193:36797: connect: Connection refused (error 111)
I20260810 02:00:53.584324 6824 leader_election.cc:304] T 2e72e04459b140cc9e20ad633b1ab5c4 P 3136daf7101445beadc1aa19bc01c227 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3136daf7101445beadc1aa19bc01c227; no voters: 82f93d1d11364ceeb485585b4ae78871, dc85be7d460a404f997177f57680850f
I20260810 02:00:53.584564 28702 raft_consensus.cc:2749] T 2e72e04459b140cc9e20ad633b1ab5c4 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 02:00:53.595350 28782 raft_consensus.cc:493] T fe8e1f0908234e46881258cfe79835f8 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 82f93d1d11364ceeb485585b4ae78871)
I20260810 02:00:53.595580 28782 raft_consensus.cc:515] T fe8e1f0908234e46881258cfe79835f8 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "22ce0e487f0341fd9bf853393d6e7683" member_type: VOTER last_known_addr { host: "127.21.64.198" port: 45317 } }
I20260810 02:00:53.596401 28782 leader_election.cc:290] T fe8e1f0908234e46881258cfe79835f8 P 4dd4cba155c941b4b7ad4d64c7431536 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893), c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199:41689), 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317)
I20260810 02:00:53.597177 6739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe8e1f0908234e46881258cfe79835f8" candidate_uuid: "4dd4cba155c941b4b7ad4d64c7431536" candidate_term: 2 candidate_status { last_received { term: 1 index: 14 } } ignore_live_leader: false dest_uuid: "c5ed5317da9c464b93f979c405f0f6e4" is_pre_election: true
I20260810 02:00:53.598130 6739 raft_consensus.cc:2468] T fe8e1f0908234e46881258cfe79835f8 P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dd4cba155c941b4b7ad4d64c7431536 in term 1.
W20260810 02:00:53.598158 6311 leader_election.cc:336] T fe8e1f0908234e46881258cfe79835f8 P 4dd4cba155c941b4b7ad4d64c7431536 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): Network error: Client connection negotiation failed: client connection to 127.21.64.194:43893: connect: Connection refused (error 111)
W20260810 02:00:53.598734 6311 leader_election.cc:343] T fe8e1f0908234e46881258cfe79835f8 P 4dd4cba155c941b4b7ad4d64c7431536 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317): Not found: Tablet not found: fe8e1f0908234e46881258cfe79835f8
I20260810 02:00:53.598865 6311 leader_election.cc:304] T fe8e1f0908234e46881258cfe79835f8 P 4dd4cba155c941b4b7ad4d64c7431536 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4dd4cba155c941b4b7ad4d64c7431536, c5ed5317da9c464b93f979c405f0f6e4; no voters: 22ce0e487f0341fd9bf853393d6e7683, 82f93d1d11364ceeb485585b4ae78871
I20260810 02:00:53.599114 28782 raft_consensus.cc:2749] T fe8e1f0908234e46881258cfe79835f8 P 4dd4cba155c941b4b7ad4d64c7431536 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 02:00:53.857652 28553 raft_consensus.cc:493] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dc85be7d460a404f997177f57680850f)
I20260810 02:00:53.857885 28553 raft_consensus.cc:515] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } }
I20260810 02:00:53.858616 28553 leader_election.cc:290] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dc85be7d460a404f997177f57680850f (127.21.64.193:36797), 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893)
W20260810 02:00:53.860572 6655 leader_election.cc:336] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): Network error: Client connection negotiation failed: client connection to 127.21.64.194:43893: connect: Connection refused (error 111)
W20260810 02:00:53.860877 6653 leader_election.cc:336] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797): Network error: Client connection negotiation failed: client connection to 127.21.64.193:36797: connect: Connection refused (error 111)
I20260810 02:00:53.861040 6653 leader_election.cc:304] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ed5317da9c464b93f979c405f0f6e4; no voters: 82f93d1d11364ceeb485585b4ae78871, dc85be7d460a404f997177f57680850f
I20260810 02:00:53.861400 28553 raft_consensus.cc:2749] T 389d3abfeadd4fe6a4efa74427d71c4d P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 02:00:53.934933 6824 consensus_peers.cc:597] T abf302f27a12414a8647dab82ab8101f P 3136daf7101445beadc1aa19bc01c227 -> Peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797): Couldn't send request to peer dc85be7d460a404f997177f57680850f. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.193:36797: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260810 02:00:53.938380 28553 raft_consensus.cc:493] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 82f93d1d11364ceeb485585b4ae78871)
I20260810 02:00:53.938601 28553 raft_consensus.cc:515] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 02:00:53.939363 28553 leader_election.cc:290] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893), dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
W20260810 02:00:53.940842 6655 leader_election.cc:336] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): Network error: Client connection negotiation failed: client connection to 127.21.64.194:43893: connect: Connection refused (error 111)
W20260810 02:00:53.941244 6653 leader_election.cc:336] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797): Network error: Client connection negotiation failed: client connection to 127.21.64.193:36797: connect: Connection refused (error 111)
I20260810 02:00:53.941463 6653 leader_election.cc:304] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ed5317da9c464b93f979c405f0f6e4; no voters: 82f93d1d11364ceeb485585b4ae78871, dc85be7d460a404f997177f57680850f
I20260810 02:00:53.941756 28553 raft_consensus.cc:2749] T 4a4350cf2ece4769b8547620ac5bedcb P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 02:00:53.970680 6974 rebalancer_tool-test.cc:1258] rebalancer run info: Runtime error: /tmp/dist-test-taskNubV1X/build/asan/bin/kudu: process exited with non-zero status 1
stdout: Per-server replica distribution summary:
Statistic | Value
-----------------------+-----------
Minimum Replica Count | 0
Maximum Replica Count | 23
Average Replica Count | 11.250000
Per-table replica distribution summary:
Replica Skew | Value
--------------+----------
Minimum | 3
Maximum | 3
Average | 3.000000
stderr: W20260810 01:59:04.501245 6982 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:59:04.501806 6982 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260810 01:59:08.748042 6982 rebalancer_tool.cc:215] running whole-cluster rebalancing
W20260810 01:59:10.961146 6982 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 5b2df46262b142169af9a32c47535432: could not find any suitable replica to move from server ca4469fc2dbc48488bc7ad7f482f129e to server 22ce0e487f0341fd9bf853393d6e7683
W20260810 01:59:10.961565 6982 rebalancer_tool.cc:1212] table b572363d270a4bfda571d46e96d0bfda: no follower replicas available on 17b49c694faf479ea2e5083470fc0302, falling back to leader replicas
W20260810 01:59:10.961747 6982 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 372310cb713644ada1071e8eb628b0c9: could not find any suitable replica to move from server ca4469fc2dbc48488bc7ad7f482f129e to server 22ce0e487f0341fd9bf853393d6e7683
W20260810 01:59:10.962035 6982 rebalancer_tool.cc:1212] table c515c90b2c71492f812b4df18501ee04: no follower replicas available on dc85be7d460a404f997177f57680850f, falling back to leader replicas
W20260810 01:59:10.962131 6982 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table c515c90b2c71492f812b4df18501ee04: could not find any suitable replica to move from server dc85be7d460a404f997177f57680850f to server c5ed5317da9c464b93f979c405f0f6e4
W20260810 01:59:10.962255 6982 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table afa71147917d44a585bcbaa37497a2b1: could not find any suitable replica to move from server 82f93d1d11364ceeb485585b4ae78871 to server 3136daf7101445beadc1aa19bc01c227
W20260810 01:59:10.962392 6982 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 5e8751d351ba4b7da7861e02b0c3c634: could not find any suitable replica to move from server 82f93d1d11364ceeb485585b4ae78871 to server 3136daf7101445beadc1aa19bc01c227
W20260810 01:59:10.962518 6982 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table c515c90b2c71492f812b4df18501ee04: could not find any suitable replica to move from server 17b49c694faf479ea2e5083470fc0302 to server 4dd4cba155c941b4b7ad4d64c7431536
W20260810 01:59:10.962667 6982 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 8fd8ee0beeb54ad9bee1c94775d09e8f: could not find any suitable replica to move from server dc85be7d460a404f997177f57680850f to server 4dd4cba155c941b4b7ad4d64c7431536
W20260810 01:59:10.962860 6982 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 5b2df46262b142169af9a32c47535432: could not find any suitable replica to move from server ca4469fc2dbc48488bc7ad7f482f129e to server 4dd4cba155c941b4b7ad4d64c7431536
W20260810 01:59:10.962988 6982 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 945a223441a04ba2bf938b104bc91cf8: could not find any suitable replica to move from server dc85be7d460a404f997177f57680850f to server 3136daf7101445beadc1aa19bc01c227
W20260810 01:59:10.963110 6982 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table e211628d46b64734960dfd60d86708ce: could not find any suitable replica to move from server 82f93d1d11364ceeb485585b4ae78871 to server 22ce0e487f0341fd9bf853393d6e7683
W20260810 01:59:10.963303 6982 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 3e1f7b9b31614ed383207098de38230c: could not find any suitable replica to move from server dc85be7d460a404f997177f57680850f to server 22ce0e487f0341fd9bf853393d6e7683
W20260810 01:59:10.963433 6982 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table b572363d270a4bfda571d46e96d0bfda: could not find any suitable replica to move from server 82f93d1d11364ceeb485585b4ae78871 to server 3136daf7101445beadc1aa19bc01c227
W20260810 01:59:10.965881 6982 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table afa71147917d44a585bcbaa37497a2b1: could not find any suitable replica to move from server dc85be7d460a404f997177f57680850f to server 22ce0e487f0341fd9bf853393d6e7683
W20260810 01:59:10.966044 6982 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 372310cb713644ada1071e8eb628b0c9: could not find any suitable replica to move from server 17b49c694faf479ea2e5083470fc0302 to server c5ed5317da9c464b93f979c405f0f6e4
W20260810 01:59:10.966162 6982 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 945a223441a04ba2bf938b104bc91cf8: could not find any suitable replica to move from server ca4469fc2dbc48488bc7ad7f482f129e to server 3136daf7101445beadc1aa19bc01c227
W20260810 01:59:10.966316 6982 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table e211628d46b64734960dfd60d86708ce: could not find any suitable replica to move from server 17b49c694faf479ea2e5083470fc0302 to server 4dd4cba155c941b4b7ad4d64c7431536
I20260810 01:59:11.543032 6982 rebalancer_tool.cc:1090] tablet cf531b93380e43bfa103837bd6350834: '17b49c694faf479ea2e5083470fc0302' -> '22ce0e487f0341fd9bf853393d6e7683' move scheduled
I20260810 01:59:12.083994 6982 rebalancer_tool.cc:1090] tablet 389d3abfeadd4fe6a4efa74427d71c4d: '82f93d1d11364ceeb485585b4ae78871' -> 'c5ed5317da9c464b93f979c405f0f6e4' move scheduled
I20260810 01:59:12.735708 6982 rebalancer_tool.cc:1090] tablet 4fc45932b9634d6d98d8a0204d4b121a: 'dc85be7d460a404f997177f57680850f' -> '4dd4cba155c941b4b7ad4d64c7431536' move scheduled
I20260810 01:59:13.381228 6982 rebalancer_tool.cc:1090] tablet 18a93b1a1ce1440b99bdd7a3bcf49064: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '3136daf7101445beadc1aa19bc01c227' move scheduled
I20260810 01:59:13.990780 6982 rebalancer_tool.cc:1090] tablet 3a15b27dbdaf4092aea66c3670204fcc: '17b49c694faf479ea2e5083470fc0302' -> '22ce0e487f0341fd9bf853393d6e7683' move scheduled
I20260810 01:59:14.622556 6982 rebalancer_tool.cc:1090] tablet 1d377b919f4748c88efb249dfc964f17: '82f93d1d11364ceeb485585b4ae78871' -> 'c5ed5317da9c464b93f979c405f0f6e4' move scheduled
I20260810 01:59:15.382392 6982 rebalancer_tool.cc:1090] tablet f7a36f7ebd5d4342a259b093e45d4c32: 'dc85be7d460a404f997177f57680850f' -> '3136daf7101445beadc1aa19bc01c227' move scheduled
I20260810 01:59:15.943337 6982 rebalancer_tool.cc:1090] tablet c53fc4008faf445fa05e436b9c8e0282: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '4dd4cba155c941b4b7ad4d64c7431536' move scheduled
I20260810 01:59:16.341590 6982 rebalancer_tool.cc:1090] tablet b63d0798e1ae4aea9b0272716d53d46d: '17b49c694faf479ea2e5083470fc0302' -> 'c5ed5317da9c464b93f979c405f0f6e4' move scheduled
I20260810 01:59:16.909766 6982 rebalancer_tool.cc:1090] tablet 0afbd7afdd834537b15c727355724562: '82f93d1d11364ceeb485585b4ae78871' -> '22ce0e487f0341fd9bf853393d6e7683' move scheduled
I20260810 01:59:17.791275 6982 rebalancer_tool.cc:1090] tablet fe8e1f0908234e46881258cfe79835f8: 'dc85be7d460a404f997177f57680850f' -> '3136daf7101445beadc1aa19bc01c227' move scheduled
I20260810 01:59:17.962131 6982 rebalancer_tool.cc:1100] tablet df5b102a0b03406f9449cdd84dfd147e: 'ca4469fc2dbc48488bc7ad7f482f129e' -> 'c5ed5317da9c464b93f979c405f0f6e4' move ignored: Illegal state: tablet df5b102a0b03406f9449cdd84dfd147e: replica c5ed5317da9c464b93f979c405f0f6e4 is already present
I20260810 01:59:17.962376 6982 rebalancer_tool.cc:772] re-synchronizing cluster state
W20260810 01:59:19.537186 6982 rebalancer_tool.cc:1212] table b572363d270a4bfda571d46e96d0bfda: no follower replicas available on 17b49c694faf479ea2e5083470fc0302, falling back to leader replicas
W20260810 01:59:19.537431 6982 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 5b2df46262b142169af9a32c47535432: could not find any suitable replica to move from server ca4469fc2dbc48488bc7ad7f482f129e to server c5ed5317da9c464b93f979c405f0f6e4
W20260810 01:59:19.537894 6982 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 372310cb713644ada1071e8eb628b0c9: could not find any suitable replica to move from server ca4469fc2dbc48488bc7ad7f482f129e to server 4dd4cba155c941b4b7ad4d64c7431536
W20260810 01:59:19.538014 6982 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 5e8751d351ba4b7da7861e02b0c3c634: could not find any suitable replica to move from server dc85be7d460a404f997177f57680850f to server 3136daf7101445beadc1aa19bc01c227
W20260810 01:59:19.538160 6982 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table e211628d46b64734960dfd60d86708ce: could not find any suitable replica to move from server 17b49c694faf479ea2e5083470fc0302 to server 22ce0e487f0341fd9bf853393d6e7683
W20260810 01:59:19.538365 6982 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table c515c90b2c71492f812b4df18501ee04: could not find any suitable replica to move from server ca4469fc2dbc48488bc7ad7f482f129e to server 4dd4cba155c941b4b7ad4d64c7431536
W20260810 01:59:19.538515 6982 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 372310cb713644ada1071e8eb628b0c9: could not find any suitable replica to move from server 17b49c694faf479ea2e5083470fc0302 to server 3136daf7101445beadc1aa19bc01c227
W20260810 01:59:19.538605 6982 rebalancer_tool.cc:1212] table c515c90b2c71492f812b4df18501ee04: no follower replicas available on dc85be7d460a404f997177f57680850f, falling back to leader replicas
W20260810 01:59:19.538709 6982 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table c515c90b2c71492f812b4df18501ee04: could not find any suitable replica to move from server dc85be7d460a404f997177f57680850f to server c5ed5317da9c464b93f979c405f0f6e4
I20260810 01:59:19.590265 6982 rebalancer_tool.cc:1090] tablet f3d04e9457c944a8a72861680bdf9b7c: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '' move scheduled
I20260810 01:59:19.671969 6982 rebalancer_tool.cc:1090] tablet 8e8d13caf8054b1daf09b2b114843766: '17b49c694faf479ea2e5083470fc0302' -> '' move scheduled
I20260810 01:59:20.198813 6982 rebalancer_tool.cc:1090] tablet d05e147199e44b8ca712e18d22e7cce7: '82f93d1d11364ceeb485585b4ae78871' -> '4dd4cba155c941b4b7ad4d64c7431536' move scheduled
I20260810 01:59:20.310122 6982 rebalancer_tool.cc:1090] tablet 606ad043ee3344c39c9eef7cd1920d7e: 'dc85be7d460a404f997177f57680850f' -> '' move scheduled
I20260810 01:59:21.702255 6982 rebalancer_tool.cc:1090] tablet e70193bd4055469d870a76542eaef524: '17b49c694faf479ea2e5083470fc0302' -> '3136daf7101445beadc1aa19bc01c227' move scheduled
I20260810 01:59:21.868589 6982 rebalancer_tool.cc:1090] tablet 4a4350cf2ece4769b8547620ac5bedcb: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '' move scheduled
I20260810 01:59:22.235471 6982 rebalancer_tool.cc:1090] tablet eb90d508a0004daa8f10d562cefe5fd6: '82f93d1d11364ceeb485585b4ae78871' -> '3136daf7101445beadc1aa19bc01c227' move scheduled
I20260810 01:59:27.289430 6982 rebalancer_tool.cc:1152] tablet 1d377b919f4748c88efb249dfc964f17: '82f93d1d11364ceeb485585b4ae78871' -> 'c5ed5317da9c464b93f979c405f0f6e4' move completed: OK
W20260810 01:59:28.861132 11701 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.GetTableLocations -> {remote=127.21.64.254:44657, user_credentials={real_user=slave}} blocked reactor thread for 60001.2us
I20260810 01:59:40.541785 6982 rebalancer_tool.cc:1152] tablet f3d04e9457c944a8a72861680bdf9b7c: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '' move completed: OK
I20260810 01:59:40.643628 6982 rebalancer_tool.cc:1152] tablet 606ad043ee3344c39c9eef7cd1920d7e: 'dc85be7d460a404f997177f57680850f' -> '' move completed: OK
I20260810 01:59:40.751781 6982 rebalancer_tool.cc:1152] tablet f7a36f7ebd5d4342a259b093e45d4c32: 'dc85be7d460a404f997177f57680850f' -> '3136daf7101445beadc1aa19bc01c227' move completed: OK
I20260810 01:59:43.924904 6982 rebalancer_tool.cc:1152] tablet c53fc4008faf445fa05e436b9c8e0282: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '4dd4cba155c941b4b7ad4d64c7431536' move completed: OK
I20260810 01:59:49.078347 6982 rebalancer_tool.cc:1152] tablet fe8e1f0908234e46881258cfe79835f8: 'dc85be7d460a404f997177f57680850f' -> '3136daf7101445beadc1aa19bc01c227' move completed: OK
I20260810 01:59:49.168329 6982 rebalancer_tool.cc:1152] tablet 8e8d13caf8054b1daf09b2b114843766: '17b49c694faf479ea2e5083470fc0302' -> '' move completed: OK
I20260810 01:59:53.100867 6982 rebalancer_tool.cc:1100] tablet 2e72e04459b140cc9e20ad633b1ab5c4: 'dc85be7d460a404f997177f57680850f' -> '3136daf7101445beadc1aa19bc01c227' move ignored: Illegal state: tablet 2e72e04459b140cc9e20ad633b1ab5c4: replica 3136daf7101445beadc1aa19bc01c227 is already present
I20260810 01:59:53.101126 6982 rebalancer_tool.cc:772] re-synchronizing cluster state
W20260810 01:59:54.512089 6982 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table b572363d270a4bfda571d46e96d0bfda: could not find any suitable replica to move from server 3136daf7101445beadc1aa19bc01c227 to server ca4469fc2dbc48488bc7ad7f482f129e
W20260810 01:59:54.512708 6982 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 945a223441a04ba2bf938b104bc91cf8: could not find any suitable replica to move from server ca4469fc2dbc48488bc7ad7f482f129e to server 17b49c694faf479ea2e5083470fc0302
I20260810 01:59:54.610626 6982 rebalancer_tool.cc:1090] tablet b6c5892f4de449fb8cb7f4cff7eb2e20: '4dd4cba155c941b4b7ad4d64c7431536' -> '' move scheduled
I20260810 01:59:55.234627 6982 rebalancer_tool.cc:1090] tablet 7207ea155ba44c0a9ba216acd22dc1b4: 'dc85be7d460a404f997177f57680850f' -> '82f93d1d11364ceeb485585b4ae78871' move scheduled
I20260810 01:59:55.932258 6982 rebalancer_tool.cc:1090] tablet 252899385eaa45b392974d2768e3cf01: '3136daf7101445beadc1aa19bc01c227' -> 'ca4469fc2dbc48488bc7ad7f482f129e' move scheduled
I20260810 01:59:56.086298 6982 rebalancer_tool.cc:1090] tablet abf302f27a12414a8647dab82ab8101f: '4dd4cba155c941b4b7ad4d64c7431536' -> '' move scheduled
I20260810 01:59:56.368899 6982 rebalancer_tool.cc:1090] tablet 8e8d13caf8054b1daf09b2b114843766: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '4dd4cba155c941b4b7ad4d64c7431536' move scheduled
I20260810 01:59:56.486469 6982 rebalancer_tool.cc:1090] tablet fe8e1f0908234e46881258cfe79835f8: '3136daf7101445beadc1aa19bc01c227' -> '' move scheduled
I20260810 02:00:06.254233 6982 rebalancer_tool.cc:1152] tablet eb90d508a0004daa8f10d562cefe5fd6: '82f93d1d11364ceeb485585b4ae78871' -> '3136daf7101445beadc1aa19bc01c227' move completed: OK
I20260810 02:00:08.826113 6982 rebalancer_tool.cc:1152] tablet 3a15b27dbdaf4092aea66c3670204fcc: '17b49c694faf479ea2e5083470fc0302' -> '22ce0e487f0341fd9bf853393d6e7683' move completed: OK
I20260810 02:00:09.025056 6982 rebalancer_tool.cc:1152] tablet 389d3abfeadd4fe6a4efa74427d71c4d: '82f93d1d11364ceeb485585b4ae78871' -> 'c5ed5317da9c464b93f979c405f0f6e4' move completed: OK
I20260810 02:00:11.928896 6982 rebalancer_tool.cc:1152] tablet 18a93b1a1ce1440b99bdd7a3bcf49064: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '3136daf7101445beadc1aa19bc01c227' move completed: OK
I20260810 02:00:12.095805 6982 rebalancer_tool.cc:1152] tablet 4fc45932b9634d6d98d8a0204d4b121a: 'dc85be7d460a404f997177f57680850f' -> '4dd4cba155c941b4b7ad4d64c7431536' move completed: OK
I20260810 02:00:12.183153 6982 rebalancer_tool.cc:1152] tablet cf531b93380e43bfa103837bd6350834: '17b49c694faf479ea2e5083470fc0302' -> '22ce0e487f0341fd9bf853393d6e7683' move completed: OK
I20260810 02:00:12.213747 6982 rebalancer_tool.cc:1152] tablet b63d0798e1ae4aea9b0272716d53d46d: '17b49c694faf479ea2e5083470fc0302' -> 'c5ed5317da9c464b93f979c405f0f6e4' move completed: OK
I20260810 02:00:12.281351 6982 rebalancer_tool.cc:1152] tablet d05e147199e44b8ca712e18d22e7cce7: '82f93d1d11364ceeb485585b4ae78871' -> '4dd4cba155c941b4b7ad4d64c7431536' move completed: OK
I20260810 02:00:12.520462 6982 rebalancer_tool.cc:1152] tablet 0afbd7afdd834537b15c727355724562: '82f93d1d11364ceeb485585b4ae78871' -> '22ce0e487f0341fd9bf853393d6e7683' move completed: OK
I20260810 02:00:14.740041 6982 rebalancer_tool.cc:1152] tablet e70193bd4055469d870a76542eaef524: '17b49c694faf479ea2e5083470fc0302' -> '3136daf7101445beadc1aa19bc01c227' move completed: OK
I20260810 02:00:14.784154 6982 rebalancer_tool.cc:1100] tablet 1d377b919f4748c88efb249dfc964f17: '3136daf7101445beadc1aa19bc01c227' -> '17b49c694faf479ea2e5083470fc0302' move ignored: Illegal state: tablet 1d377b919f4748c88efb249dfc964f17: replica 17b49c694faf479ea2e5083470fc0302 is already present
I20260810 02:00:14.784382 6982 rebalancer_tool.cc:772] re-synchronizing cluster state
W20260810 02:00:17.178550 6982 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 3e1f7b9b31614ed383207098de38230c: could not find any suitable replica to move from server c5ed5317da9c464b93f979c405f0f6e4 to server 3136daf7101445beadc1aa19bc01c227
I20260810 02:00:17.889243 6982 rebalancer_tool.cc:1090] tablet 2e72e04459b140cc9e20ad633b1ab5c4: '22ce0e487f0341fd9bf853393d6e7683' -> 'dc85be7d460a404f997177f57680850f' move scheduled
I20260810 02:00:18.452896 6982 rebalancer_tool.cc:1090] tablet da507bc24d964ce1a5835edad5177726: 'dc85be7d460a404f997177f57680850f' -> '82f93d1d11364ceeb485585b4ae78871' move scheduled
I20260810 02:00:19.146690 6982 rebalancer_tool.cc:1090] tablet 389d3abfeadd4fe6a4efa74427d71c4d: '22ce0e487f0341fd9bf853393d6e7683' -> 'ca4469fc2dbc48488bc7ad7f482f129e' move scheduled
I20260810 02:00:19.253733 6982 rebalancer_tool.cc:1090] tablet 4fc45932b9634d6d98d8a0204d4b121a: '22ce0e487f0341fd9bf853393d6e7683' -> '' move scheduled
I20260810 02:00:29.783083 6982 rebalancer_tool.cc:1152] tablet fe8e1f0908234e46881258cfe79835f8: '3136daf7101445beadc1aa19bc01c227' -> '' move completed: OK
I20260810 02:00:29.964201 6982 rebalancer_tool.cc:1152] tablet 8e8d13caf8054b1daf09b2b114843766: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '4dd4cba155c941b4b7ad4d64c7431536' move completed: OK
I20260810 02:00:30.169731 6982 rebalancer_tool.cc:1152] tablet abf302f27a12414a8647dab82ab8101f: '4dd4cba155c941b4b7ad4d64c7431536' -> '' move completed: OK
I20260810 02:00:30.330058 6982 rebalancer_tool.cc:1152] tablet b6c5892f4de449fb8cb7f4cff7eb2e20: '4dd4cba155c941b4b7ad4d64c7431536' -> '' move completed: OK
I20260810 02:00:30.483349 6982 rebalancer_tool.cc:1152] tablet 4a4350cf2ece4769b8547620ac5bedcb: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '' move completed: OK
I20260810 02:00:30.572781 6982 rebalancer_tool.cc:1152] tablet 252899385eaa45b392974d2768e3cf01: '3136daf7101445beadc1aa19bc01c227' -> 'ca4469fc2dbc48488bc7ad7f482f129e' move completed: Incomplete: tablet 252899385eaa45b392974d2768e3cf01, TS 3136daf7101445beadc1aa19bc01c227 -> TS ca4469fc2dbc48488bc7ad7f482f129e move failed, target replica disappeared
I20260810 02:00:30.660136 6982 rebalancer_tool.cc:1152] tablet 7207ea155ba44c0a9ba216acd22dc1b4: 'dc85be7d460a404f997177f57680850f' -> '82f93d1d11364ceeb485585b4ae78871' move completed: OK
I20260810 02:00:30.788760 6982 rebalancer_tool.cc:1152] tablet 4fc45932b9634d6d98d8a0204d4b121a: '22ce0e487f0341fd9bf853393d6e7683' -> '' move completed: OK
I20260810 02:00:30.861264 6982 rebalancer_tool.cc:1152] tablet 389d3abfeadd4fe6a4efa74427d71c4d: '22ce0e487f0341fd9bf853393d6e7683' -> 'ca4469fc2dbc48488bc7ad7f482f129e' move completed: OK
I20260810 02:00:30.956494 6982 rebalancer_tool.cc:1152] tablet da507bc24d964ce1a5835edad5177726: 'dc85be7d460a404f997177f57680850f' -> '82f93d1d11364ceeb485585b4ae78871' move completed: OK
I20260810 02:00:31.038456 6982 rebalancer_tool.cc:1152] tablet 2e72e04459b140cc9e20ad633b1ab5c4: '22ce0e487f0341fd9bf853393d6e7683' -> 'dc85be7d460a404f997177f57680850f' move completed: OK
W20260810 02:00:33.294473 6982 rebalancer_tool.cc:1212] table 5b2df46262b142169af9a32c47535432: no follower replicas available on c5ed5317da9c464b93f979c405f0f6e4, falling back to leader replicas
W20260810 02:00:33.298534 6982 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 5b2df46262b142169af9a32c47535432: could not find any suitable replica to move from server c5ed5317da9c464b93f979c405f0f6e4 to server 22ce0e487f0341fd9bf853393d6e7683
I20260810 02:00:33.735020 6982 rebalancer_tool.cc:1090] tablet 4fc45932b9634d6d98d8a0204d4b121a: '4dd4cba155c941b4b7ad4d64c7431536' -> '22ce0e487f0341fd9bf853393d6e7683' move scheduled
I20260810 02:00:36.682842 6982 rebalancer_tool.cc:1152] tablet 4fc45932b9634d6d98d8a0204d4b121a: '4dd4cba155c941b4b7ad4d64c7431536' -> '22ce0e487f0341fd9bf853393d6e7683' move completed: OK
I20260810 02:00:38.636163 6982 rebalancer_tool.cc:1090] tablet 4a4350cf2ece4769b8547620ac5bedcb: '22ce0e487f0341fd9bf853393d6e7683' -> 'dc85be7d460a404f997177f57680850f' move scheduled
I20260810 02:00:39.167814 6982 rebalancer_tool.cc:1090] tablet 8308d63e9002418b876c3d3ae0095d9f: 'c5ed5317da9c464b93f979c405f0f6e4' -> '4dd4cba155c941b4b7ad4d64c7431536' move scheduled
I20260810 02:00:43.174945 6982 rebalancer_tool.cc:1152] tablet 8308d63e9002418b876c3d3ae0095d9f: 'c5ed5317da9c464b93f979c405f0f6e4' -> '4dd4cba155c941b4b7ad4d64c7431536' move completed: OK
I20260810 02:00:43.256834 6982 rebalancer_tool.cc:1152] tablet 4a4350cf2ece4769b8547620ac5bedcb: '22ce0e487f0341fd9bf853393d6e7683' -> 'dc85be7d460a404f997177f57680850f' move completed: OK
W20260810 02:00:44.808239 6982 rebalancer_tool.cc:1212] table 372310cb713644ada1071e8eb628b0c9: no follower replicas available on ca4469fc2dbc48488bc7ad7f482f129e, falling back to leader replicas
I20260810 02:00:45.051630 6982 rebalancer_tool.cc:1090] tablet 5528e3ba51a640eaa614f141440bb90b: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '82f93d1d11364ceeb485585b4ae78871' move scheduled
I20260810 02:00:45.185526 6982 rebalancer_tool.cc:1100] tablet f7a36f7ebd5d4342a259b093e45d4c32: '3136daf7101445beadc1aa19bc01c227' -> 'c5ed5317da9c464b93f979c405f0f6e4' move ignored: Illegal state: tablet f7a36f7ebd5d4342a259b093e45d4c32: replica c5ed5317da9c464b93f979c405f0f6e4 is already present
I20260810 02:00:45.185689 6982 rebalancer_tool.cc:772] re-synchronizing cluster state
I20260810 02:00:46.688409 6982 rebalancer_tool.cc:1090] tablet abf302f27a12414a8647dab82ab8101f: 'c5ed5317da9c464b93f979c405f0f6e4' -> '' move scheduled
W20260810 02:00:50.284829 28257 negotiation.cc:336] Failed RPC negotiation. Trace:
0810 02:00:49.984577 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.21.64.194:43893 (local address 127.0.0.1:37006)
0810 02:00:49.985058 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0810 02:00:49.985075 (+ 17us) client_negotiation.cc:175] Beginning negotiation
0810 02:00:49.985177 (+ 102us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0810 02:00:50.283794 (+298617us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.64.194:43893: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":397}
W20260810 02:00:50.441884 28246 negotiation.cc:336] Failed RPC negotiation. Trace:
0810 02:00:50.145134 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.21.64.196:41943 (local address 127.0.0.1:37018)
0810 02:00:50.145453 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0810 02:00:50.145473 (+ 20us) client_negotiation.cc:175] Beginning negotiation
0810 02:00:50.145581 (+ 108us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0810 02:00:50.441709 (+296128us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.64.196:41943: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":162}
I20260810 02:00:52.764451 6982 rebalancer_tool.cc:1152] tablet abf302f27a12414a8647dab82ab8101f: 'c5ed5317da9c464b93f979c405f0f6e4' -> '' move completed: OK
I20260810 02:00:52.811120 6982 rebalancer_tool.cc:1139] tablet 5528e3ba51a640eaa614f141440bb90b: 'ca4469fc2dbc48488bc7ad7f482f129e' -> '82f93d1d11364ceeb485585b4ae78871' move is abandoned: Network error: Client connection negotiation failed: client connection to 127.21.64.196:41943: connect: Connection refused (error 111)
Illegal state: tablet server 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): unacceptable health status UNAVAILABLE
E20260810 02:00:53.971480 21763 external_mini_cluster.cc:968] Process with UUID dc85be7d460a404f997177f57680850f has crashed
E20260810 02:00:53.971652 21763 external_mini_cluster.cc:968] Process with UUID 82f93d1d11364ceeb485585b4ae78871 has crashed
E20260810 02:00:53.971786 21763 external_mini_cluster.cc:968] Process with UUID ca4469fc2dbc48488bc7ad7f482f129e has crashed
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/mini-cluster/external_mini_cluster.cc:972: Failure
Expected equality of these values:
0
num_crashes
Which is: 3
At least one process crashed
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tools/rebalancer_tool-test.cc:1282: Failure
Expected: cluster_->AssertNoCrashes() doesn't generate new fatal failures in the current thread.
Actual: it does.
I20260810 02:00:53.973884 21763 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskNubV1X/build/asan/bin/kudu pid 4017
I20260810 02:00:53.981055 4188 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 02:00:54.365217 21763 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskNubV1X/build/asan/bin/kudu with pid 4017
W20260810 02:00:54.436631 6477 connection.cc:573] server connection from 127.21.64.195:39817 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 02:00:54.437003 3551 connection.cc:573] server connection from 127.21.64.195:60929 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 02:00:54.437495 21763 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskNubV1X/build/asan/bin/kudu pid 6284
W20260810 02:00:54.438264 6825 consensus_peers.cc:597] T abf302f27a12414a8647dab82ab8101f P 3136daf7101445beadc1aa19bc01c227 -> Peer 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189): Couldn't send request to peer 17b49c694faf479ea2e5083470fc0302. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.195:39189: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260810 02:00:54.438413 6825 consensus_peers.cc:597] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227 -> Peer 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189): Couldn't send request to peer 17b49c694faf479ea2e5083470fc0302. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.195:39189: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 02:00:54.443866 6439 generic_service.cc:196] Checking for leaks (request via RPC)
W20260810 02:00:54.522446 6479 consensus_peers.cc:597] T 8308d63e9002418b876c3d3ae0095d9f P 22ce0e487f0341fd9bf853393d6e7683 -> Peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): Couldn't send request to peer ca4469fc2dbc48488bc7ad7f482f129e. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.196:41943: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260810 02:00:54.778440 21763 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskNubV1X/build/asan/bin/kudu with pid 6284
W20260810 02:00:54.852504 6824 connection.cc:573] client connection to 127.21.64.197:38787 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 02:00:54.852823 6477 connection.cc:573] server connection from 127.21.64.197:46879 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 02:00:54.852972 6825 connection.cc:573] server connection from 127.21.64.197:45695 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 02:00:54.853189 21763 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskNubV1X/build/asan/bin/kudu pid 6455
W20260810 02:00:54.853538 6653 consensus_peers.cc:597] T da507bc24d964ce1a5835edad5177726 P c5ed5317da9c464b93f979c405f0f6e4 -> Peer 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197:38787): Couldn't send request to peer 4dd4cba155c941b4b7ad4d64c7431536. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.197:38787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260810 02:00:54.854527 6824 consensus_peers.cc:597] T 3a15b27dbdaf4092aea66c3670204fcc P 3136daf7101445beadc1aa19bc01c227 -> Peer 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197:38787): Couldn't send request to peer 4dd4cba155c941b4b7ad4d64c7431536. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.197:38787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 02:00:54.860044 6616 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 02:00:55.044804 28702 raft_consensus.cc:493] T c53fc4008faf445fa05e436b9c8e0282 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17b49c694faf479ea2e5083470fc0302)
I20260810 02:00:55.045054 28702 raft_consensus.cc:515] T c53fc4008faf445fa05e436b9c8e0282 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } }
I20260810 02:00:55.045836 28702 leader_election.cc:290] T c53fc4008faf445fa05e436b9c8e0282 P 3136daf7101445beadc1aa19bc01c227 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189), dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
W20260810 02:00:55.046710 6824 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.64.193:36797: connect: Connection refused (error 111)
W20260810 02:00:55.046710 6825 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.64.195:39189: connect: Connection refused (error 111) [suppressed 33 similar messages]
W20260810 02:00:55.047821 6824 leader_election.cc:336] T c53fc4008faf445fa05e436b9c8e0282 P 3136daf7101445beadc1aa19bc01c227 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797): Network error: Client connection negotiation failed: client connection to 127.21.64.193:36797: connect: Connection refused (error 111)
W20260810 02:00:55.047971 6825 leader_election.cc:336] T c53fc4008faf445fa05e436b9c8e0282 P 3136daf7101445beadc1aa19bc01c227 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189): Network error: Client connection negotiation failed: client connection to 127.21.64.195:39189: connect: Connection refused (error 111)
I20260810 02:00:55.048134 6825 leader_election.cc:304] T c53fc4008faf445fa05e436b9c8e0282 P 3136daf7101445beadc1aa19bc01c227 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3136daf7101445beadc1aa19bc01c227; no voters: 17b49c694faf479ea2e5083470fc0302, dc85be7d460a404f997177f57680850f
I20260810 02:00:55.048419 28702 raft_consensus.cc:2749] T c53fc4008faf445fa05e436b9c8e0282 P 3136daf7101445beadc1aa19bc01c227 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 02:00:55.121282 28702 raft_consensus.cc:493] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17b49c694faf479ea2e5083470fc0302)
I20260810 02:00:55.121541 28702 raft_consensus.cc:515] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 02:00:55.122318 28702 leader_election.cc:290] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 3136daf7101445beadc1aa19bc01c227 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893), 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189)
W20260810 02:00:55.123917 6826 leader_election.cc:336] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 3136daf7101445beadc1aa19bc01c227 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893): Network error: Client connection negotiation failed: client connection to 127.21.64.194:43893: connect: Connection refused (error 111)
W20260810 02:00:55.124238 6825 leader_election.cc:336] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 3136daf7101445beadc1aa19bc01c227 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189): Network error: Client connection negotiation failed: client connection to 127.21.64.195:39189: connect: Connection refused (error 111)
I20260810 02:00:55.124373 6825 leader_election.cc:304] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 3136daf7101445beadc1aa19bc01c227 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3136daf7101445beadc1aa19bc01c227; no voters: 17b49c694faf479ea2e5083470fc0302, 82f93d1d11364ceeb485585b4ae78871
I20260810 02:00:55.124699 28702 raft_consensus.cc:2749] T 18a93b1a1ce1440b99bdd7a3bcf49064 P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260810 02:00:55.184839 28702 raft_consensus.cc:493] T eb90d508a0004daa8f10d562cefe5fd6 P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17b49c694faf479ea2e5083470fc0302)
I20260810 02:00:55.185102 28702 raft_consensus.cc:515] T eb90d508a0004daa8f10d562cefe5fd6 P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 02:00:55.185947 28702 leader_election.cc:290] T eb90d508a0004daa8f10d562cefe5fd6 P 3136daf7101445beadc1aa19bc01c227 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189), ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943)
W20260810 02:00:55.187485 6826 leader_election.cc:336] T eb90d508a0004daa8f10d562cefe5fd6 P 3136daf7101445beadc1aa19bc01c227 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): Network error: Client connection negotiation failed: client connection to 127.21.64.196:41943: connect: Connection refused (error 111)
W20260810 02:00:55.187808 6825 leader_election.cc:336] T eb90d508a0004daa8f10d562cefe5fd6 P 3136daf7101445beadc1aa19bc01c227 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189): Network error: Client connection negotiation failed: client connection to 127.21.64.195:39189: connect: Connection refused (error 111)
I20260810 02:00:55.187942 6825 leader_election.cc:304] T eb90d508a0004daa8f10d562cefe5fd6 P 3136daf7101445beadc1aa19bc01c227 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3136daf7101445beadc1aa19bc01c227; no voters: 17b49c694faf479ea2e5083470fc0302, ca4469fc2dbc48488bc7ad7f482f129e
I20260810 02:00:55.188230 28702 raft_consensus.cc:2749] T eb90d508a0004daa8f10d562cefe5fd6 P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260810 02:00:55.206171 21763 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskNubV1X/build/asan/bin/kudu with pid 6455
I20260810 02:00:55.220703 28702 raft_consensus.cc:493] T be4737d169be4419b5a0a0b656a3930f P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17b49c694faf479ea2e5083470fc0302)
I20260810 02:00:55.220922 28702 raft_consensus.cc:515] T be4737d169be4419b5a0a0b656a3930f P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } }
I20260810 02:00:55.221689 28702 leader_election.cc:290] T be4737d169be4419b5a0a0b656a3930f P 3136daf7101445beadc1aa19bc01c227 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943), 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189)
W20260810 02:00:55.223709 6826 leader_election.cc:336] T be4737d169be4419b5a0a0b656a3930f P 3136daf7101445beadc1aa19bc01c227 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): Network error: Client connection negotiation failed: client connection to 127.21.64.196:41943: connect: Connection refused (error 111)
W20260810 02:00:55.224176 6825 leader_election.cc:336] T be4737d169be4419b5a0a0b656a3930f P 3136daf7101445beadc1aa19bc01c227 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189): Network error: Client connection negotiation failed: client connection to 127.21.64.195:39189: connect: Connection refused (error 111)
I20260810 02:00:55.224354 6825 leader_election.cc:304] T be4737d169be4419b5a0a0b656a3930f P 3136daf7101445beadc1aa19bc01c227 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3136daf7101445beadc1aa19bc01c227; no voters: 17b49c694faf479ea2e5083470fc0302, ca4469fc2dbc48488bc7ad7f482f129e
I20260810 02:00:55.224663 28702 raft_consensus.cc:2749] T be4737d169be4419b5a0a0b656a3930f P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260810 02:00:55.252789 28553 raft_consensus.cc:493] T 1d377b919f4748c88efb249dfc964f17 P c5ed5317da9c464b93f979c405f0f6e4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17b49c694faf479ea2e5083470fc0302)
I20260810 02:00:55.253072 28553 raft_consensus.cc:515] T 1d377b919f4748c88efb249dfc964f17 P c5ed5317da9c464b93f979c405f0f6e4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 02:00:55.254066 28553 leader_election.cc:290] T 1d377b919f4748c88efb249dfc964f17 P c5ed5317da9c464b93f979c405f0f6e4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943), 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189)
W20260810 02:00:55.255890 6655 leader_election.cc:336] T 1d377b919f4748c88efb249dfc964f17 P c5ed5317da9c464b93f979c405f0f6e4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943): Network error: Client connection negotiation failed: client connection to 127.21.64.196:41943: connect: Connection refused (error 111)
W20260810 02:00:55.256150 6654 leader_election.cc:336] T 1d377b919f4748c88efb249dfc964f17 P c5ed5317da9c464b93f979c405f0f6e4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189): Network error: Client connection negotiation failed: client connection to 127.21.64.195:39189: connect: Connection refused (error 111)
I20260810 02:00:55.256237 6654 leader_election.cc:304] T 1d377b919f4748c88efb249dfc964f17 P c5ed5317da9c464b93f979c405f0f6e4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ed5317da9c464b93f979c405f0f6e4; no voters: 17b49c694faf479ea2e5083470fc0302, ca4469fc2dbc48488bc7ad7f482f129e
I20260810 02:00:55.256564 28553 raft_consensus.cc:2749] T 1d377b919f4748c88efb249dfc964f17 P c5ed5317da9c464b93f979c405f0f6e4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260810 02:00:55.281502 3554 connection.cc:573] server connection from 127.21.64.198:37671 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 02:00:55.282181 21763 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskNubV1X/build/asan/bin/kudu pid 6628
W20260810 02:00:55.282271 6826 consensus_peers.cc:597] T 3a15b27dbdaf4092aea66c3670204fcc P 3136daf7101445beadc1aa19bc01c227 -> Peer 22ce0e487f0341fd9bf853393d6e7683 (127.21.64.198:45317): Couldn't send request to peer 22ce0e487f0341fd9bf853393d6e7683. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.198:45317: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 02:00:55.288331 6790 generic_service.cc:196] Checking for leaks (request via RPC)
W20260810 02:00:55.530823 6824 consensus_peers.cc:597] T d05e147199e44b8ca712e18d22e7cce7 P 3136daf7101445beadc1aa19bc01c227 -> Peer dc85be7d460a404f997177f57680850f (127.21.64.193:36797): Couldn't send request to peer dc85be7d460a404f997177f57680850f. Status: Network error: Client connection negotiation failed: client connection to 127.21.64.193:36797: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260810 02:00:55.615162 28553 raft_consensus.cc:493] T a586b7d625bb4c27a6343ae7918c8cea P c5ed5317da9c464b93f979c405f0f6e4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17b49c694faf479ea2e5083470fc0302)
I20260810 02:00:55.615397 28553 raft_consensus.cc:515] T a586b7d625bb4c27a6343ae7918c8cea P c5ed5317da9c464b93f979c405f0f6e4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ca4469fc2dbc48488bc7ad7f482f129e" member_type: VOTER last_known_addr { host: "127.21.64.196" port: 41943 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } } peers { permanent_uuid: "17b49c694faf479ea2e5083470fc0302" member_type: VOTER last_known_addr { host: "127.21.64.195" port: 39189 } }
I20260810 02:00:55.616166 28553 leader_election.cc:290] T a586b7d625bb4c27a6343ae7918c8cea P c5ed5317da9c464b93f979c405f0f6e4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca4469fc2dbc48488bc7ad7f482f129e (127.21.64.196:41943), 17b49c694faf479ea2e5083470fc0302 (127.21.64.195:39189)
I20260810 02:00:55.616694 28553 raft_consensus.cc:493] T b63d0798e1ae4aea9b0272716d53d46d P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 82f93d1d11364ceeb485585b4ae78871)
I20260810 02:00:55.616885 28553 raft_consensus.cc:515] T b63d0798e1ae4aea9b0272716d53d46d P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "dc85be7d460a404f997177f57680850f" member_type: VOTER last_known_addr { host: "127.21.64.193" port: 36797 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 02:00:55.617539 28553 leader_election.cc:290] T b63d0798e1ae4aea9b0272716d53d46d P c5ed5317da9c464b93f979c405f0f6e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893), dc85be7d460a404f997177f57680850f (127.21.64.193:36797)
W20260810 02:00:55.617799 6654 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.64.195:39189: connect: Connection refused (error 111) [suppressed 29 similar messages]
I20260810 02:00:55.617422 28908 raft_consensus.cc:493] T f3d04e9457c944a8a72861680bdf9b7c P c5ed5317da9c464b93f979c405f0f6e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17b49c694faf479ea2e5083470fc0302)
I20260810 02:00:55.618830 21763 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskNubV1X/build/asan/bin/kudu with pid 6628
I20260810 02:00:55.686736 21763 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskNubV1X/build/asan/bin/kudu pid 6803
I20260810 02:00:55.696894 6956 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 02:00:56.026341 28702 raft_consensus.cc:493] T f7a36f7ebd5d4342a259b093e45d4c32 P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4dd4cba155c941b4b7ad4d64c7431536)
I20260810 02:00:56.026592 28702 raft_consensus.cc:515] T f7a36f7ebd5d4342a259b093e45d4c32 P 3136daf7101445beadc1aa19bc01c227 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82f93d1d11364ceeb485585b4ae78871" member_type: VOTER last_known_addr { host: "127.21.64.194" port: 43893 } } peers { permanent_uuid: "4dd4cba155c941b4b7ad4d64c7431536" member_type: VOTER last_known_addr { host: "127.21.64.197" port: 38787 } } peers { permanent_uuid: "3136daf7101445beadc1aa19bc01c227" member_type: VOTER last_known_addr { host: "127.21.64.200" port: 32995 } } peers { permanent_uuid: "c5ed5317da9c464b93f979c405f0f6e4" member_type: VOTER last_known_addr { host: "127.21.64.199" port: 41689 } }
I20260810 02:00:56.027710 28702 leader_election.cc:290] T f7a36f7ebd5d4342a259b093e45d4c32 P 3136daf7101445beadc1aa19bc01c227 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 82f93d1d11364ceeb485585b4ae78871 (127.21.64.194:43893), 4dd4cba155c941b4b7ad4d64c7431536 (127.21.64.197:38787), c5ed5317da9c464b93f979c405f0f6e4 (127.21.64.199:41689)
I20260810 02:00:56.030280 21763 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskNubV1X/build/asan/bin/kudu with pid 6803
I20260810 02:00:56.095618 21763 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskNubV1X/build/asan/bin/kudu pid 3534
I20260810 02:00:56.102675 3616 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 02:00:56.430163 21763 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskNubV1X/build/asan/bin/kudu with pid 3534
2026-08-10T02:00:56Z chronyd exiting
I20260810 02:00:56.509831 21763 test_util.cc:182] -----------------------------------------------
I20260810 02:00:56.509965 21763 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786326929400868-21763-0
[ FAILED ] ConcurrentRebalancersTest.TwoConcurrentRebalancers/0, where GetParam() = 4-byte object <00-00 00-00> (137730 ms)
[----------] 1 test from ConcurrentRebalancersTest (137730 ms total)
[----------] 1 test from RebalancerAndSingleReplicaTablets
[ RUN ] RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove/0
I20260810 02:00:56.514285 21763 ts_itest-base.cc:115] Starting cluster with:
I20260810 02:00:56.514360 21763 ts_itest-base.cc:116] --------------
I20260810 02:00:56.514396 21763 ts_itest-base.cc:117] 4 tablet servers
I20260810 02:00:56.514474 21763 ts_itest-base.cc:118] 1 replicas per TS
I20260810 02:00:56.514523 21763 ts_itest-base.cc:119] --------------
2026-08-10T02:00:56Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-10T02:00:56Z Disabled control of system clock
I20260810 02:00:56.602322 21763 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNubV1X/build/asan/bin/kudu
/tmp/dist-test-taskNubV1X/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.64.254:46681
--webserver_interface=127.21.64.254
--webserver_port=0
--builtin_ntp_servers=127.21.64.212:40591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.64.254:46681
--raft_prepare_replacement_before_eviction=false
--tserver_unresponsive_timeout_ms=3000
--enable_range_replica_placement=false with env {}
W20260810 02:00:57.005188 28931 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 02:00:57.005618 28931 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 02:00:57.005703 28931 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 02:00:57.014207 28931 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260810 02:00:57.014326 28931 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 02:00:57.014400 28931 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 02:00:57.014448 28931 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 02:00:57.014505 28931 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260810 02:00:57.024726 28931 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.64.212:40591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/wal
--enable_range_replica_placement=false
--ipki_ca_key_size=768
--master_addresses=127.21.64.254:46681
--tserver_unresponsive_timeout_ms=3000
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.64.254:46681
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.21.64.254
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 01:44:04 UTC on e7f111948823
build id 13266
ASAN enabled
I20260810 02:00:57.026515 28931 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 02:00:57.028406 28931 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 02:00:57.037154 28936 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 02:00:57.037184 28939 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 02:00:57.037959 28941 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 02:00:57.038882 28931 server_base.cc:1061] running on GCE node
I20260810 02:00:57.039669 28931 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 02:00:57.041126 28931 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 02:00:57.042351 28931 hybrid_clock.cc:648] HybridClock initialized: now 1786327257042278 us; error 47 us; skew 500 ppm
I20260810 02:00:57.042692 28931 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 02:00:57.044857 28931 webserver.cc:533] Webserver started at http://127.21.64.254:34985/ using document root <none> and password file <none>
I20260810 02:00:57.045674 28931 fs_manager.cc:362] Metadata directory not provided
I20260810 02:00:57.045814 28931 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 02:00:57.046191 28931 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 02:00:57.048621 28931 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "dae9b579cdee4ad99df93c99807cc5dd"
format_stamp: "Formatted at 2026-08-10 02:00:57 on dist-test-slave-bw88"
I20260810 02:00:57.049475 28931 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "dae9b579cdee4ad99df93c99807cc5dd"
format_stamp: "Formatted at 2026-08-10 02:00:57 on dist-test-slave-bw88"
W20260810 02:00:57.054949 28931 dir_manager.cc:275] Insufficient disk space under path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/data/data: will retry after 10 seconds: IO error: Insufficient disk space to allocate 0 bytes under path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/data/data (495271936 bytes available vs 518351011 bytes reserved) (error 28)
I20260810 02:00:57.055141 28931 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260810 02:00:57.058619 28948 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 02:00:57.059893 28931 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260810 02:00:57.060096 28931 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/wal
uuid: "dae9b579cdee4ad99df93c99807cc5dd"
format_stamp: "Formatted at 2026-08-10 02:00:57 on dist-test-slave-bw88"
I20260810 02:00:57.060321 28931 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 02:00:57.095641 28931 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 02:00:57.096623 28931 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 02:00:57.096953 28931 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 02:00:57.119603 28931 rpc_server.cc:307] RPC server started. Bound to: 127.21.64.254:46681
I20260810 02:00:57.119643 29018 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.64.254:46681 every 8 connection(s)
I20260810 02:00:57.121429 28931 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260810 02:00:57.122094 21763 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNubV1X/build/asan/bin/kudu as pid 28931
I20260810 02:00:57.122344 21763 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/wal/instance
W20260810 02:00:57.126899 29019 dir_manager.cc:275] Insufficient disk space under path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/data/data: will retry after 10 seconds: IO error: Insufficient disk space to allocate 0 bytes under path /tmp/dist-test-taskNubV1X/test-tmp/rebalancer_tool-test.3.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_0.1786326929400868-21763-0/raft_consensus-itest-cluster/master-0/data/data (495267840 bytes available vs 518351011 bytes reserved) (error 28)
E20260810 02:00:57.127338 29019 master.cc:417] Unable to init master catalog manager: IO error: Unable to initialize catalog manager: Failed to initialize sys tables async: Failed to create TabletMetadata: All healthy data directories are full (error 28)
I20260810 02:00:57.127651 28931 master.cc:562] Master@127.21.64.254:46681 shutting down...
I20260810 02:00:57.157299 28931 master.cc:584] Master@127.21.64.254:46681 shutdown complete.
W20260810 02:00:57.159339 28931 builtin_ntp.cc:688] coult not shutdown socket: Network error: shutdown error: Transport endpoint is not connected (error 107)
IO error: Unable to initialize catalog manager: Failed to initialize sys tables async: Failed to create TabletMetadata: All healthy data directories are full (error 28)
F20260810 02:01:02.147470 21763 external_mini_cluster.cc:656] Check failed: leader_master() != nullptr Must have started at least 1 master before adding tablet servers
*** Check failure stack trace: ***
*** Aborted at 1786327262 (unix time) try "date -d @1786327262" if you are using GNU date ***
PC: @ 0x0 (unknown)
*** SIGABRT (@0x3e800005503) received by PID 21763 (TID 0x7f6ef574fd40) from PID 21763; stack trace: ***
@ 0x7f6f009e5980 (unknown) at ??:0
@ 0x7f6ef6209e87 gsignal at ??:0
@ 0x7f6ef620b7f1 abort at ??:0
@ 0x7f6ef89bed5d google::LogMessage::Fail() at ??:0
@ 0x7f6ef89c2b23 google::LogMessage::SendToLog() at ??:0
@ 0x7f6ef89be75c google::LogMessage::Flush() at ??:0
@ 0x7f6ef89bfee9 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f6f0f9332a6 kudu::cluster::ExternalMiniCluster::AddTabletServer() at ??:0
@ 0x7f6f0f92c86f kudu::cluster::ExternalMiniCluster::Start() at ??:0
@ 0x7f6f10332f62 kudu::tserver::TabletServerIntegrationTestBase::CreateCluster() at ??:0
@ 0x7f6f1033d1d7 kudu::tserver::TabletServerIntegrationTestBase::BuildAndStart() at ??:0
@ 0x613b4f kudu::tools::RebalancerAndSingleReplicaTablets_SingleReplicasStayOrMove_Test::TestBody() at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tools/rebalancer_tool-test.cc:1645
@ 0x7f6f0eb460ed testing::internal::HandleExceptionsInMethodIfSupported<>() at ??:0
@ 0x7f6f0eb3abdb testing::Test::Run() at ??:0
@ 0x7f6f0eb3ad9d testing::TestInfo::Run() at ??:0
@ 0x7f6f0eb3b377 testing::TestSuite::Run() at ??:0
@ 0x7f6f0eb3b77c testing::internal::UnitTestImpl::RunAllTests() at ??:0
@ 0x7f6f0eb4660d testing::internal::HandleExceptionsInMethodIfSupported<>() at ??:0
@ 0x7f6f0eb3ae63 testing::UnitTest::Run() at ??:0
@ 0x702e52 RUN_ALL_TESTS() at /home/jenkins-slave/workspace/build_and_test_flaky@2/thirdparty/installed/uninstrumented/include/gtest/gtest.h:2293
@ 0x700d29 main at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/test_main.cc:115
@ 0x7f6ef61ecc87 __libc_start_main at ??:0
@ 0x50fa6a _start at ??:?